{ "cells": [ { "cell_type": "markdown", "metadata": { "id": "6bYaCABobL5q" }, "source": [ "##### Copyright 2018 The TensorFlow Authors." ] }, { "cell_type": "code", "execution_count": 1, "metadata": { "cellView": "form", "execution": { "iopub.execute_input": "2022-12-14T21:00:27.466139Z", "iopub.status.busy": "2022-12-14T21:00:27.465730Z", "iopub.status.idle": "2022-12-14T21:00:27.470060Z", "shell.execute_reply": "2022-12-14T21:00:27.469497Z" }, "id": "FlUw7tSKbtg4" }, "outputs": [], "source": [ "#@title Licensed under the Apache License, Version 2.0 (the \"License\");\n", "# you may not use this file except in compliance with the License.\n", "# You may obtain a copy of the License at\n", "#\n", "# https://www.apache.org/licenses/LICENSE-2.0\n", "#\n", "# Unless required by applicable law or agreed to in writing, software\n", "# distributed under the License is distributed on an \"AS IS\" BASIS,\n", "# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.\n", "# See the License for the specific language governing permissions and\n", "# limitations under the License." ] }, { "cell_type": "markdown", "metadata": { "id": "08OTcmxgqkc2" }, "source": [ "# 自动重写 TF 1.x 和 compat.v1 API 符号\n", "\n", "\n", " \n", " \n", " \n", " \n", "
在 TensorFlow.org 上查看 在 Google Colab 运行\n", " 在 Github 上查看源代码\n", " 下载笔记本\n", "
\n" ] }, { "cell_type": "markdown", "metadata": { "id": "hZSaRPoybOp5" }, "source": [ "TensorFlow 2.x 包含 TF 1.x 和 `tf.compat.v1` API 的许多 API 更改，例如重新排序了参数，重命名了符号，更改了参数的默认值。手动执行所有这些修改可能很乏味，而且很容易出错。为了简化更改，尽可能让您无缝过渡到 TF 2.x，TensorFlow 团队创建了 `tf_upgrade_v2` 效用函数，帮助您将旧版代码转换至新的 API。\n", "\n", "注：TensorFlow 1.13 和更高版本（包括所有 TF 2.0 构建）会自动安装 `tf_upgrade_v2`。\n", "\n", "典型的用法如下：\n", "\n", "
\n",
    "tf_upgrade_v2 \\\n",
    "  --intree my_project/ \\\n",
    "  --outtree my_project_v2/ \\\n",
    "  --reportfile report.txt\n",
    "
\n", "\n", "将现有 TensorFlow 1.x Python 脚本转换为 TensorFlow 2.x 脚本可以加快升级流程。\n", "\n", "尽管许多 API 无法自动迁移，但转换脚本会自动执行许多机械 API 转换。它也无法使您的代码与 TF2 行为和 API 完全兼容。因此，这只是您迁移之旅的一部分。" ] }, { "cell_type": "markdown", "metadata": { "id": "gP9v2vgptdfi" }, "source": [ "## 兼容性模块\n", "\n", "某些 API 符号不能简单地通过使用字符串替换来升级。那些无法自动升级的符号将被映射到它们在 `compat.v1` 模块中的位置。此模块将 `tf.foo` 等 TF 1.x 符号替换为对应的 `tf.compat.v1.foo` 引用。如果您已经通过 `import tensorflow.compat.v1 as tf` 导入 TF 来使用 `compat.v1` API，`tf_upgrade_v2` 脚本会尝试尽可能将这些用法转换为非兼容 API。请注意，尽管有些 `compat.v1` API 与 TF2.x 行为兼容，但许多 API 不兼容。因此，建议尽快手动检查替换并将它们迁移到 `tf.*` 命名空间而不是 `tf.compat.v1` 命名空间中的新 API。\n", "\n", "由于在 TensorFlow 2.x 模块弃用（例如，`tf.flags` 和 `tf.contrib`），所以切换到 `compat.v1` 无法解决某些更改。升级此代码可能需要其他库（例如，[`absl.flags`](https://github.com/abseil/abseil-py)）或切换到 [tensorflow/addons](http://www.github.com/tensorflow/addons) 中的软件包。\n" ] }, { "cell_type": "markdown", "metadata": { "id": "s78bbfjkXYb7" }, "source": [ "## 推荐的升级流程\n", "\n", "本指南的剩余部分将演示如何使用符号重写脚本。虽然此脚本易于使用，但我们仍强烈建议按照以下流程使用脚本：\n", "\n", "1. **单元测试**：确保要升级的代码包含具有合理覆盖率的单元测试套件。这是 Python 代码，该语言并不会帮助您避免各种类型的错误。同时还要确保已升级所有依赖项，使其与 TensorFlow 2.x 兼容。\n", "\n", "2. **安装 TensorFlow 1.15**：将 TensorFlow 升级到最新的 TensorFlow 1.x 版本（最低为 1.15 版本）。其中包括 `tf.compat.v2` 中的最终 TensorFlow 2.0 API。\n", "\n", "3. **使用 1.15 版本进行测试**：确保此时可以通过单元测试。在升级过程中，您将反复进行测试，因此，从可以正常运行的代码开始非常重要。\n", "\n", "4. **运行升级脚本**：对整个源代码树运行 `tf_upgrade_v2`（已包含测试）。这样可将代码升级为仅使用 TensorFlow 2.0 中提供的符号的格式。被弃用的符号将通过 `tf.compat.v1` 进行访问。最终需要人工检查这些升级，但不是现在。\n", "\n", "5. **使用 TensorFlow 1.15 运行转换的测试**：代码在 TensorFlow 1.15 中应该仍可以正常运行。再次运行单元测试。测试在此时产生任何错误都意味着升级脚本存在错误。[请通知我们](https://github.com/tensorflow/tensorflow/issues)。\n", "\n", "6. **检查更新报告中的警告和错误**：该脚本会编写一个对需要复查的转换或需要执行的人工操作进行解释的报告文件。例如：contrib 的所有剩余实例需要通过人工移除。请查阅 [RFC 中的详细说明](https://github.com/tensorflow/community/blob/master/rfcs/20180907-contrib-sunset.md)。\n", "\n", "7. **安装 TensorFlow 2.x**：此时切换到 TensorFlow 2.x 二进制文件应当是安全的，即使您正在运行旧版行为\n", "\n", "8. **使用 `v1.disable_v2_behavior` 进行测试**：使用测试主函数中的 `v1.disable_v2_behavior()` 重新运行测试产生的结果应与在 1.15 下运行时产生的结果相同。\n", "\n", "9. **启用 V2 行为**：现在，您的测试使用 TF2 二进制文件工作，现在可以开始迁移代码以避免 `tf.estimator` 并仅使用受支持的 TF2 行为（不停用 TF2 行为）。请参阅[迁移指南](https://tensorflow.org/guide/migrate)以了解详情。" ] }, { "cell_type": "markdown", "metadata": { "id": "6pwSAQEwvscP" }, "source": [ "## 使用符号重写 `tf_upgrade_v2` 脚本\n" ] }, { "cell_type": "markdown", "metadata": { "id": "I9NCvDt5GwX4" }, "source": [ "### 安装\n", "\n", "首先，请确保已安装 TensorFlow 2.x。" ] }, { "cell_type": "code", "execution_count": 2, "metadata": { "execution": { "iopub.execute_input": "2022-12-14T21:00:27.473859Z", "iopub.status.busy": "2022-12-14T21:00:27.473399Z", "iopub.status.idle": "2022-12-14T21:00:29.386150Z", "shell.execute_reply": "2022-12-14T21:00:29.385457Z" }, "id": "DWVYbvi1WCeY" }, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "2022-12-14 21:00:28.410584: W tensorflow/compiler/xla/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libnvinfer.so.7'; dlerror: libnvinfer.so.7: cannot open shared object file: No such file or directory\n", "2022-12-14 21:00:28.410673: W tensorflow/compiler/xla/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libnvinfer_plugin.so.7'; dlerror: libnvinfer_plugin.so.7: cannot open shared object file: No such file or directory\n", "2022-12-14 21:00:28.410683: W tensorflow/compiler/tf2tensorrt/utils/py_utils.cc:38] TF-TRT Warning: Cannot dlopen some TensorRT libraries. If you would like to use Nvidia GPU with TensorRT, please make sure the missing libraries mentioned above are installed properly.\n" ] }, { "name": "stdout", "output_type": "stream", "text": [ "2.11.0\n" ] } ], "source": [ "import tensorflow as tf\n", "\n", "print(tf.__version__)" ] }, { "cell_type": "markdown", "metadata": { "id": "Ycy3B5PNGutU" }, "source": [ "克隆 [tensorflow/models](https://github.com/tensorflow/models)s git 仓库，以便获得要测试的一些代码：" ] }, { "cell_type": "code", "execution_count": 3, "metadata": { "execution": { "iopub.execute_input": "2022-12-14T21:00:29.390234Z", "iopub.status.busy": "2022-12-14T21:00:29.389538Z", "iopub.status.idle": "2022-12-14T21:00:41.362367Z", "shell.execute_reply": "2022-12-14T21:00:41.361539Z" }, "id": "jyckoWyAZEhZ" }, "outputs": [ { "name": "stdout", "output_type": "stream", "text": [ "Cloning into 'models'...\r\n" ] }, { "name": "stdout", "output_type": "stream", "text": [ "remote: Enumerating objects: 2927, done.\u001b[K\r\n", "remote: Counting objects: 0% (1/2927)\u001b[K\r", "remote: Counting objects: 1% (30/2927)\u001b[K\r", "remote: Counting objects: 2% (59/2927)\u001b[K\r", "remote: Counting objects: 3% (88/2927)\u001b[K\r", "remote: Counting objects: 4% (118/2927)\u001b[K\r", "remote: Counting objects: 5% (147/2927)\u001b[K\r", "remote: Counting objects: 6% (176/2927)\u001b[K\r", "remote: Counting objects: 7% (205/2927)\u001b[K\r", "remote: Counting objects: 8% (235/2927)\u001b[K\r", "remote: Counting objects: 9% (264/2927)\u001b[K\r", "remote: Counting objects: 10% (293/2927)\u001b[K\r", "remote: Counting objects: 11% (322/2927)\u001b[K\r", "remote: Counting objects: 12% (352/2927)\u001b[K\r", "remote: Counting objects: 13% (381/2927)\u001b[K\r", "remote: Counting objects: 14% (410/2927)\u001b[K\r", "remote: Counting objects: 15% (440/2927)\u001b[K\r", "remote: Counting objects: 16% (469/2927)\u001b[K\r", "remote: Counting objects: 17% (498/2927)\u001b[K\r", "remote: Counting objects: 18% (527/2927)\u001b[K\r", "remote: Counting objects: 19% (557/2927)\u001b[K\r", "remote: Counting objects: 20% (586/2927)\u001b[K\r", "remote: Counting objects: 21% (615/2927)\u001b[K\r", "remote: Counting objects: 22% (644/2927)\u001b[K\r", "remote: Counting objects: 23% (674/2927)\u001b[K\r", "remote: Counting objects: 24% (703/2927)\u001b[K\r", "remote: Counting objects: 25% (732/2927)\u001b[K\r", "remote: Counting objects: 26% (762/2927)\u001b[K\r", "remote: Counting objects: 27% (791/2927)\u001b[K\r", "remote: Counting objects: 28% (820/2927)\u001b[K\r", "remote: Counting objects: 29% (849/2927)\u001b[K\r", "remote: Counting objects: 30% (879/2927)\u001b[K\r", "remote: Counting objects: 31% (908/2927)\u001b[K\r", "remote: Counting objects: 32% (937/2927)\u001b[K\r", "remote: Counting objects: 33% (966/2927)\u001b[K\r", "remote: Counting objects: 34% (996/2927)\u001b[K\r", "remote: Counting objects: 35% (1025/2927)\u001b[K\r", "remote: Counting objects: 36% (1054/2927)\u001b[K\r", "remote: Counting objects: 37% (1083/2927)\u001b[K\r", "remote: Counting objects: 38% (1113/2927)\u001b[K\r", "remote: Counting objects: 39% (1142/2927)\u001b[K\r", "remote: Counting objects: 40% (1171/2927)\u001b[K\r", "remote: Counting objects: 41% (1201/2927)\u001b[K\r", "remote: Counting objects: 42% (1230/2927)\u001b[K\r", "remote: Counting objects: 43% (1259/2927)\u001b[K\r", "remote: Counting objects: 44% (1288/2927)\u001b[K\r", "remote: Counting objects: 45% (1318/2927)\u001b[K\r", "remote: Counting objects: 46% (1347/2927)\u001b[K\r", "remote: Counting objects: 47% (1376/2927)\u001b[K\r", "remote: Counting objects: 48% (1405/2927)\u001b[K\r", "remote: Counting objects: 49% (1435/2927)\u001b[K\r", "remote: Counting objects: 50% (1464/2927)\u001b[K\r", "remote: Counting objects: 51% (1493/2927)\u001b[K\r", "remote: Counting objects: 52% (1523/2927)\u001b[K\r", "remote: Counting objects: 53% (1552/2927)\u001b[K\r", "remote: Counting objects: 54% (1581/2927)\u001b[K\r", "remote: Counting objects: 55% (1610/2927)\u001b[K\r", "remote: Counting objects: 56% (1640/2927)\u001b[K\r", "remote: Counting objects: 57% (1669/2927)\u001b[K\r", "remote: Counting objects: 58% (1698/2927)\u001b[K\r", "remote: Counting objects: 59% (1727/2927)\u001b[K\r", "remote: Counting objects: 60% (1757/2927)\u001b[K\r", "remote: Counting objects: 61% (1786/2927)\u001b[K\r", "remote: Counting objects: 62% (1815/2927)\u001b[K\r", "remote: Counting objects: 63% (1845/2927)\u001b[K\r", "remote: Counting objects: 64% (1874/2927)\u001b[K\r", "remote: Counting objects: 65% (1903/2927)\u001b[K\r", "remote: Counting objects: 66% (1932/2927)\u001b[K\r", "remote: Counting objects: 67% (1962/2927)\u001b[K\r", "remote: Counting objects: 68% (1991/2927)\u001b[K\r", "remote: Counting objects: 69% (2020/2927)\u001b[K\r", "remote: Counting objects: 70% (2049/2927)\u001b[K\r", "remote: Counting objects: 71% (2079/2927)\u001b[K\r", "remote: Counting objects: 72% (2108/2927)\u001b[K\r", "remote: Counting objects: 73% (2137/2927)\u001b[K\r", "remote: Counting objects: 74% (2166/2927)\u001b[K\r", "remote: Counting objects: 75% (2196/2927)\u001b[K\r", "remote: Counting objects: 76% (2225/2927)\u001b[K\r", "remote: Counting objects: 77% (2254/2927)\u001b[K\r", "remote: Counting objects: 78% (2284/2927)\u001b[K\r", "remote: Counting objects: 79% (2313/2927)\u001b[K\r", "remote: Counting objects: 80% (2342/2927)\u001b[K\r", "remote: Counting objects: 81% (2371/2927)\u001b[K\r", "remote: Counting objects: 82% (2401/2927)\u001b[K\r", "remote: Counting objects: 83% (2430/2927)\u001b[K\r", "remote: Counting objects: 84% (2459/2927)\u001b[K\r", "remote: Counting objects: 85% (2488/2927)\u001b[K\r", "remote: Counting objects: 86% (2518/2927)\u001b[K\r", "remote: Counting objects: 87% (2547/2927)\u001b[K\r", "remote: Counting objects: 88% (2576/2927)\u001b[K\r", "remote: Counting objects: 89% (2606/2927)\u001b[K\r", "remote: Counting objects: 90% (2635/2927)\u001b[K\r", "remote: Counting objects: 91% (2664/2927)\u001b[K\r", "remote: Counting objects: 92% (2693/2927)\u001b[K\r", "remote: Counting objects: 93% (2723/2927)\u001b[K\r", "remote: Counting objects: 94% (2752/2927)\u001b[K\r", "remote: Counting objects: 95% (2781/2927)\u001b[K\r", "remote: Counting objects: 96% (2810/2927)\u001b[K\r", "remote: Counting objects: 97% (2840/2927)\u001b[K\r", "remote: Counting objects: 98% (2869/2927)\u001b[K\r", "remote: Counting objects: 99% (2898/2927)\u001b[K\r", "remote: Counting objects: 100% (2927/2927)\u001b[K\r", "remote: Counting objects: 100% (2927/2927), done.\u001b[K\r\n", "remote: Compressing objects: 0% (1/2428)\u001b[K\r", "remote: Compressing objects: 1% (25/2428)\u001b[K\r", "remote: Compressing objects: 2% (49/2428)\u001b[K\r", "remote: Compressing objects: 3% (73/2428)\u001b[K\r", "remote: Compressing objects: 4% (98/2428)\u001b[K\r", "remote: Compressing objects: 5% (122/2428)\u001b[K\r" ] }, { "name": "stdout", "output_type": "stream", "text": [ "remote: Compressing objects: 6% (146/2428)\u001b[K\r", "remote: Compressing objects: 7% (170/2428)\u001b[K\r", "remote: Compressing objects: 8% (195/2428)\u001b[K\r", "remote: Compressing objects: 9% (219/2428)\u001b[K\r", "remote: Compressing objects: 10% (243/2428)\u001b[K\r", "remote: Compressing objects: 11% (268/2428)\u001b[K\r", "remote: Compressing objects: 12% (292/2428)\u001b[K\r" ] }, { "name": "stdout", "output_type": "stream", "text": [ "remote: Compressing objects: 13% (316/2428)\u001b[K\r", "remote: Compressing objects: 14% (340/2428)\u001b[K\r", "remote: Compressing objects: 15% (365/2428)\u001b[K\r", "remote: Compressing objects: 16% (389/2428)\u001b[K\r", "remote: Compressing objects: 17% (413/2428)\u001b[K\r", "remote: Compressing objects: 18% (438/2428)\u001b[K\r", "remote: Compressing objects: 19% (462/2428)\u001b[K\r", "remote: Compressing objects: 20% (486/2428)\u001b[K\r" ] }, { "name": "stdout", "output_type": "stream", "text": [ "remote: Compressing objects: 21% (510/2428)\u001b[K\r", "remote: Compressing objects: 22% (535/2428)\u001b[K\r", "remote: Compressing objects: 23% (559/2428)\u001b[K\r", "remote: Compressing objects: 24% (583/2428)\u001b[K\r", "remote: Compressing objects: 25% (607/2428)\u001b[K\r", "remote: Compressing objects: 26% (632/2428)\u001b[K\r", "remote: Compressing objects: 27% (656/2428)\u001b[K\r" ] }, { "name": "stdout", "output_type": "stream", "text": [ "remote: Compressing objects: 28% (680/2428)\u001b[K\r", "remote: Compressing objects: 29% (705/2428)\u001b[K\r", "remote: Compressing objects: 30% (729/2428)\u001b[K\r", "remote: Compressing objects: 31% (753/2428)\u001b[K\r", "remote: Compressing objects: 32% (777/2428)\u001b[K\r", "remote: Compressing objects: 33% (802/2428)\u001b[K\r" ] }, { "name": "stdout", "output_type": "stream", "text": [ "remote: Compressing objects: 34% (826/2428)\u001b[K\r", "remote: Compressing objects: 35% (850/2428)\u001b[K\r", "remote: Compressing objects: 36% (875/2428)\u001b[K\r", "remote: Compressing objects: 37% (899/2428)\u001b[K\r", "remote: Compressing objects: 38% (923/2428)\u001b[K\r", "remote: Compressing objects: 39% (947/2428)\u001b[K\r", "remote: Compressing objects: 40% (972/2428)\u001b[K\r", "remote: Compressing objects: 41% (996/2428)\u001b[K\r" ] }, { "name": "stdout", "output_type": "stream", "text": [ "remote: Compressing objects: 42% (1020/2428)\u001b[K\r", "remote: Compressing objects: 43% (1045/2428)\u001b[K\r", "remote: Compressing objects: 44% (1069/2428)\u001b[K\r", "remote: Compressing objects: 45% (1093/2428)\u001b[K\r", "remote: Compressing objects: 46% (1117/2428)\u001b[K\r" ] }, { "name": "stdout", "output_type": "stream", "text": [ "remote: Compressing objects: 47% (1142/2428)\u001b[K\r", "remote: Compressing objects: 48% (1166/2428)\u001b[K\r", "remote: Compressing objects: 49% (1190/2428)\u001b[K\r", "remote: Compressing objects: 50% (1214/2428)\u001b[K\r", "remote: Compressing objects: 51% (1239/2428)\u001b[K\r", "remote: Compressing objects: 52% (1263/2428)\u001b[K\r", "remote: Compressing objects: 53% (1287/2428)\u001b[K\r", "remote: Compressing objects: 54% (1312/2428)\u001b[K\r", "remote: Compressing objects: 55% (1336/2428)\u001b[K\r", "remote: Compressing objects: 56% (1360/2428)\u001b[K\r", "remote: Compressing objects: 57% (1384/2428)\u001b[K\r", "remote: Compressing objects: 58% (1409/2428)\u001b[K\r", "remote: Compressing objects: 59% (1433/2428)\u001b[K\r", "remote: Compressing objects: 60% (1457/2428)\u001b[K\r", "remote: Compressing objects: 61% (1482/2428)\u001b[K\r", "remote: Compressing objects: 62% (1506/2428)\u001b[K\r", "remote: Compressing objects: 63% (1530/2428)\u001b[K\r", "remote: Compressing objects: 64% (1554/2428)\u001b[K\r", "remote: Compressing objects: 65% (1579/2428)\u001b[K\r", "remote: Compressing objects: 66% (1603/2428)\u001b[K\r", "remote: Compressing objects: 67% (1627/2428)\u001b[K\r", "remote: Compressing objects: 68% (1652/2428)\u001b[K\r" ] }, { "name": "stdout", "output_type": "stream", "text": [ "remote: Compressing objects: 69% (1676/2428)\u001b[K\r", "remote: Compressing objects: 70% (1700/2428)\u001b[K\r", "remote: Compressing objects: 71% (1724/2428)\u001b[K\r", "remote: Compressing objects: 72% (1749/2428)\u001b[K\r", "remote: Compressing objects: 73% (1773/2428)\u001b[K\r", "remote: Compressing objects: 74% (1797/2428)\u001b[K\r", "remote: Compressing objects: 75% (1821/2428)\u001b[K\r", "remote: Compressing objects: 76% (1846/2428)\u001b[K\r", "remote: Compressing objects: 77% (1870/2428)\u001b[K\r" ] }, { "name": "stdout", "output_type": "stream", "text": [ "remote: Compressing objects: 78% (1894/2428)\u001b[K\r", "remote: Compressing objects: 79% (1919/2428)\u001b[K\r", "remote: Compressing objects: 80% (1943/2428)\u001b[K\r", "remote: Compressing objects: 81% (1967/2428)\u001b[K\r", "remote: Compressing objects: 82% (1991/2428)\u001b[K\r", "remote: Compressing objects: 83% (2016/2428)\u001b[K\r", "remote: Compressing objects: 84% (2040/2428)\u001b[K\r", "remote: Compressing objects: 85% (2064/2428)\u001b[K\r", "remote: Compressing objects: 86% (2089/2428)\u001b[K\r", "remote: Compressing objects: 87% (2113/2428)\u001b[K\r", "remote: Compressing objects: 88% (2137/2428)\u001b[K\r", "remote: Compressing objects: 89% (2161/2428)\u001b[K\r", "remote: Compressing objects: 90% (2186/2428)\u001b[K\r", "remote: Compressing objects: 91% (2210/2428)\u001b[K\r", "remote: Compressing objects: 92% (2234/2428)\u001b[K\r", "remote: Compressing objects: 93% (2259/2428)\u001b[K\r", "remote: Compressing objects: 94% (2283/2428)\u001b[K\r", "remote: Compressing objects: 95% (2307/2428)\u001b[K\r", "remote: Compressing objects: 96% (2331/2428)\u001b[K\r", "remote: Compressing objects: 97% (2356/2428)\u001b[K\r", "remote: Compressing objects: 98% (2380/2428)\u001b[K\r", "remote: Compressing objects: 99% (2404/2428)\u001b[K\r", "remote: Compressing objects: 100% (2428/2428)\u001b[K\r", "remote: Compressing objects: 100% (2428/2428), done.\u001b[K\r\n", "Receiving objects: 0% (1/2927)\r", "Receiving objects: 1% (30/2927)\r", "Receiving objects: 2% (59/2927)\r", "Receiving objects: 3% (88/2927)\r", "Receiving objects: 4% (118/2927)\r", "Receiving objects: 5% (147/2927)\r", "Receiving objects: 6% (176/2927)\r", "Receiving objects: 7% (205/2927)\r", "Receiving objects: 8% (235/2927)\r", "Receiving objects: 9% (264/2927)\r", "Receiving objects: 10% (293/2927)\r", "Receiving objects: 11% (322/2927)\r", "Receiving objects: 12% (352/2927)\r", "Receiving objects: 13% (381/2927)\r", "Receiving objects: 14% (410/2927)\r", "Receiving objects: 15% (440/2927)\r", "Receiving objects: 16% (469/2927)\r" ] }, { "name": "stdout", "output_type": "stream", "text": [ "Receiving objects: 17% (498/2927)\r", "Receiving objects: 18% (527/2927)\r", "Receiving objects: 19% (557/2927)\r", "Receiving objects: 20% (586/2927)\r" ] }, { "name": "stdout", "output_type": "stream", "text": [ "Receiving objects: 21% (615/2927)\r", "Receiving objects: 22% (644/2927)\r" ] }, { "name": "stdout", "output_type": "stream", "text": [ "Receiving objects: 23% (674/2927)\r" ] }, { "name": "stdout", "output_type": "stream", "text": [ "Receiving objects: 24% (703/2927), 12.44 MiB | 24.87 MiB/s\r" ] }, { "name": "stdout", "output_type": "stream", "text": [ "Receiving objects: 25% (732/2927), 12.44 MiB | 24.87 MiB/s\r", "Receiving objects: 26% (762/2927), 12.44 MiB | 24.87 MiB/s\r", "Receiving objects: 27% (791/2927), 12.44 MiB | 24.87 MiB/s\r", "Receiving objects: 28% (820/2927), 12.44 MiB | 24.87 MiB/s\r", "Receiving objects: 29% (849/2927), 12.44 MiB | 24.87 MiB/s\r", "Receiving objects: 30% (879/2927), 12.44 MiB | 24.87 MiB/s\r" ] }, { "name": "stdout", "output_type": "stream", "text": [ "Receiving objects: 31% (908/2927), 12.44 MiB | 24.87 MiB/s\r", "Receiving objects: 32% (937/2927), 12.44 MiB | 24.87 MiB/s\r", "Receiving objects: 33% (966/2927), 12.44 MiB | 24.87 MiB/s\r", "Receiving objects: 34% (996/2927), 12.44 MiB | 24.87 MiB/s\r" ] }, { "name": "stdout", "output_type": "stream", "text": [ "Receiving objects: 35% (1025/2927), 12.44 MiB | 24.87 MiB/s\r", "Receiving objects: 36% (1054/2927), 12.44 MiB | 24.87 MiB/s\r", "Receiving objects: 37% (1083/2927), 12.44 MiB | 24.87 MiB/s\r", "Receiving objects: 38% (1113/2927), 12.44 MiB | 24.87 MiB/s\r", "Receiving objects: 39% (1142/2927), 12.44 MiB | 24.87 MiB/s\r", "Receiving objects: 40% (1171/2927), 12.44 MiB | 24.87 MiB/s\r", "Receiving objects: 41% (1201/2927), 12.44 MiB | 24.87 MiB/s\r" ] }, { "name": "stdout", "output_type": "stream", "text": [ "Receiving objects: 41% (1222/2927), 43.30 MiB | 43.34 MiB/s\r" ] }, { "name": "stdout", "output_type": "stream", "text": [ "Receiving objects: 42% (1230/2927), 78.98 MiB | 52.69 MiB/s\r" ] }, { "name": "stdout", "output_type": "stream", "text": [ "Receiving objects: 42% (1257/2927), 107.25 MiB | 53.65 MiB/s\r", "Receiving objects: 43% (1259/2927), 107.25 MiB | 53.65 MiB/s\r" ] }, { "name": "stdout", "output_type": "stream", "text": [ "Receiving objects: 44% (1288/2927), 107.25 MiB | 53.65 MiB/s\r", "Receiving objects: 45% (1318/2927), 107.25 MiB | 53.65 MiB/s\r", "Receiving objects: 46% (1347/2927), 107.25 MiB | 53.65 MiB/s\r", "Receiving objects: 47% (1376/2927), 107.25 MiB | 53.65 MiB/s\r", "Receiving objects: 48% (1405/2927), 107.25 MiB | 53.65 MiB/s\r", "Receiving objects: 49% (1435/2927), 107.25 MiB | 53.65 MiB/s\r", "Receiving objects: 50% (1464/2927), 107.25 MiB | 53.65 MiB/s\r", "Receiving objects: 51% (1493/2927), 107.25 MiB | 53.65 MiB/s\r" ] }, { "name": "stdout", "output_type": "stream", "text": [ "Receiving objects: 52% (1523/2927), 107.25 MiB | 53.65 MiB/s\r", "Receiving objects: 53% (1552/2927), 107.25 MiB | 53.65 MiB/s\r", "Receiving objects: 54% (1581/2927), 107.25 MiB | 53.65 MiB/s\r", "Receiving objects: 55% (1610/2927), 107.25 MiB | 53.65 MiB/s\r", "Receiving objects: 56% (1640/2927), 107.25 MiB | 53.65 MiB/s\r", "Receiving objects: 57% (1669/2927), 107.25 MiB | 53.65 MiB/s\r", "Receiving objects: 58% (1698/2927), 107.25 MiB | 53.65 MiB/s\r", "Receiving objects: 59% (1727/2927), 107.25 MiB | 53.65 MiB/s\r", "Receiving objects: 60% (1757/2927), 107.25 MiB | 53.65 MiB/s\r" ] }, { "name": "stdout", "output_type": "stream", "text": [ "Receiving objects: 61% (1786/2927), 107.25 MiB | 53.65 MiB/s\r", "Receiving objects: 62% (1815/2927), 107.25 MiB | 53.65 MiB/s\r", "Receiving objects: 63% (1845/2927), 107.25 MiB | 53.65 MiB/s\r", "Receiving objects: 64% (1874/2927), 107.25 MiB | 53.65 MiB/s\r", "Receiving objects: 65% (1903/2927), 107.25 MiB | 53.65 MiB/s\r" ] }, { "name": "stdout", "output_type": "stream", "text": [ "Receiving objects: 65% (1912/2927), 166.27 MiB | 55.44 MiB/s\r" ] }, { "name": "stdout", "output_type": "stream", "text": [ "Receiving objects: 66% (1932/2927), 194.59 MiB | 55.61 MiB/s\r", "Receiving objects: 67% (1962/2927), 194.59 MiB | 55.61 MiB/s\r" ] }, { "name": "stdout", "output_type": "stream", "text": [ "Receiving objects: 68% (1991/2927), 194.59 MiB | 55.61 MiB/s\r", "Receiving objects: 69% (2020/2927), 194.59 MiB | 55.61 MiB/s\r", "Receiving objects: 70% (2049/2927), 194.59 MiB | 55.61 MiB/s\r", "Receiving objects: 71% (2079/2927), 194.59 MiB | 55.61 MiB/s\r", "Receiving objects: 72% (2108/2927), 194.59 MiB | 55.61 MiB/s\r", "Receiving objects: 73% (2137/2927), 194.59 MiB | 55.61 MiB/s\r", "Receiving objects: 74% (2166/2927), 194.59 MiB | 55.61 MiB/s\r", "Receiving objects: 75% (2196/2927), 194.59 MiB | 55.61 MiB/s\r", "Receiving objects: 76% (2225/2927), 194.59 MiB | 55.61 MiB/s\r", "Receiving objects: 77% (2254/2927), 194.59 MiB | 55.61 MiB/s\r", "Receiving objects: 78% (2284/2927), 194.59 MiB | 55.61 MiB/s\r", "Receiving objects: 79% (2313/2927), 194.59 MiB | 55.61 MiB/s\r" ] }, { "name": "stdout", "output_type": "stream", "text": [ "Receiving objects: 79% (2322/2927), 221.77 MiB | 55.45 MiB/s\r" ] }, { "name": "stdout", "output_type": "stream", "text": [ "Receiving objects: 80% (2342/2927), 221.77 MiB | 55.45 MiB/s\r" ] }, { "name": "stdout", "output_type": "stream", "text": [ "Receiving objects: 81% (2371/2927), 221.77 MiB | 55.45 MiB/s\r" ] }, { "name": "stdout", "output_type": "stream", "text": [ "Receiving objects: 82% (2401/2927), 245.31 MiB | 54.52 MiB/s\r", "Receiving objects: 83% (2430/2927), 245.31 MiB | 54.52 MiB/s\r" ] }, { "name": "stdout", "output_type": "stream", "text": [ "Receiving objects: 83% (2444/2927), 269.56 MiB | 57.16 MiB/s\r" ] }, { "name": "stdout", "output_type": "stream", "text": [ "Receiving objects: 84% (2459/2927), 269.56 MiB | 57.16 MiB/s\r" ] }, { "name": "stdout", "output_type": "stream", "text": [ "Receiving objects: 85% (2488/2927), 269.56 MiB | 57.16 MiB/s\r" ] }, { "name": "stdout", "output_type": "stream", "text": [ "Receiving objects: 86% (2518/2927), 297.98 MiB | 56.61 MiB/s\r" ] }, { "name": "stdout", "output_type": "stream", "text": [ "Receiving objects: 87% (2547/2927), 297.98 MiB | 56.61 MiB/s\r" ] }, { "name": "stdout", "output_type": "stream", "text": [ "Receiving objects: 88% (2576/2927), 297.98 MiB | 56.61 MiB/s\r", "Receiving objects: 89% (2606/2927), 297.98 MiB | 56.61 MiB/s\r", "Receiving objects: 90% (2635/2927), 297.98 MiB | 56.61 MiB/s\r" ] }, { "name": "stdout", "output_type": "stream", "text": [ "Receiving objects: 90% (2640/2927), 322.12 MiB | 54.04 MiB/s\r" ] }, { "name": "stdout", "output_type": "stream", "text": [ "Receiving objects: 91% (2664/2927), 351.64 MiB | 54.32 MiB/s\r", "Receiving objects: 92% (2693/2927), 351.64 MiB | 54.32 MiB/s\r", "Receiving objects: 93% (2723/2927), 351.64 MiB | 54.32 MiB/s\r", "Receiving objects: 94% (2752/2927), 351.64 MiB | 54.32 MiB/s\r" ] }, { "name": "stdout", "output_type": "stream", "text": [ "Receiving objects: 95% (2781/2927), 351.64 MiB | 54.32 MiB/s\r", "Receiving objects: 96% (2810/2927), 351.64 MiB | 54.32 MiB/s\r", "Receiving objects: 97% (2840/2927), 351.64 MiB | 54.32 MiB/s\r", "Receiving objects: 98% (2869/2927), 351.64 MiB | 54.32 MiB/s\r", "remote: Total 2927 (delta 503), reused 2114 (delta 424), pack-reused 0\u001b[K\r\n", "Receiving objects: 99% (2898/2927), 351.64 MiB | 54.32 MiB/s\r", "Receiving objects: 100% (2927/2927), 351.64 MiB | 54.32 MiB/s\r", "Receiving objects: 100% (2927/2927), 369.04 MiB | 54.42 MiB/s, done.\r\n", "Resolving deltas: 0% (0/503)\r", "Resolving deltas: 1% (6/503)\r", "Resolving deltas: 2% (11/503)\r", "Resolving deltas: 3% (18/503)\r", "Resolving deltas: 4% (22/503)\r", "Resolving deltas: 5% (28/503)\r", "Resolving deltas: 6% (33/503)\r", "Resolving deltas: 7% (37/503)\r", "Resolving deltas: 8% (42/503)\r", "Resolving deltas: 9% (46/503)\r", "Resolving deltas: 10% (51/503)\r", "Resolving deltas: 11% (56/503)\r", "Resolving deltas: 12% (61/503)\r", "Resolving deltas: 13% (66/503)\r", "Resolving deltas: 14% (72/503)\r", "Resolving deltas: 15% (76/503)\r", "Resolving deltas: 16% (81/503)\r", "Resolving deltas: 17% (86/503)\r", "Resolving deltas: 18% (93/503)\r", "Resolving deltas: 19% (98/503)\r", "Resolving deltas: 20% (101/503)\r", "Resolving deltas: 21% (106/503)\r", "Resolving deltas: 22% (112/503)\r", "Resolving deltas: 23% (116/503)\r", "Resolving deltas: 24% (122/503)\r", "Resolving deltas: 25% (126/503)\r", "Resolving deltas: 26% (132/503)\r", "Resolving deltas: 27% (136/503)\r", "Resolving deltas: 28% (141/503)\r", "Resolving deltas: 29% (146/503)\r", "Resolving deltas: 30% (151/503)\r", "Resolving deltas: 31% (156/503)\r", "Resolving deltas: 32% (163/503)\r", "Resolving deltas: 33% (166/503)\r", "Resolving deltas: 34% (172/503)\r", "Resolving deltas: 35% (178/503)\r", "Resolving deltas: 36% (182/503)\r", "Resolving deltas: 37% (190/503)\r", "Resolving deltas: 40% (205/503)\r", "Resolving deltas: 41% (211/503)\r", "Resolving deltas: 42% (215/503)\r", "Resolving deltas: 43% (217/503)\r", "Resolving deltas: 44% (222/503)\r", "Resolving deltas: 46% (232/503)\r", "Resolving deltas: 47% (239/503)\r", "Resolving deltas: 48% (242/503)\r", "Resolving deltas: 49% (247/503)\r", "Resolving deltas: 50% (252/503)\r", "Resolving deltas: 51% (257/503)\r", "Resolving deltas: 52% (263/503)\r", "Resolving deltas: 53% (267/503)\r", "Resolving deltas: 54% (273/503)\r", "Resolving deltas: 56% (282/503)\r", "Resolving deltas: 57% (288/503)\r", "Resolving deltas: 58% (292/503)\r", "Resolving deltas: 59% (298/503)\r", "Resolving deltas: 60% (306/503)\r", "Resolving deltas: 61% (307/503)\r", "Resolving deltas: 62% (312/503)\r", "Resolving deltas: 63% (318/503)\r", "Resolving deltas: 64% (322/503)\r", "Resolving deltas: 65% (329/503)\r", "Resolving deltas: 66% (332/503)\r", "Resolving deltas: 67% (339/503)\r", "Resolving deltas: 68% (343/503)\r", "Resolving deltas: 69% (350/503)\r", "Resolving deltas: 70% (354/503)\r", "Resolving deltas: 71% (360/503)\r", "Resolving deltas: 72% (364/503)\r", "Resolving deltas: 73% (368/503)\r", "Resolving deltas: 74% (373/503)\r", "Resolving deltas: 75% (378/503)\r", "Resolving deltas: 76% (387/503)\r", "Resolving deltas: 77% (389/503)\r", "Resolving deltas: 78% (393/503)\r", "Resolving deltas: 79% (398/503)\r", "Resolving deltas: 80% (403/503)\r", "Resolving deltas: 81% (410/503)\r", "Resolving deltas: 82% (413/503)\r", "Resolving deltas: 83% (418/503)\r", "Resolving deltas: 84% (423/503)\r", "Resolving deltas: 85% (429/503)\r", "Resolving deltas: 86% (434/503)\r", "Resolving deltas: 87% (438/503)\r", "Resolving deltas: 88% (445/503)\r", "Resolving deltas: 89% (448/503)\r", "Resolving deltas: 90% (453/503)\r", "Resolving deltas: 91% (458/503)\r", "Resolving deltas: 92% (465/503)\r", "Resolving deltas: 94% (474/503)\r", "Resolving deltas: 95% (479/503)\r", "Resolving deltas: 96% (483/503)\r", "Resolving deltas: 97% (490/503)\r", "Resolving deltas: 98% (494/503)\r", "Resolving deltas: 99% (498/503)\r", "Resolving deltas: 100% (503/503)\r", "Resolving deltas: 100% (503/503), done.\r\n" ] }, { "name": "stdout", "output_type": "stream", "text": [ "Updating files: 56% (1576/2768)\r" ] }, { "name": "stdout", "output_type": "stream", "text": [ "Updating files: 57% (1578/2768)\r", "Updating files: 58% (1606/2768)\r", "Updating files: 59% (1634/2768)\r", "Updating files: 60% (1661/2768)\r", "Updating files: 61% (1689/2768)\r", "Updating files: 62% (1717/2768)\r", "Updating files: 63% (1744/2768)\r", "Updating files: 64% (1772/2768)\r", "Updating files: 65% (1800/2768)\r", "Updating files: 66% (1827/2768)\r", "Updating files: 67% (1855/2768)\r", "Updating files: 68% (1883/2768)\r", "Updating files: 69% (1910/2768)\r", "Updating files: 70% (1938/2768)\r", "Updating files: 71% (1966/2768)\r", "Updating files: 72% (1993/2768)\r", "Updating files: 73% (2021/2768)\r", "Updating files: 74% (2049/2768)\r", "Updating files: 75% (2076/2768)\r", "Updating files: 76% (2104/2768)\r" ] }, { "name": "stdout", "output_type": "stream", "text": [ "Updating files: 77% (2132/2768)\r", "Updating files: 78% (2160/2768)\r" ] }, { "name": "stdout", "output_type": "stream", "text": [ "Updating files: 79% (2187/2768)\r", "Updating files: 80% (2215/2768)\r", "Updating files: 81% (2243/2768)\r" ] }, { "name": "stdout", "output_type": "stream", "text": [ "Updating files: 81% (2248/2768)\r", "Updating files: 82% (2270/2768)\r", "Updating files: 83% (2298/2768)\r" ] }, { "name": "stdout", "output_type": "stream", "text": [ "Updating files: 84% (2326/2768)\r" ] }, { "name": "stdout", "output_type": "stream", "text": [ "Updating files: 85% (2353/2768)\r", "Updating files: 86% (2381/2768)\r", "Updating files: 87% (2409/2768)\r", "Updating files: 88% (2436/2768)\r" ] }, { "name": "stdout", "output_type": "stream", "text": [ "Updating files: 89% (2464/2768)\r", "Updating files: 90% (2492/2768)\r", "Updating files: 91% (2519/2768)\r", "Updating files: 92% (2547/2768)\r", "Updating files: 93% (2575/2768)\r" ] }, { "name": "stdout", "output_type": "stream", "text": [ "Updating files: 94% (2602/2768)\r", "Updating files: 95% (2630/2768)\r", "Updating files: 96% (2658/2768)\r", "Updating files: 97% (2685/2768)\r", "Updating files: 98% (2713/2768)\r", "Updating files: 99% (2741/2768)\r", "Updating files: 100% (2768/2768)\r", "Updating files: 100% (2768/2768), done.\r\n" ] } ], "source": [ "!git clone --branch r1.13.0 --depth 1 https://github.com/tensorflow/models" ] }, { "cell_type": "markdown", "metadata": { "id": "wfHOhbkgvrKr" }, "source": [ "### 读取帮助\n", "\n", "安装 TensorFlow 时应该已安装该脚本。下面是内置帮助命令：" ] }, { "cell_type": "code", "execution_count": 4, "metadata": { "execution": { "iopub.execute_input": "2022-12-14T21:00:41.366404Z", "iopub.status.busy": "2022-12-14T21:00:41.366153Z", "iopub.status.idle": "2022-12-14T21:00:43.797858Z", "shell.execute_reply": "2022-12-14T21:00:43.796689Z" }, "id": "m2GF-tlntqTQ" }, "outputs": [ { "name": "stdout", "output_type": "stream", "text": [ "2022-12-14 21:00:42.454774: W tensorflow/compiler/xla/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libnvinfer.so.7'; dlerror: libnvinfer.so.7: cannot open shared object file: No such file or directory\r\n", "2022-12-14 21:00:42.454864: W tensorflow/compiler/xla/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libnvinfer_plugin.so.7'; dlerror: libnvinfer_plugin.so.7: cannot open shared object file: No such file or directory\r\n", "2022-12-14 21:00:42.454875: W tensorflow/compiler/tf2tensorrt/utils/py_utils.cc:38] TF-TRT Warning: Cannot dlopen some TensorRT libraries. If you would like to use Nvidia GPU with TensorRT, please make sure the missing libraries mentioned above are installed properly.\r\n" ] }, { "name": "stdout", "output_type": "stream", "text": [ "usage: tf_upgrade_v2 [-h] [--infile INPUT_FILE] [--outfile OUTPUT_FILE]\r\n", " [--intree INPUT_TREE] [--outtree OUTPUT_TREE]\r\n", " [--copyotherfiles COPY_OTHER_FILES] [--inplace]\r\n", " [--no_import_rename] [--no_upgrade_compat_v1_import]\r\n", " [--reportfile REPORT_FILENAME] [--mode {DEFAULT,SAFETY}]\r\n", " [--print_all]\r\n", "\r\n", "Convert a TensorFlow Python file from 1.x to 2.0\r\n", "\r\n", "Simple usage:\r\n", " tf_upgrade_v2.py --infile foo.py --outfile bar.py\r\n", " tf_upgrade_v2.py --infile foo.ipynb --outfile bar.ipynb\r\n", " tf_upgrade_v2.py --intree ~/code/old --outtree ~/code/new\r\n", "\r\n", "optional arguments:\r\n", " -h, --help show this help message and exit\r\n", " --infile INPUT_FILE If converting a single file, the name of the file to\r\n", " convert\r\n", " --outfile OUTPUT_FILE\r\n", " If converting a single file, the output filename.\r\n", " --intree INPUT_TREE If converting a whole tree of files, the directory to\r\n", " read from (relative or absolute).\r\n", " --outtree OUTPUT_TREE\r\n", " If converting a whole tree of files, the output\r\n", " directory (relative or absolute).\r\n", " --copyotherfiles COPY_OTHER_FILES\r\n", " If converting a whole tree of files, whether to copy\r\n", " the other files.\r\n", " --inplace If converting a set of files, whether to allow the\r\n", " conversion to be performed on the input files.\r\n", " --no_import_rename Not to rename import to compat.v2 explicitly.\r\n", " --no_upgrade_compat_v1_import\r\n", " If specified, don't upgrade explicit imports of\r\n", " `tensorflow.compat.v1 as tf` to the v2 APIs.\r\n", " Otherwise, explicit imports of the form\r\n", " `tensorflow.compat.v1 as tf` will be upgraded.\r\n", " --reportfile REPORT_FILENAME\r\n", " The name of the file where the report log is\r\n", " stored.(default: report.txt)\r\n", " --mode {DEFAULT,SAFETY}\r\n", " Upgrade script mode. Supported modes: DEFAULT: Perform\r\n", " only straightforward conversions to upgrade to 2.0. In\r\n", " more difficult cases, switch to use compat.v1. SAFETY:\r\n", " Keep 1.* code intact and import compat.v1 module.\r\n", " --print_all Print full log to stdout instead of just printing\r\n", " errors\r\n" ] } ], "source": [ "!tf_upgrade_v2 -h" ] }, { "cell_type": "markdown", "metadata": { "id": "se9Leqjm1CZR" }, "source": [ "### TF1 代码示例" ] }, { "cell_type": "markdown", "metadata": { "id": "whD5i36s1SuM" }, "source": [ "下面是一个简单的 TensorFlow 1.0 脚本：" ] }, { "cell_type": "code", "execution_count": 5, "metadata": { "execution": { "iopub.execute_input": "2022-12-14T21:00:43.802933Z", "iopub.status.busy": "2022-12-14T21:00:43.802192Z", "iopub.status.idle": "2022-12-14T21:00:43.930493Z", "shell.execute_reply": "2022-12-14T21:00:43.929707Z" }, "id": "mhGbYQ9HwbeU" }, "outputs": [ { "name": "stdout", "output_type": "stream", "text": [ " # Calculate loss using mean squared error\r\n", " average_loss = tf.losses.mean_squared_error(labels, predictions)\r\n", "\r\n", " # Pre-made estimators use the total_loss instead of the average,\r\n", " # so report total_loss for compatibility.\r\n", " batch_size = tf.shape(labels)[0]\r\n", " total_loss = tf.to_float(batch_size) * average_loss\r\n", "\r\n", " if mode == tf.estimator.ModeKeys.TRAIN:\r\n", " optimizer = params.get(\"optimizer\", tf.train.AdamOptimizer)\r\n" ] } ], "source": [ "!head -n 65 models/samples/cookbook/regression/custom_regression.py | tail -n 10" ] }, { "cell_type": "markdown", "metadata": { "id": "UGO7xSyL89wX" }, "source": [ "对于安装的 TensorFlow 2.x，它不会运行：" ] }, { "cell_type": "code", "execution_count": 6, "metadata": { "execution": { "iopub.execute_input": "2022-12-14T21:00:43.934542Z", "iopub.status.busy": "2022-12-14T21:00:43.933880Z", "iopub.status.idle": "2022-12-14T21:00:46.348835Z", "shell.execute_reply": "2022-12-14T21:00:46.347752Z" }, "id": "TD7fFphX8_qE" }, "outputs": [ { "name": "stdout", "output_type": "stream", "text": [ "2022-12-14 21:00:45.033189: W tensorflow/compiler/xla/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libnvinfer.so.7'; dlerror: libnvinfer.so.7: cannot open shared object file: No such file or directory\r\n", "2022-12-14 21:00:45.033277: W tensorflow/compiler/xla/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libnvinfer_plugin.so.7'; dlerror: libnvinfer_plugin.so.7: cannot open shared object file: No such file or directory\r\n", "2022-12-14 21:00:45.033287: W tensorflow/compiler/tf2tensorrt/utils/py_utils.cc:38] TF-TRT Warning: Cannot dlopen some TensorRT libraries. If you would like to use Nvidia GPU with TensorRT, please make sure the missing libraries mentioned above are installed properly.\r\n" ] }, { "name": "stdout", "output_type": "stream", "text": [ "Traceback (most recent call last):\r\n", " File \"/tmpfs/src/temp/site/zh-cn/guide/migrate/models/samples/cookbook/regression/custom_regression.py\", line 162, in \r\n", " tf.logging.set_verbosity(tf.logging.INFO)\r\n", "AttributeError: module 'tensorflow' has no attribute 'logging'\r\n" ] } ], "source": [ "!(cd models/samples/cookbook/regression && python custom_regression.py)" ] }, { "cell_type": "markdown", "metadata": { "id": "iZZHu0H0wLRJ" }, "source": [ "### 单个文件\n", "\n", "该脚本可以对单个 Python 文件运行：" ] }, { "cell_type": "code", "execution_count": 7, "metadata": { "execution": { "iopub.execute_input": "2022-12-14T21:00:46.352984Z", "iopub.status.busy": "2022-12-14T21:00:46.352716Z", "iopub.status.idle": "2022-12-14T21:00:48.803501Z", "shell.execute_reply": "2022-12-14T21:00:48.802318Z" }, "id": "xIBZVEjkqkc5" }, "outputs": [ { "name": "stdout", "output_type": "stream", "text": [ "2022-12-14 21:00:47.430391: W tensorflow/compiler/xla/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libnvinfer.so.7'; dlerror: libnvinfer.so.7: cannot open shared object file: No such file or directory\r\n", "2022-12-14 21:00:47.430480: W tensorflow/compiler/xla/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libnvinfer_plugin.so.7'; dlerror: libnvinfer_plugin.so.7: cannot open shared object file: No such file or directory\r\n", "2022-12-14 21:00:47.430490: W tensorflow/compiler/tf2tensorrt/utils/py_utils.cc:38] TF-TRT Warning: Cannot dlopen some TensorRT libraries. If you would like to use Nvidia GPU with TensorRT, please make sure the missing libraries mentioned above are installed properly.\r\n" ] }, { "name": "stdout", "output_type": "stream", "text": [ "INFO line 38:8: Renamed 'tf.feature_column.input_layer' to 'tf.compat.v1.feature_column.input_layer'\r\n", "INFO line 43:10: Renamed 'tf.layers.dense' to 'tf.compat.v1.layers.dense'\r\n", "INFO line 46:17: Renamed 'tf.layers.dense' to 'tf.compat.v1.layers.dense'\r\n", "INFO line 57:17: tf.losses.mean_squared_error requires manual check. tf.losses have been replaced with object oriented versions in TF 2.0 and after. The loss function calls have been converted to compat.v1 for backward compatibility. Please update these calls to the TF 2.0 versions.\r\n", "INFO line 57:17: Renamed 'tf.losses.mean_squared_error' to 'tf.compat.v1.losses.mean_squared_error'\r\n", "INFO line 61:15: Added keywords to args of function 'tf.shape'\r\n", "INFO line 62:15: Changed tf.to_float call to tf.cast(..., dtype=tf.float32).\r\n", "INFO line 65:40: Renamed 'tf.train.AdamOptimizer' to 'tf.compat.v1.train.AdamOptimizer'\r\n", "INFO line 68:39: Renamed 'tf.train.get_global_step' to 'tf.compat.v1.train.get_global_step'\r\n", "INFO line 83:9: tf.metrics.root_mean_squared_error requires manual check. tf.metrics have been replaced with object oriented versions in TF 2.0 and after. The metric function calls have been converted to compat.v1 for backward compatibility. Please update these calls to the TF 2.0 versions.\r\n", "INFO line 83:9: Renamed 'tf.metrics.root_mean_squared_error' to 'tf.compat.v1.metrics.root_mean_squared_error'\r\n", "INFO line 142:23: Renamed 'tf.train.AdamOptimizer' to 'tf.compat.v1.train.AdamOptimizer'\r\n", "INFO line 162:2: Renamed 'tf.logging.set_verbosity' to 'tf.compat.v1.logging.set_verbosity'\r\n", "INFO line 162:27: Renamed 'tf.logging.INFO' to 'tf.compat.v1.logging.INFO'\r\n", "INFO line 163:2: Renamed 'tf.app.run' to 'tf.compat.v1.app.run'\r\n" ] }, { "name": "stdout", "output_type": "stream", "text": [ "TensorFlow 2.0 Upgrade Script\r\n", "-----------------------------\r\n", "Converted 1 files\r\n", "Detected 0 issues that require attention\r\n", "--------------------------------------------------------------------------------\r\n", "\r\n", "\r\n", "Make sure to read the detailed log 'report.txt'\r\n", "\r\n" ] } ], "source": [ "!tf_upgrade_v2 \\\n", " --infile models/samples/cookbook/regression/custom_regression.py \\\n", " --outfile /tmp/custom_regression_v2.py" ] }, { "cell_type": "markdown", "metadata": { "id": "L9X2lxzqqkc9" }, "source": [ "如果无法找到修正代码问题的方法，该脚本会打印错误消息。 " ] }, { "cell_type": "markdown", "metadata": { "id": "r7zpuE1vWSlL" }, "source": [ "### 目录树" ] }, { "cell_type": "markdown", "metadata": { "id": "2q7Gtuu8SdIC" }, "source": [ "典型项目（包括下面的简单示例）会使用远不止一个文件。通常需要更新整个软件包，因此该脚本也可以对目录树运行：" ] }, { "cell_type": "code", "execution_count": 8, "metadata": { "execution": { "iopub.execute_input": "2022-12-14T21:00:48.808519Z", "iopub.status.busy": "2022-12-14T21:00:48.807777Z", "iopub.status.idle": "2022-12-14T21:00:51.344392Z", "shell.execute_reply": "2022-12-14T21:00:51.343164Z" }, "id": "XGqcdkAPqkc-" }, "outputs": [ { "name": "stdout", "output_type": "stream", "text": [ "2022-12-14 21:00:49.884020: W tensorflow/compiler/xla/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libnvinfer.so.7'; dlerror: libnvinfer.so.7: cannot open shared object file: No such file or directory\r\n", "2022-12-14 21:00:49.884109: W tensorflow/compiler/xla/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libnvinfer_plugin.so.7'; dlerror: libnvinfer_plugin.so.7: cannot open shared object file: No such file or directory\r\n", "2022-12-14 21:00:49.884119: W tensorflow/compiler/tf2tensorrt/utils/py_utils.cc:38] TF-TRT Warning: Cannot dlopen some TensorRT libraries. If you would like to use Nvidia GPU with TensorRT, please make sure the missing libraries mentioned above are installed properly.\r\n" ] }, { "name": "stdout", "output_type": "stream", "text": [ "INFO line 40:7: Renamed 'tf.test.mock' to 'tf.compat.v1.test.mock'\r\n" ] }, { "name": "stdout", "output_type": "stream", "text": [ "WARNING line 125:15: Changing dataset.make_one_shot_iterator() to tf.compat.v1.data.make_one_shot_iterator(dataset). Please check this transformation.\r\n", "\r\n", "INFO line 58:10: tf.estimator.LinearRegressor: Default value of loss_reduction has been changed to SUM_OVER_BATCH_SIZE; inserting old default value tf.keras.losses.Reduction.SUM.\r\n", "\r\n", "INFO line 101:2: Renamed 'tf.logging.set_verbosity' to 'tf.compat.v1.logging.set_verbosity'\r\n", "INFO line 101:27: Renamed 'tf.logging.INFO' to 'tf.compat.v1.logging.INFO'\r\n", "INFO line 102:2: Renamed 'tf.app.run' to 'tf.compat.v1.app.run'\r\n", "INFO line 72:10: tf.estimator.DNNRegressor: Default value of loss_reduction has been changed to SUM_OVER_BATCH_SIZE; inserting old default value tf.keras.losses.Reduction.SUM.\r\n", "\r\n", "INFO line 96:2: Renamed 'tf.logging.set_verbosity' to 'tf.compat.v1.logging.set_verbosity'\r\n", "INFO line 96:27: Renamed 'tf.logging.INFO' to 'tf.compat.v1.logging.INFO'\r\n", "INFO line 97:2: Renamed 'tf.app.run' to 'tf.compat.v1.app.run'\r\n" ] }, { "name": "stdout", "output_type": "stream", "text": [ "INFO line 82:10: tf.estimator.LinearRegressor: Default value of loss_reduction has been changed to SUM_OVER_BATCH_SIZE; inserting old default value tf.keras.losses.Reduction.SUM.\r\n", "\r\n", "INFO line 105:2: Renamed 'tf.logging.set_verbosity' to 'tf.compat.v1.logging.set_verbosity'\r\n", "INFO line 105:27: Renamed 'tf.logging.INFO' to 'tf.compat.v1.logging.INFO'\r\n", "INFO line 106:2: Renamed 'tf.app.run' to 'tf.compat.v1.app.run'\r\n", "INFO line 38:8: Renamed 'tf.feature_column.input_layer' to 'tf.compat.v1.feature_column.input_layer'\r\n", "INFO line 43:10: Renamed 'tf.layers.dense' to 'tf.compat.v1.layers.dense'\r\n", "INFO line 46:17: Renamed 'tf.layers.dense' to 'tf.compat.v1.layers.dense'\r\n", "INFO line 57:17: tf.losses.mean_squared_error requires manual check. tf.losses have been replaced with object oriented versions in TF 2.0 and after. The loss function calls have been converted to compat.v1 for backward compatibility. Please update these calls to the TF 2.0 versions.\r\n", "INFO line 57:17: Renamed 'tf.losses.mean_squared_error' to 'tf.compat.v1.losses.mean_squared_error'\r\n", "INFO line 61:15: Added keywords to args of function 'tf.shape'\r\n", "INFO line 62:15: Changed tf.to_float call to tf.cast(..., dtype=tf.float32).\r\n", "INFO line 65:40: Renamed 'tf.train.AdamOptimizer' to 'tf.compat.v1.train.AdamOptimizer'\r\n", "INFO line 68:39: Renamed 'tf.train.get_global_step' to 'tf.compat.v1.train.get_global_step'\r\n", "INFO line 83:9: tf.metrics.root_mean_squared_error requires manual check. tf.metrics have been replaced with object oriented versions in TF 2.0 and after. The metric function calls have been converted to compat.v1 for backward compatibility. Please update these calls to the TF 2.0 versions.\r\n", "INFO line 83:9: Renamed 'tf.metrics.root_mean_squared_error' to 'tf.compat.v1.metrics.root_mean_squared_error'\r\n", "INFO line 142:23: Renamed 'tf.train.AdamOptimizer' to 'tf.compat.v1.train.AdamOptimizer'\r\n", "INFO line 162:2: Renamed 'tf.logging.set_verbosity' to 'tf.compat.v1.logging.set_verbosity'\r\n", "INFO line 162:27: Renamed 'tf.logging.INFO' to 'tf.compat.v1.logging.INFO'\r\n", "INFO line 163:2: Renamed 'tf.app.run' to 'tf.compat.v1.app.run'\r\n", "TensorFlow 2.0 Upgrade Script\r\n", "-----------------------------\r\n", "Converted 7 files\r\n", "Detected 1 issues that require attention\r\n", "--------------------------------------------------------------------------------\r\n", "--------------------------------------------------------------------------------\r\n", "File: models/samples/cookbook/regression/automobile_data.py\r\n", "--------------------------------------------------------------------------------\r\n", "models/samples/cookbook/regression/automobile_data.py:125:15: WARNING: Changing dataset.make_one_shot_iterator() to tf.compat.v1.data.make_one_shot_iterator(dataset). Please check this transformation.\r\n", "\r\n", "\r\n", "\r\n", "Make sure to read the detailed log 'tree_report.txt'\r\n", "\r\n" ] } ], "source": [ "# update the .py files and copy all the other files to the outtree\n", "!tf_upgrade_v2 \\\n", " --intree models/samples/cookbook/regression/ \\\n", " --outtree regression_v2/ \\\n", " --reportfile tree_report.txt" ] }, { "cell_type": "markdown", "metadata": { "id": "2S4j7sqbSowC" }, "source": [ "注意关于 `dataset.make_one_shot_iterator` 函数的一条警告。\n", "\n", "现在，对于 TensorFlow 2.x，该脚本已经可以发挥作用：\n", "\n", "请注意，由于 TF 1.15 中包含 `tf.compat.v1` 模块，转换的脚本在 TensorFlow 1.15 中也可以运行。" ] }, { "cell_type": "code", "execution_count": 9, "metadata": { "execution": { "iopub.execute_input": "2022-12-14T21:00:51.349077Z", "iopub.status.busy": "2022-12-14T21:00:51.348495Z", "iopub.status.idle": "2022-12-14T21:01:02.972669Z", "shell.execute_reply": "2022-12-14T21:01:02.971750Z" }, "id": "vh0cmW3y1tX9" }, "outputs": [ { "name": "stdout", "output_type": "stream", "text": [ "I1214 21:01:01.809502 140703740618560 estimator.py:2083] Saving dict for global step 1000: global_step = 1000, loss = 546.7986, rmse = 3.3751497\r\n", "INFO:tensorflow:Saving 'checkpoint_path' summary for global step 1000: /tmpfs/tmp/tmpk1ymuugp/model.ckpt-1000\r\n", "I1214 21:01:01.853601 140703740618560 estimator.py:2143] Saving 'checkpoint_path' summary for global step 1000: /tmpfs/tmp/tmpk1ymuugp/model.ckpt-1000\r\n", "Tensor(\"IteratorGetNext:25\", shape=(None,), dtype=float64, device=/device:CPU:0)\r\n", "Tensor(\"Squeeze:0\", shape=(None,), dtype=float32)\r\n", "\r\n", "********************************************************************************\r\n", "\r\n", "RMS error for the test set: $3375\r\n", "\r\n" ] } ], "source": [ "!(cd regression_v2 && python custom_regression.py 2>&1) | tail" ] }, { "cell_type": "markdown", "metadata": { "id": "4EgZGGkdqkdC" }, "source": [ "## 详细报告\n", "\n", "该脚本还会报告一个详细更改的列表。在本例中，它发现了一个可能不安全的转换，因此在文件顶部包含了一条警告： " ] }, { "cell_type": "code", "execution_count": 10, "metadata": { "execution": { "iopub.execute_input": "2022-12-14T21:01:02.977135Z", "iopub.status.busy": "2022-12-14T21:01:02.976570Z", "iopub.status.idle": "2022-12-14T21:01:03.098748Z", "shell.execute_reply": "2022-12-14T21:01:03.097990Z" }, "id": "CtHaZbVaNMGV" }, "outputs": [ { "name": "stdout", "output_type": "stream", "text": [ "TensorFlow 2.0 Upgrade Script\r\n", "-----------------------------\r\n", "Converted 7 files\r\n", "Detected 1 issues that require attention\r\n", "--------------------------------------------------------------------------------\r\n", "--------------------------------------------------------------------------------\r\n", "File: models/samples/cookbook/regression/automobile_data.py\r\n", "--------------------------------------------------------------------------------\r\n", "models/samples/cookbook/regression/automobile_data.py:125:15: WARNING: Changing dataset.make_one_shot_iterator() to tf.compat.v1.data.make_one_shot_iterator(dataset). Please check this transformation.\r\n", "\r\n", "================================================================================\r\n", "Detailed log follows:\r\n", "\r\n", "================================================================================\r\n", "================================================================================\r\n", "Input tree: 'models/samples/cookbook/regression/'\r\n", "================================================================================\r\n", "--------------------------------------------------------------------------------\r\n", "Processing file 'models/samples/cookbook/regression/__init__.py'\r\n", " outputting to 'regression_v2/__init__.py'\r\n" ] } ], "source": [ "!head -n 20 tree_report.txt" ] }, { "cell_type": "markdown", "metadata": { "id": "1-UIFXP3cFSa" }, "source": [ "再次注意关于 `Dataset.make_one_shot_iterator function` 函数的一条警告。" ] }, { "cell_type": "markdown", "metadata": { "id": "oxQeYS1TN-jv" }, "source": [ "在其他情况下，对于比较重要的更改，输出会解释原因：" ] }, { "cell_type": "code", "execution_count": 11, "metadata": { "execution": { "iopub.execute_input": "2022-12-14T21:01:03.102991Z", "iopub.status.busy": "2022-12-14T21:01:03.102400Z", "iopub.status.idle": "2022-12-14T21:01:03.107994Z", "shell.execute_reply": "2022-12-14T21:01:03.107397Z" }, "id": "WQs9kEvVN9th" }, "outputs": [ { "name": "stdout", "output_type": "stream", "text": [ "Writing dropout.py\n" ] } ], "source": [ "%%writefile dropout.py\n", "import tensorflow as tf\n", "\n", "d = tf.nn.dropout(tf.range(10), 0.2)\n", "z = tf.zeros_like(d, optimize=False)" ] }, { "cell_type": "code", "execution_count": 12, "metadata": { "execution": { "iopub.execute_input": "2022-12-14T21:01:03.111167Z", "iopub.status.busy": "2022-12-14T21:01:03.110559Z", "iopub.status.idle": "2022-12-14T21:01:05.581100Z", "shell.execute_reply": "2022-12-14T21:01:05.580109Z" }, "id": "7uOkacZsO3XX" }, "outputs": [ { "name": "stdout", "output_type": "stream", "text": [ "2022-12-14 21:01:04.210481: W tensorflow/compiler/xla/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libnvinfer.so.7'; dlerror: libnvinfer.so.7: cannot open shared object file: No such file or directory\r\n", "2022-12-14 21:01:04.210578: W tensorflow/compiler/xla/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libnvinfer_plugin.so.7'; dlerror: libnvinfer_plugin.so.7: cannot open shared object file: No such file or directory\r\n", "2022-12-14 21:01:04.210597: W tensorflow/compiler/tf2tensorrt/utils/py_utils.cc:38] TF-TRT Warning: Cannot dlopen some TensorRT libraries. If you would like to use Nvidia GPU with TensorRT, please make sure the missing libraries mentioned above are installed properly.\r\n" ] } ], "source": [ "!tf_upgrade_v2 \\\n", " --infile dropout.py \\\n", " --outfile dropout_v2.py \\\n", " --reportfile dropout_report.txt > /dev/null" ] }, { "cell_type": "code", "execution_count": 13, "metadata": { "execution": { "iopub.execute_input": "2022-12-14T21:01:05.585689Z", "iopub.status.busy": "2022-12-14T21:01:05.584979Z", "iopub.status.idle": "2022-12-14T21:01:05.707898Z", "shell.execute_reply": "2022-12-14T21:01:05.706928Z" }, "id": "m-J82-scPMGl" }, "outputs": [ { "name": "stdout", "output_type": "stream", "text": [ "TensorFlow 2.0 Upgrade Script\r\n", "-----------------------------\r\n", "Converted 1 files\r\n", "Detected 0 issues that require attention\r\n", "--------------------------------------------------------------------------------\r\n", "================================================================================\r\n", "Detailed log follows:\r\n", "\r\n", "================================================================================\r\n", "--------------------------------------------------------------------------------\r\n", "Processing file 'dropout.py'\r\n", " outputting to 'dropout_v2.py'\r\n", "--------------------------------------------------------------------------------\r\n", "\r\n", "3:4: INFO: Changing keep_prob arg of tf.nn.dropout to rate, and recomputing value.\r\n", "\r\n", "4:4: INFO: Renaming tf.zeros_like to tf.compat.v1.zeros_like because argument optimize is present. tf.zeros_like no longer takes an optimize argument, and behaves as if optimize=True. This call site specifies something other than optimize=True, so it was converted to compat.v1.\r\n", "--------------------------------------------------------------------------------\r\n", "\r\n" ] } ], "source": [ "!cat dropout_report.txt" ] }, { "cell_type": "markdown", "metadata": { "id": "DOOLN21nTGSS" }, "source": [ "以下是经过修改的文件内容，请注意脚本是如何通过添加参数名来处理移动和重命名的参数的：" ] }, { "cell_type": "code", "execution_count": 14, "metadata": { "execution": { "iopub.execute_input": "2022-12-14T21:01:05.712341Z", "iopub.status.busy": "2022-12-14T21:01:05.711644Z", "iopub.status.idle": "2022-12-14T21:01:05.833904Z", "shell.execute_reply": "2022-12-14T21:01:05.833151Z" }, "id": "SrYcJk9-TFlU" }, "outputs": [ { "name": "stdout", "output_type": "stream", "text": [ "import tensorflow as tf\r\n", "\r\n", "d = tf.nn.dropout(tf.range(10), rate=1 - (0.2))\r\n", "z = tf.compat.v1.zeros_like(d, optimize=False)\r\n" ] } ], "source": [ "!cat dropout_v2.py" ] }, { "cell_type": "markdown", "metadata": { "id": "wI_sVNp_b4C4" }, "source": [ "更大的项目可能会包含一些错误。例如，转换 deeplab 模型：" ] }, { "cell_type": "code", "execution_count": 15, "metadata": { "execution": { "iopub.execute_input": "2022-12-14T21:01:05.837600Z", "iopub.status.busy": "2022-12-14T21:01:05.837102Z", "iopub.status.idle": "2022-12-14T21:01:09.792698Z", "shell.execute_reply": "2022-12-14T21:01:09.791603Z" }, "id": "uzuY-bOvYBS7" }, "outputs": [ { "name": "stdout", "output_type": "stream", "text": [ "2022-12-14 21:01:06.969746: W tensorflow/compiler/xla/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libnvinfer.so.7'; dlerror: libnvinfer.so.7: cannot open shared object file: No such file or directory\r\n", "2022-12-14 21:01:06.969834: W tensorflow/compiler/xla/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libnvinfer_plugin.so.7'; dlerror: libnvinfer_plugin.so.7: cannot open shared object file: No such file or directory\r\n", "2022-12-14 21:01:06.969844: W tensorflow/compiler/tf2tensorrt/utils/py_utils.cc:38] TF-TRT Warning: Cannot dlopen some TensorRT libraries. If you would like to use Nvidia GPU with TensorRT, please make sure the missing libraries mentioned above are installed properly.\r\n" ] } ], "source": [ "!tf_upgrade_v2 \\\n", " --intree models/research/deeplab \\\n", " --outtree deeplab_v2 \\\n", " --reportfile deeplab_report.txt > /dev/null" ] }, { "cell_type": "markdown", "metadata": { "id": "FLhw3fm8drae" }, "source": [ "它会生成输出文件：" ] }, { "cell_type": "code", "execution_count": 16, "metadata": { "execution": { "iopub.execute_input": "2022-12-14T21:01:09.797505Z", "iopub.status.busy": "2022-12-14T21:01:09.796710Z", "iopub.status.idle": "2022-12-14T21:01:09.919706Z", "shell.execute_reply": "2022-12-14T21:01:09.918825Z" }, "id": "4YYLRxWJdSvQ" }, "outputs": [ { "name": "stdout", "output_type": "stream", "text": [ "README.md\tdatasets\t input_preprocess.py train.py\r\n", "__init__.py\tdeeplab_demo.ipynb local_test.sh\t utils\r\n", "common.py\teval.py\t\t local_test_mobilenetv2.sh vis.py\r\n", "common_test.py\texport_model.py model.py\r\n", "core\t\tg3doc\t\t model_test.py\r\n" ] } ], "source": [ "!ls deeplab_v2" ] }, { "cell_type": "markdown", "metadata": { "id": "qtTC-cAZdEBy" }, "source": [ "但是其中包含错误。该报告会帮助您找到确保代码可以正常运行所需要解决的错误。下面是前三个错误：" ] }, { "cell_type": "code", "execution_count": 17, "metadata": { "execution": { "iopub.execute_input": "2022-12-14T21:01:09.924020Z", "iopub.status.busy": "2022-12-14T21:01:09.923254Z", "iopub.status.idle": "2022-12-14T21:01:10.045918Z", "shell.execute_reply": "2022-12-14T21:01:10.045141Z" }, "id": "UVTNOohlcyVZ" }, "outputs": [ { "name": "stdout", "output_type": "stream", "text": [ "models/research/deeplab/export_model.py:25:7: ERROR: Using member tf.contrib.slim in deprecated module tf.contrib. tf.contrib.slim cannot be converted automatically. tf.contrib will not be distributed with TensorFlow 2.0, please consider an alternative in non-contrib TensorFlow, a community-maintained repository such as tensorflow/addons, or fork the required code.\r\n", "models/research/deeplab/eval.py:28:7: ERROR: Using member tf.contrib.slim in deprecated module tf.contrib. tf.contrib.slim cannot be converted automatically. tf.contrib will not be distributed with TensorFlow 2.0, please consider an alternative in non-contrib TensorFlow, a community-maintained repository such as tensorflow/addons, or fork the required code.\r\n", "models/research/deeplab/eval.py:146:8: ERROR: Using member tf.contrib.metrics.aggregate_metric_map in deprecated module tf.contrib. tf.contrib.metrics.aggregate_metric_map cannot be converted automatically. tf.contrib will not be distributed with TensorFlow 2.0, please consider an alternative in non-contrib TensorFlow, a community-maintained repository such as tensorflow/addons, or fork the required code.\r\n" ] } ], "source": [ "!cat deeplab_report.txt | grep -i models/research/deeplab | grep -i error | head -n 3" ] }, { "cell_type": "markdown", "metadata": { "id": "gGBeDaFVRJ5l" }, "source": [ "## “安全”模式" ] }, { "cell_type": "markdown", "metadata": { "id": "BnfCxB7SVtTO" }, "source": [ "该转换脚本还有一种介入度相对较低的 `SAFETY` 模式。在此模式下，只需更改导入来使用 `tensorflow.compat.v1` 模块：" ] }, { "cell_type": "code", "execution_count": 18, "metadata": { "execution": { "iopub.execute_input": "2022-12-14T21:01:10.050312Z", "iopub.status.busy": "2022-12-14T21:01:10.049566Z", "iopub.status.idle": "2022-12-14T21:01:10.169363Z", "shell.execute_reply": "2022-12-14T21:01:10.168621Z" }, "id": "XdaVXCPWQCC5" }, "outputs": [ { "name": "stdout", "output_type": "stream", "text": [ "import tensorflow as tf\r\n", "\r\n", "d = tf.nn.dropout(tf.range(10), 0.2)\r\n", "z = tf.zeros_like(d, optimize=False)\r\n" ] } ], "source": [ "!cat dropout.py" ] }, { "cell_type": "code", "execution_count": 19, "metadata": { "execution": { "iopub.execute_input": "2022-12-14T21:01:10.173082Z", "iopub.status.busy": "2022-12-14T21:01:10.172569Z", "iopub.status.idle": "2022-12-14T21:01:12.609317Z", "shell.execute_reply": "2022-12-14T21:01:12.608399Z" }, "id": "c0tvRJLGRYEb" }, "outputs": [ { "name": "stdout", "output_type": "stream", "text": [ "2022-12-14 21:01:11.255934: W tensorflow/compiler/xla/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libnvinfer.so.7'; dlerror: libnvinfer.so.7: cannot open shared object file: No such file or directory\r\n", "2022-12-14 21:01:11.256020: W tensorflow/compiler/xla/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libnvinfer_plugin.so.7'; dlerror: libnvinfer_plugin.so.7: cannot open shared object file: No such file or directory\r\n", "2022-12-14 21:01:11.256031: W tensorflow/compiler/tf2tensorrt/utils/py_utils.cc:38] TF-TRT Warning: Cannot dlopen some TensorRT libraries. If you would like to use Nvidia GPU with TensorRT, please make sure the missing libraries mentioned above are installed properly.\r\n" ] } ], "source": [ "!tf_upgrade_v2 --mode SAFETY --infile dropout.py --outfile dropout_v2_safe.py > /dev/null" ] }, { "cell_type": "code", "execution_count": 20, "metadata": { "execution": { "iopub.execute_input": "2022-12-14T21:01:12.613482Z", "iopub.status.busy": "2022-12-14T21:01:12.613216Z", "iopub.status.idle": "2022-12-14T21:01:12.735623Z", "shell.execute_reply": "2022-12-14T21:01:12.734831Z" }, "id": "91suN2RaRfIV" }, "outputs": [ { "name": "stdout", "output_type": "stream", "text": [ "import tensorflow.compat.v1 as tf\r\n", "\r\n", "d = tf.nn.dropout(tf.range(10), 0.2)\r\n", "z = tf.zeros_like(d, optimize=False)\r\n" ] } ], "source": [ "!cat dropout_v2_safe.py" ] }, { "cell_type": "markdown", "metadata": { "id": "EOzTF7xbZqqW" }, "source": [ "如您所见，这不会升级您的代码，但允许 TensorFlow 1 代码针对 TensorFlow 2 二进制文件运行。请注意，这并不意味着您的代码正在运行受支持的 TF 2.x 行为！" ] }, { "cell_type": "markdown", "metadata": { "id": "jGfXVApkqkdG" }, "source": [ "## 注意事项\n", "\n", "- 在运行此脚本之前，不要手动更新代码的某些部分。尤其是，更改了参数顺序的函数（如 `tf.math.argmax` 或 `tf.batch_to_space`）会导致代码错误添加不正确映射现有代码匹配的关键字参数。\n", "\n", "- 该脚本假定使用 `import tensorflow as tf` 或 `import tensorflow.compat.v1 as tf` 导入 `tensorflow`。\n", "\n", "- 该脚本不会更改参数顺序，但是会将关键字参数添加到本身已更改参数顺序的函数。\n", "\n", "- 请查阅 [tf2up.ml](https://github.com/lc0/tf2up)，找到一款方便的工具来升级 GitHub 仓库中的 Jupyter 笔记本和 Python 文件。\n", "\n", "要报告升级脚本错误或提出功能请求，请在 [GitHub](https://github.com/tensorflow/tensorflow/issues) 上提交议题。" ] } ], "metadata": { "colab": { "collapsed_sections": [], "name": "upgrade.ipynb", "toc_visible": true }, "kernelspec": { "display_name": "Python 3", "name": "python3" }, "language_info": { "codemirror_mode": { "name": "ipython", "version": 3 }, "file_extension": ".py", "mimetype": "text/x-python", "name": "python", "nbconvert_exporter": "python", "pygments_lexer": "ipython3", "version": "3.9.16" } }, "nbformat": 4, "nbformat_minor": 0 }