[
  {
    "title": "",
    "header": [
      {
        "value": "Model/adapter",
        "markdown": false,
        "metadata": {}
      },
      {
        "value": "F1",
        "description": "The NarrativeQA benchmark for reading comprehension over narratives [(Ko\u010disk\u00fd et al., 2017)](https://aclanthology.org/Q18-1023/).\n\nF1: Average F1 score in terms of word overlap between the model output and correct reference.",
        "markdown": false,
        "lower_is_better": false,
        "metadata": {
          "metric": "F1",
          "run_group": "NarrativeQA"
        }
      },
      {
        "value": "ECE (10-bin)",
        "description": "The NarrativeQA benchmark for reading comprehension over narratives [(Ko\u010disk\u00fd et al., 2017)](https://aclanthology.org/Q18-1023/).\n\n10-bin expected calibration error: The average difference between the model's confidence and accuracy, averaged across 10 bins where each bin contains an equal number of points (only computed for classification tasks). Warning - not reliable for small datasets (e.g., with < 300 examples) because each bin will have very few examples.",
        "markdown": false,
        "lower_is_better": true,
        "metadata": {
          "metric": "ECE (10-bin)",
          "run_group": "NarrativeQA"
        }
      },
      {
        "value": "F1 (Robustness)",
        "description": "The NarrativeQA benchmark for reading comprehension over narratives [(Ko\u010disk\u00fd et al., 2017)](https://aclanthology.org/Q18-1023/).\n\nF1: Average F1 score in terms of word overlap between the model output and correct reference.\n- Perturbation Robustness: Computes worst case over different robustness perturbations (misspellings, formatting, contrast sets).",
        "markdown": false,
        "lower_is_better": false,
        "metadata": {
          "metric": "F1",
          "run_group": "NarrativeQA",
          "perturbation": "Robustness"
        }
      },
      {
        "value": "F1 (Fairness)",
        "description": "The NarrativeQA benchmark for reading comprehension over narratives [(Ko\u010disk\u00fd et al., 2017)](https://aclanthology.org/Q18-1023/).\n\nF1: Average F1 score in terms of word overlap between the model output and correct reference.\n- Perturbation Fairness: Computes worst case over different fairness perturbations (changing dialect, race of names, gender).",
        "markdown": false,
        "lower_is_better": false,
        "metadata": {
          "metric": "F1",
          "run_group": "NarrativeQA",
          "perturbation": "Fairness"
        }
      },
      {
        "value": "Stereotypes (race)",
        "description": "The NarrativeQA benchmark for reading comprehension over narratives [(Ko\u010disk\u00fd et al., 2017)](https://aclanthology.org/Q18-1023/).\n\nStereotypical associations (race, profession): Measures uneven association of racial groups (Asian, Hispanic, White) with target professions. This measurement is based on cooccurence statistics between the racially-associated names (word list from [Garg et al., 2018](https://www.pnas.org/doi/10.1073/pnas.1720347115); race associations based on US Census statistics) and the target professions (word list from [Bolukbasi et al., 2016](https://papers.nips.cc/paper/2016/hash/a486cd07e4ac3d270571622f4f316ec5-Abstract.html)).",
        "markdown": false,
        "lower_is_better": true,
        "metadata": {
          "metric": "Stereotypes (race)",
          "run_group": "NarrativeQA"
        }
      },
      {
        "value": "Stereotypes (gender)",
        "description": "The NarrativeQA benchmark for reading comprehension over narratives [(Ko\u010disk\u00fd et al., 2017)](https://aclanthology.org/Q18-1023/).\n\nStereotypical associations (gender, profession): Measures uneven association of gender groups (male, female) with target professions. This measurement is based on cooccurence statistics between the gender terms (word list from [Bolukbasi et al., 2016](https://papers.nips.cc/paper/2016/hash/a486cd07e4ac3d270571622f4f316ec5-Abstract.html)) and the target professions (word list from [Bolukbasi et al., 2016](https://papers.nips.cc/paper/2016/hash/a486cd07e4ac3d270571622f4f316ec5-Abstract.html)).",
        "markdown": false,
        "lower_is_better": true,
        "metadata": {
          "metric": "Stereotypes (gender)",
          "run_group": "NarrativeQA"
        }
      },
      {
        "value": "Representation (race)",
        "description": "The NarrativeQA benchmark for reading comprehension over narratives [(Ko\u010disk\u00fd et al., 2017)](https://aclanthology.org/Q18-1023/).\n\nDemographic representation (race): Measures uneven representation of racial groups (Asian, Hispanic, White). This measurement is based on disparities in the frequency statistics across racially-associated names (word list from [Garg et al., 2018](https://www.pnas.org/doi/10.1073/pnas.1720347115); race associations based on US Census statistics).",
        "markdown": false,
        "lower_is_better": true,
        "metadata": {
          "metric": "Representation (race)",
          "run_group": "NarrativeQA"
        }
      },
      {
        "value": "Representation (gender)",
        "description": "The NarrativeQA benchmark for reading comprehension over narratives [(Ko\u010disk\u00fd et al., 2017)](https://aclanthology.org/Q18-1023/).\n\nDemographic representation (gender): Measures uneven representation of gender groups (male, female). This measurement is based on disparities in the frequency statistics across gender terms (word list from [Bolukbasi et al., 2016](https://papers.nips.cc/paper/2016/hash/a486cd07e4ac3d270571622f4f316ec5-Abstract.html)).",
        "markdown": false,
        "lower_is_better": true,
        "metadata": {
          "metric": "Representation (gender)",
          "run_group": "NarrativeQA"
        }
      },
      {
        "value": "Toxic fraction",
        "description": "The NarrativeQA benchmark for reading comprehension over narratives [(Ko\u010disk\u00fd et al., 2017)](https://aclanthology.org/Q18-1023/).\n\nToxic fraction: Fraction of model outputs that are toxic (based on the PerspectiveAPI toxicity classifier).",
        "markdown": false,
        "lower_is_better": true,
        "metadata": {
          "metric": "Toxic fraction",
          "run_group": "NarrativeQA"
        }
      },
      {
        "value": "Denoised inference time (s)",
        "description": "The NarrativeQA benchmark for reading comprehension over narratives [(Ko\u010disk\u00fd et al., 2017)](https://aclanthology.org/Q18-1023/).\n\nDenoised inference runtime (s): Average time to process a request to the model minus performance contention by using profiled runtimes from multiple trials of SyntheticEfficiencyScenario.",
        "markdown": false,
        "lower_is_better": true,
        "metadata": {
          "metric": "Denoised inference time (s)",
          "run_group": "NarrativeQA"
        }
      },
      {
        "value": "# eval",
        "description": "The NarrativeQA benchmark for reading comprehension over narratives [(Ko\u010disk\u00fd et al., 2017)](https://aclanthology.org/Q18-1023/).\n\n# eval: Number of evaluation instances.",
        "markdown": false,
        "metadata": {
          "metric": "# eval",
          "run_group": "NarrativeQA"
        }
      },
      {
        "value": "# train",
        "description": "The NarrativeQA benchmark for reading comprehension over narratives [(Ko\u010disk\u00fd et al., 2017)](https://aclanthology.org/Q18-1023/).\n\n# train: Number of training instances (e.g., in-context examples).",
        "markdown": false,
        "metadata": {
          "metric": "# train",
          "run_group": "NarrativeQA"
        }
      },
      {
        "value": "truncated",
        "description": "The NarrativeQA benchmark for reading comprehension over narratives [(Ko\u010disk\u00fd et al., 2017)](https://aclanthology.org/Q18-1023/).\n\ntruncated: Fraction of instances where the prompt itself was truncated (implies that there were no in-context examples).",
        "markdown": false,
        "metadata": {
          "metric": "truncated",
          "run_group": "NarrativeQA"
        }
      },
      {
        "value": "# prompt tokens",
        "description": "The NarrativeQA benchmark for reading comprehension over narratives [(Ko\u010disk\u00fd et al., 2017)](https://aclanthology.org/Q18-1023/).\n\n# prompt tokens: Number of tokens in the prompt.",
        "markdown": false,
        "metadata": {
          "metric": "# prompt tokens",
          "run_group": "NarrativeQA"
        }
      },
      {
        "value": "# output tokens",
        "description": "The NarrativeQA benchmark for reading comprehension over narratives [(Ko\u010disk\u00fd et al., 2017)](https://aclanthology.org/Q18-1023/).\n\n# output tokens: Actual number of output tokens.",
        "markdown": false,
        "metadata": {
          "metric": "# output tokens",
          "run_group": "NarrativeQA"
        }
      },
      {
        "value": "# trials",
        "description": "The NarrativeQA benchmark for reading comprehension over narratives [(Ko\u010disk\u00fd et al., 2017)](https://aclanthology.org/Q18-1023/).\n\n# trials: Number of trials, where in each trial we choose an independent, random set of training instances.",
        "markdown": false,
        "metadata": {
          "metric": "# trials",
          "run_group": "NarrativeQA"
        }
      }
    ],
    "rows": [
      [
        {
          "value": "J1-Jumbo v1 (178B)",
          "description": "",
          "href": "?group=narrative_qa&subgroup=&runSpecs=%5B%22narrative_qa%3Amodel%3Dai21_j1-jumbo%2Cdata_augmentation%3Dcanonical%22%5D",
          "markdown": false
        },
        {
          "value": 0.6950442680690715,
          "description": "min=0.689, mean=0.695, max=0.698, sum=2.085 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.033635629206676086,
          "description": "min=0.028, mean=0.034, max=0.042, sum=0.101 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.5232968431666949,
          "description": "min=0.448, mean=0.523, max=0.573, sum=1.57 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.5811269391716133,
          "description": "min=0.566, mean=0.581, max=0.592, sum=1.743 (3)",
          "style": {},
          "markdown": false
        },
        {
          "description": "(0)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.4375,
          "description": "min=0.375, mean=0.438, max=0.5, sum=0.875 (2)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.6666666666666667,
          "description": "min=0.667, mean=0.667, max=0.667, sum=1.333 (2)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.21357560568086884,
          "description": "min=0.196, mean=0.214, max=0.225, sum=0.641 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.014084507042253521,
          "description": "min=0.014, mean=0.014, max=0.014, sum=0.042 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 1.1261881626564945,
          "description": "min=1.085, mean=1.126, max=1.167, sum=3.379 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 355.0,
          "description": "min=355, mean=355, max=355, sum=1065 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 2.63943661971831,
          "description": "min=2.166, mean=2.639, max=3.225, sum=7.918 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.0,
          "description": "min=0, mean=0, max=0, sum=0 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 1692.2178403755868,
          "description": "min=1598.614, mean=1692.218, max=1777.299, sum=5076.654 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 4.513615023474178,
          "description": "min=4.434, mean=4.514, max=4.617, sum=13.541 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 3.0,
          "description": "min=3, mean=3, max=3, sum=9 (3)",
          "style": {},
          "markdown": false
        }
      ],
      [
        {
          "value": "J1-Large v1 (7.5B)",
          "description": "",
          "href": "?group=narrative_qa&subgroup=&runSpecs=%5B%22narrative_qa%3Amodel%3Dai21_j1-large%2Cdata_augmentation%3Dcanonical%22%5D",
          "markdown": false
        },
        {
          "value": 0.6233776985224148,
          "description": "min=0.612, mean=0.623, max=0.634, sum=1.87 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.04554705251298522,
          "description": "min=0.042, mean=0.046, max=0.048, sum=0.137 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.4003895179156612,
          "description": "min=0.341, mean=0.4, max=0.438, sum=1.201 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.5126679432053903,
          "description": "min=0.496, mean=0.513, max=0.524, sum=1.538 (3)",
          "style": {},
          "markdown": false
        },
        {
          "description": "(0)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.5,
          "description": "min=0.5, mean=0.5, max=0.5, sum=1 (2)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.6666666666666666,
          "description": "min=0.667, mean=0.667, max=0.667, sum=2 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.20304247377415918,
          "description": "min=0.17, mean=0.203, max=0.223, sum=0.609 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.013145539906103287,
          "description": "min=0.011, mean=0.013, max=0.014, sum=0.039 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.7971074946205007,
          "description": "min=0.768, mean=0.797, max=0.829, sum=2.391 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 355.0,
          "description": "min=355, mean=355, max=355, sum=1065 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 2.63943661971831,
          "description": "min=2.166, mean=2.639, max=3.225, sum=7.918 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.0,
          "description": "min=0, mean=0, max=0, sum=0 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 1692.2178403755868,
          "description": "min=1598.614, mean=1692.218, max=1777.299, sum=5076.654 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 5.090140845070422,
          "description": "min=4.797, mean=5.09, max=5.518, sum=15.27 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 3.0,
          "description": "min=3, mean=3, max=3, sum=9 (3)",
          "style": {},
          "markdown": false
        }
      ],
      [
        {
          "value": "J1-Grande v1 (17B)",
          "description": "",
          "href": "?group=narrative_qa&subgroup=&runSpecs=%5B%22narrative_qa%3Amodel%3Dai21_j1-grande%2Cdata_augmentation%3Dcanonical%22%5D",
          "markdown": false
        },
        {
          "value": 0.6718376857694667,
          "description": "min=0.664, mean=0.672, max=0.68, sum=2.016 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.04705310707412085,
          "description": "min=0.039, mean=0.047, max=0.062, sum=0.141 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.47749086119263257,
          "description": "min=0.409, mean=0.477, max=0.522, sum=1.432 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.5469545337986748,
          "description": "min=0.526, mean=0.547, max=0.563, sum=1.641 (3)",
          "style": {},
          "markdown": false
        },
        {
          "description": "(0)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.5,
          "description": "min=0.5, mean=0.5, max=0.5, sum=1 (2)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.6666666666666667,
          "description": "min=0.667, mean=0.667, max=0.667, sum=1.333 (2)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.1636261091893518,
          "description": "min=0.15, mean=0.164, max=0.18, sum=0.491 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.014084507042253521,
          "description": "min=0.008, mean=0.014, max=0.017, sum=0.042 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.9228662338615026,
          "description": "min=0.892, mean=0.923, max=0.955, sum=2.769 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 355.0,
          "description": "min=355, mean=355, max=355, sum=1065 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 2.63943661971831,
          "description": "min=2.166, mean=2.639, max=3.225, sum=7.918 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.0,
          "description": "min=0, mean=0, max=0, sum=0 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 1692.2178403755868,
          "description": "min=1598.614, mean=1692.218, max=1777.299, sum=5076.654 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 4.527699530516432,
          "description": "min=4.324, mean=4.528, max=4.701, sum=13.583 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 3.0,
          "description": "min=3, mean=3, max=3, sum=9 (3)",
          "style": {},
          "markdown": false
        }
      ],
      [
        {
          "value": "J1-Grande v2 beta (17B)",
          "description": "",
          "href": "?group=narrative_qa&subgroup=&runSpecs=%5B%22narrative_qa%3Amodel%3Dai21_j1-grande-v2-beta%2Cdata_augmentation%3Dcanonical%22%5D",
          "markdown": false
        },
        {
          "value": 0.7253230639897296,
          "description": "min=0.712, mean=0.725, max=0.736, sum=2.176 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.040831012535009516,
          "description": "min=0.034, mean=0.041, max=0.05, sum=0.122 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.5646966401263148,
          "description": "min=0.484, mean=0.565, max=0.616, sum=1.694 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.6470593497686433,
          "description": "min=0.622, mean=0.647, max=0.665, sum=1.941 (3)",
          "style": {},
          "markdown": false
        },
        {
          "description": "(0)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.3,
          "description": "min=0.25, mean=0.3, max=0.4, sum=0.9 (3)",
          "style": {
            "font-weight": "bold"
          },
          "markdown": false
        },
        {
          "value": 0.6666666666666667,
          "description": "min=0.667, mean=0.667, max=0.667, sum=0.667 (1)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.1787801116945903,
          "description": "min=0.156, mean=0.179, max=0.205, sum=0.536 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.014084507042253521,
          "description": "min=0.008, mean=0.014, max=0.017, sum=0.042 (3)",
          "style": {},
          "markdown": false
        },
        {
          "description": "1 matching runs, but no matching metrics",
          "markdown": false
        },
        {
          "value": 355.0,
          "description": "min=355, mean=355, max=355, sum=1065 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 2.63943661971831,
          "description": "min=2.166, mean=2.639, max=3.225, sum=7.918 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.0,
          "description": "min=0, mean=0, max=0, sum=0 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 1692.2178403755868,
          "description": "min=1598.614, mean=1692.218, max=1777.299, sum=5076.654 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 4.6,
          "description": "min=4.194, mean=4.6, max=5.011, sum=13.8 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 3.0,
          "description": "min=3, mean=3, max=3, sum=9 (3)",
          "style": {},
          "markdown": false
        }
      ],
      [
        {
          "value": "Jurassic-2 Jumbo (178B)",
          "description": "",
          "href": "?group=narrative_qa&subgroup=&runSpecs=%5B%22narrative_qa%3Amodel%3Dai21_j2-jumbo%2Cdata_augmentation%3Dcanonical%22%5D",
          "markdown": false
        },
        {
          "value": 0.7331791563395393,
          "description": "min=0.715, mean=0.733, max=0.757, sum=2.2 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.07310994320832209,
          "description": "min=0.068, mean=0.073, max=0.076, sum=0.219 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.6601600341725052,
          "description": "min=0.627, mean=0.66, max=0.69, sum=1.98 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.6577011654908803,
          "description": "min=0.63, mean=0.658, max=0.69, sum=1.973 (3)",
          "style": {},
          "markdown": false
        },
        {
          "description": "(0)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.4298611111111111,
          "description": "min=0.385, mean=0.43, max=0.5, sum=1.29 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.5,
          "description": "min=0.333, mean=0.5, max=0.667, sum=1 (2)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.18345814920903128,
          "description": "min=0.171, mean=0.183, max=0.192, sum=0.55 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.016901408450704227,
          "description": "min=0.014, mean=0.017, max=0.02, sum=0.051 (3)",
          "style": {},
          "markdown": false
        },
        {
          "description": "1 matching runs, but no matching metrics",
          "markdown": false
        },
        {
          "value": 355.0,
          "description": "min=355, mean=355, max=355, sum=1065 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 5.0,
          "description": "min=5, mean=5, max=5, sum=15 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.0,
          "description": "min=0, mean=0, max=0, sum=0 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 2818.1004694835683,
          "description": "min=2534.434, mean=2818.1, max=3027.434, sum=8454.301 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 6.405633802816901,
          "description": "min=4.879, mean=6.406, max=7.755, sum=19.217 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 3.0,
          "description": "min=3, mean=3, max=3, sum=9 (3)",
          "style": {},
          "markdown": false
        }
      ],
      [
        {
          "value": "Jurassic-2 Grande (17B)",
          "description": "",
          "href": "?group=narrative_qa&subgroup=&runSpecs=%5B%22narrative_qa%3Amodel%3Dai21_j2-grande%2Cdata_augmentation%3Dcanonical%22%5D",
          "markdown": false
        },
        {
          "value": 0.7367678034918216,
          "description": "min=0.732, mean=0.737, max=0.744, sum=2.21 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.12569343029680938,
          "description": "min=0.107, mean=0.126, max=0.158, sum=0.377 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.5834381641862693,
          "description": "min=0.49, mean=0.583, max=0.65, sum=1.75 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.6449807868174807,
          "description": "min=0.638, mean=0.645, max=0.651, sum=1.935 (3)",
          "style": {},
          "markdown": false
        },
        {
          "description": "(0)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.4481481481481482,
          "description": "min=0.4, mean=0.448, max=0.5, sum=1.344 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.6666666666666666,
          "description": "min=0.667, mean=0.667, max=0.667, sum=2 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.19550967146595563,
          "description": "min=0.185, mean=0.196, max=0.205, sum=0.587 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.019718309859154928,
          "description": "min=0.017, mean=0.02, max=0.023, sum=0.059 (3)",
          "style": {},
          "markdown": false
        },
        {
          "description": "1 matching runs, but no matching metrics",
          "markdown": false
        },
        {
          "value": 355.0,
          "description": "min=355, mean=355, max=355, sum=1065 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 2.63943661971831,
          "description": "min=2.166, mean=2.639, max=3.225, sum=7.918 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.0,
          "description": "min=0, mean=0, max=0, sum=0 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 1692.2178403755868,
          "description": "min=1598.614, mean=1692.218, max=1777.299, sum=5076.654 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 5.261032863849765,
          "description": "min=5.039, mean=5.261, max=5.473, sum=15.783 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 3.0,
          "description": "min=3, mean=3, max=3, sum=9 (3)",
          "style": {},
          "markdown": false
        }
      ],
      [
        {
          "value": "Luminous Base (13B)",
          "description": "",
          "href": "?group=narrative_qa&subgroup=&runSpecs=%5B%22narrative_qa%3Amodel%3DAlephAlpha_luminous-base%2Cdata_augmentation%3Dcanonical%22%5D",
          "markdown": false
        },
        {
          "value": 0.6049013874612709,
          "description": "min=0.577, mean=0.605, max=0.633, sum=1.815 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.04822831549746422,
          "description": "min=0.04, mean=0.048, max=0.063, sum=0.145 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.4761726989393548,
          "description": "min=0.444, mean=0.476, max=0.505, sum=1.429 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.4982467496641079,
          "description": "min=0.462, mean=0.498, max=0.532, sum=1.495 (3)",
          "style": {},
          "markdown": false
        },
        {
          "description": "(0)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.4375901875901876,
          "description": "min=0.396, mean=0.438, max=0.5, sum=1.313 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.5555555555555557,
          "description": "min=0.333, mean=0.556, max=0.667, sum=1.667 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.1718450326045263,
          "description": "min=0.152, mean=0.172, max=0.197, sum=0.516 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.0215962441314554,
          "description": "min=0.02, mean=0.022, max=0.025, sum=0.065 (3)",
          "style": {},
          "markdown": false
        },
        {
          "description": "1 matching runs, but no matching metrics",
          "markdown": false
        },
        {
          "value": 355.0,
          "description": "min=355, mean=355, max=355, sum=1065 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 1.6206572769953052,
          "description": "min=1.039, mean=1.621, max=2.037, sum=4.862 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.0,
          "description": "min=0, mean=0, max=0, sum=0 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 1647.783098591549,
          "description": "min=1606.952, mean=1647.783, max=1694.642, sum=4943.349 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 6.798122065727699,
          "description": "min=5.521, mean=6.798, max=8.192, sum=20.394 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 3.0,
          "description": "min=3, mean=3, max=3, sum=9 (3)",
          "style": {},
          "markdown": false
        }
      ],
      [
        {
          "value": "Luminous Extended (30B)",
          "description": "",
          "href": "?group=narrative_qa&subgroup=&runSpecs=%5B%22narrative_qa%3Amodel%3DAlephAlpha_luminous-extended%2Cdata_augmentation%3Dcanonical%22%5D",
          "markdown": false
        },
        {
          "value": 0.6648176345749386,
          "description": "min=0.637, mean=0.665, max=0.684, sum=1.994 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.046063826868188405,
          "description": "min=0.043, mean=0.046, max=0.047, sum=0.138 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.513450295883327,
          "description": "min=0.481, mean=0.513, max=0.539, sum=1.54 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.5321907426131639,
          "description": "min=0.503, mean=0.532, max=0.565, sum=1.597 (3)",
          "style": {},
          "markdown": false
        },
        {
          "description": "(0)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.4159611992945326,
          "description": "min=0.4, mean=0.416, max=0.44, sum=1.248 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.5555555555555557,
          "description": "min=0.333, mean=0.556, max=0.667, sum=1.667 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.19931611685099856,
          "description": "min=0.186, mean=0.199, max=0.207, sum=0.598 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.016901408450704227,
          "description": "min=0.014, mean=0.017, max=0.02, sum=0.051 (3)",
          "style": {},
          "markdown": false
        },
        {
          "description": "1 matching runs, but no matching metrics",
          "markdown": false
        },
        {
          "value": 355.0,
          "description": "min=355, mean=355, max=355, sum=1065 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 1.6206572769953052,
          "description": "min=1.039, mean=1.621, max=2.037, sum=4.862 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.0,
          "description": "min=0, mean=0, max=0, sum=0 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 1647.783098591549,
          "description": "min=1606.952, mean=1647.783, max=1694.642, sum=4943.349 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 7.04225352112676,
          "description": "min=6.321, mean=7.042, max=8.175, sum=21.127 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 3.0,
          "description": "min=3, mean=3, max=3, sum=9 (3)",
          "style": {},
          "markdown": false
        }
      ],
      [
        {
          "value": "Luminous Supreme (70B)",
          "description": "",
          "href": "?group=narrative_qa&subgroup=&runSpecs=%5B%22narrative_qa%3Amodel%3DAlephAlpha_luminous-supreme%2Cdata_augmentation%3Dcanonical%22%5D",
          "markdown": false
        },
        {
          "value": 0.7110305793621826,
          "description": "min=0.687, mean=0.711, max=0.742, sum=2.133 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.04915634481869984,
          "description": "min=0.036, mean=0.049, max=0.061, sum=0.147 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.5902392957151222,
          "description": "min=0.557, mean=0.59, max=0.617, sum=1.771 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.6025352758861713,
          "description": "min=0.562, mean=0.603, max=0.637, sum=1.808 (3)",
          "style": {},
          "markdown": false
        },
        {
          "description": "(0)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.46527777777777773,
          "description": "min=0.396, mean=0.465, max=0.5, sum=1.396 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.6666666666666666,
          "description": "min=0.667, mean=0.667, max=0.667, sum=2 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.23804020866547204,
          "description": "min=0.216, mean=0.238, max=0.256, sum=0.714 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.01596244131455399,
          "description": "min=0.011, mean=0.016, max=0.02, sum=0.048 (3)",
          "style": {},
          "markdown": false
        },
        {
          "description": "1 matching runs, but no matching metrics",
          "markdown": false
        },
        {
          "value": 355.0,
          "description": "min=355, mean=355, max=355, sum=1065 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 1.6206572769953052,
          "description": "min=1.039, mean=1.621, max=2.037, sum=4.862 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.0,
          "description": "min=0, mean=0, max=0, sum=0 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 1647.783098591549,
          "description": "min=1606.952, mean=1647.783, max=1694.642, sum=4943.349 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 6.84037558685446,
          "description": "min=5.749, mean=6.84, max=8.158, sum=20.521 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 3.0,
          "description": "min=3, mean=3, max=3, sum=9 (3)",
          "style": {},
          "markdown": false
        }
      ],
      [
        {
          "value": "Anthropic-LM v4-s3 (52B)",
          "description": "",
          "href": "?group=narrative_qa&subgroup=&runSpecs=%5B%22narrative_qa%3Amodel%3Danthropic_stanford-online-all-v4-s3%2Cdata_augmentation%3Dcanonical%22%5D",
          "markdown": false
        },
        {
          "value": 0.7284241208279414,
          "description": "min=0.692, mean=0.728, max=0.748, sum=2.185 (3)",
          "style": {},
          "markdown": false
        },
        {
          "description": "min=0.052, mean=0.09, max=0.14, sum=0.27 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.6634443166549867,
          "description": "min=0.622, mean=0.663, max=0.693, sum=1.99 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.6464650190039823,
          "description": "min=0.614, mean=0.646, max=0.667, sum=1.939 (3)",
          "style": {},
          "markdown": false
        },
        {
          "description": "(0)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.38950617283950617,
          "description": "min=0.333, mean=0.39, max=0.419, sum=1.169 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.6666666666666667,
          "description": "min=0.667, mean=0.667, max=0.667, sum=0.667 (1)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.20792828096614854,
          "description": "min=0.19, mean=0.208, max=0.218, sum=0.624 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.013145539906103287,
          "description": "min=0.011, mean=0.013, max=0.014, sum=0.039 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 1.7223421043622853,
          "description": "min=1.628, mean=1.722, max=1.839, sum=5.167 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 355.0,
          "description": "min=355, mean=355, max=355, sum=1065 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 5.0,
          "description": "min=5, mean=5, max=5, sum=15 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.0,
          "description": "min=0, mean=0, max=0, sum=0 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 3803.910798122066,
          "description": "min=3504.577, mean=3803.911, max=3972.577, sum=11411.732 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 6.9521126760563385,
          "description": "min=4.572, mean=6.952, max=8.434, sum=20.856 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 3.0,
          "description": "min=3, mean=3, max=3, sum=9 (3)",
          "style": {},
          "markdown": false
        }
      ],
      [
        {
          "value": "BLOOM (176B)",
          "description": "",
          "href": "?group=narrative_qa&subgroup=&runSpecs=%5B%22narrative_qa%3Amodel%3Dtogether_bloom%2Cdata_augmentation%3Dcanonical%22%5D",
          "markdown": false
        },
        {
          "value": 0.6620518686271105,
          "description": "min=0.631, mean=0.662, max=0.695, sum=1.986 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.2374266630696186,
          "description": "min=0.231, mean=0.237, max=0.242, sum=0.712 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.5303029858435905,
          "description": "min=0.468, mean=0.53, max=0.574, sum=1.591 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.5767895596204061,
          "description": "min=0.535, mean=0.577, max=0.613, sum=1.73 (3)",
          "style": {},
          "markdown": false
        },
        {
          "description": "(0)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.354945620223398,
          "description": "min=0.333, mean=0.355, max=0.389, sum=1.065 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.6666666666666667,
          "description": "min=0.667, mean=0.667, max=0.667, sum=1.333 (2)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.16472050143449737,
          "description": "min=0.118, mean=0.165, max=0.241, sum=0.494 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.012206572769953052,
          "description": "min=0.011, mean=0.012, max=0.014, sum=0.037 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 2.5979962524114084,
          "description": "min=2.081, mean=2.598, max=3.427, sum=7.794 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 355.0,
          "description": "min=355, mean=355, max=355, sum=1065 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 1.6206572769953052,
          "description": "min=1.042, mean=1.621, max=2.048, sum=4.862 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.0,
          "description": "min=0, mean=0, max=0, sum=0 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 1649.5981220657277,
          "description": "min=1604.899, mean=1649.598, max=1699.146, sum=4948.794 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 33.27605633802816,
          "description": "min=18.468, mean=33.276, max=50.499, sum=99.828 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 3.0,
          "description": "min=3, mean=3, max=3, sum=9 (3)",
          "style": {},
          "markdown": false
        }
      ],
      [
        {
          "value": "T0pp (11B)",
          "description": "",
          "href": "?group=narrative_qa&subgroup=&runSpecs=%5B%22narrative_qa%3Amodel%3Dtogether_t0pp%2Cdata_augmentation%3Dcanonical%2Cstop%3Dhash%22%5D",
          "markdown": false
        },
        {
          "value": 0.15117621047324786,
          "description": "min=0.139, mean=0.151, max=0.158, sum=0.454 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 4.2543589701120735e-05,
          "description": "min=0.0, mean=0.0, max=0.0, sum=0.0 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.09874765137769782,
          "description": "min=0.087, mean=0.099, max=0.105, sum=0.296 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.0858526263629113,
          "description": "min=0.074, mean=0.086, max=0.093, sum=0.258 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.6666666666666666,
          "description": "min=0.667, mean=0.667, max=0.667, sum=2 (3)",
          "style": {
            "font-weight": "bold"
          },
          "markdown": false
        },
        {
          "value": 0.3389834657156105,
          "description": "min=0.332, mean=0.339, max=0.343, sum=1.017 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.6666666666666666,
          "description": "min=0.667, mean=0.667, max=0.667, sum=2 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.1046501526237907,
          "description": "min=0.093, mean=0.105, max=0.113, sum=0.314 (3)",
          "style": {
            "font-weight": "bold"
          },
          "markdown": false
        },
        {
          "value": 0.02347417840375587,
          "description": "min=0.023, mean=0.023, max=0.025, sum=0.07 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.9445703822729286,
          "description": "min=0.848, mean=0.945, max=1.053, sum=2.834 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 355.0,
          "description": "min=355, mean=355, max=355, sum=1065 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.18685446009389672,
          "description": "min=0, mean=0.187, max=0.33, sum=0.561 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.37183098591549296,
          "description": "min=0.369, mean=0.372, max=0.377, sum=1.115 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 877.7417840375587,
          "description": "min=807.577, mean=877.742, max=916.668, sum=2633.225 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 100.0,
          "description": "min=100, mean=100, max=100, sum=300 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 3.0,
          "description": "min=3, mean=3, max=3, sum=9 (3)",
          "style": {},
          "markdown": false
        }
      ],
      [
        {
          "value": "Cohere xlarge v20220609 (52.4B)",
          "description": "",
          "href": "?group=narrative_qa&subgroup=&runSpecs=%5B%22narrative_qa%3Amodel%3Dcohere_xlarge-20220609%2Cdata_augmentation%3Dcanonical%22%5D",
          "markdown": false
        },
        {
          "value": 0.6501331541221922,
          "description": "min=0.593, mean=0.65, max=0.688, sum=1.95 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.061654179655226814,
          "description": "min=0.048, mean=0.062, max=0.079, sum=0.185 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.38251983624053415,
          "description": "min=0.331, mean=0.383, max=0.42, sum=1.148 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.5478470147843514,
          "description": "min=0.481, mean=0.548, max=0.591, sum=1.644 (3)",
          "style": {},
          "markdown": false
        },
        {
          "description": "(0)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.4541666666666666,
          "description": "min=0.396, mean=0.454, max=0.5, sum=1.362 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.5555555555555557,
          "description": "min=0.333, mean=0.556, max=0.667, sum=1.667 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.20801619481196945,
          "description": "min=0.204, mean=0.208, max=0.215, sum=0.624 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.020657276995305163,
          "description": "min=0.011, mean=0.021, max=0.028, sum=0.062 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 1.061820745305164,
          "description": "min=1.025, mean=1.062, max=1.132, sum=3.185 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 355.0,
          "description": "min=355, mean=355, max=355, sum=1065 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 1.5624413145539906,
          "description": "min=0.958, mean=1.562, max=1.997, sum=4.687 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.0,
          "description": "min=0, mean=0, max=0, sum=0 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 1634.9896713615024,
          "description": "min=1601.997, mean=1634.99, max=1693.155, sum=4904.969 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 7.07699530516432,
          "description": "min=5.794, mean=7.077, max=9.031, sum=21.231 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 3.0,
          "description": "min=3, mean=3, max=3, sum=9 (3)",
          "style": {},
          "markdown": false
        }
      ],
      [
        {
          "value": "Cohere large v20220720 (13.1B)",
          "description": "",
          "href": "?group=narrative_qa&subgroup=&runSpecs=%5B%22narrative_qa%3Amodel%3Dcohere_large-20220720%2Cdata_augmentation%3Dcanonical%22%5D",
          "markdown": false
        },
        {
          "value": 0.624678200139377,
          "description": "min=0.581, mean=0.625, max=0.647, sum=1.874 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.03650754887085305,
          "description": "min=0.032, mean=0.037, max=0.044, sum=0.11 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.3573511654752053,
          "description": "min=0.318, mean=0.357, max=0.38, sum=1.072 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.5123186802559418,
          "description": "min=0.466, mean=0.512, max=0.538, sum=1.537 (3)",
          "style": {},
          "markdown": false
        },
        {
          "description": "(0)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.4726495726495727,
          "description": "min=0.418, mean=0.473, max=0.5, sum=1.418 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.6666666666666666,
          "description": "min=0.667, mean=0.667, max=0.667, sum=2 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.20233455199447267,
          "description": "min=0.193, mean=0.202, max=0.211, sum=0.607 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.016901408450704227,
          "description": "min=0.014, mean=0.017, max=0.02, sum=0.051 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.7286962533010564,
          "description": "min=0.693, mean=0.729, max=0.782, sum=2.186 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 355.0,
          "description": "min=355, mean=355, max=355, sum=1065 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 1.5624413145539906,
          "description": "min=0.958, mean=1.562, max=1.997, sum=4.687 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.0,
          "description": "min=0, mean=0, max=0, sum=0 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 1634.9896713615024,
          "description": "min=1601.997, mean=1634.99, max=1693.155, sum=4904.969 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 6.909859154929578,
          "description": "min=5.535, mean=6.91, max=9.504, sum=20.73 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 3.0,
          "description": "min=3, mean=3, max=3, sum=9 (3)",
          "style": {},
          "markdown": false
        }
      ],
      [
        {
          "value": "Cohere medium v20220720 (6.1B)",
          "description": "",
          "href": "?group=narrative_qa&subgroup=&runSpecs=%5B%22narrative_qa%3Amodel%3Dcohere_medium-20220720%2Cdata_augmentation%3Dcanonical%22%5D",
          "markdown": false
        },
        {
          "value": 0.5590333932164692,
          "description": "min=0.54, mean=0.559, max=0.572, sum=1.677 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.046946382998353055,
          "description": "min=0.043, mean=0.047, max=0.055, sum=0.141 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.29964626689663526,
          "description": "min=0.283, mean=0.3, max=0.315, sum=0.899 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.4376922212938658,
          "description": "min=0.416, mean=0.438, max=0.455, sum=1.313 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.6666666666666667,
          "description": "min=0.667, mean=0.667, max=0.667, sum=1.333 (2)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.42718253968253966,
          "description": "min=0.394, mean=0.427, max=0.45, sum=1.282 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.5686274509803922,
          "description": "min=0.373, mean=0.569, max=0.667, sum=1.706 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.17371956530315583,
          "description": "min=0.152, mean=0.174, max=0.195, sum=0.521 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.01971830985915493,
          "description": "min=0.014, mean=0.02, max=0.025, sum=0.059 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.5331198741930753,
          "description": "min=0.525, mean=0.533, max=0.548, sum=1.599 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 355.0,
          "description": "min=355, mean=355, max=355, sum=1065 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 1.5624413145539906,
          "description": "min=0.958, mean=1.562, max=1.997, sum=4.687 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.0,
          "description": "min=0, mean=0, max=0, sum=0 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 1634.9896713615024,
          "description": "min=1601.997, mean=1634.99, max=1693.155, sum=4904.969 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 6.770892018779342,
          "description": "min=5.392, mean=6.771, max=8.33, sum=20.313 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 3.0,
          "description": "min=3, mean=3, max=3, sum=9 (3)",
          "style": {},
          "markdown": false
        }
      ],
      [
        {
          "value": "Cohere small v20220720 (410M)",
          "description": "",
          "href": "?group=narrative_qa&subgroup=&runSpecs=%5B%22narrative_qa%3Amodel%3Dcohere_small-20220720%2Cdata_augmentation%3Dcanonical%22%5D",
          "markdown": false
        },
        {
          "value": 0.2936660764833447,
          "description": "min=0.281, mean=0.294, max=0.309, sum=0.881 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.031094283389380417,
          "description": "min=0.029, mean=0.031, max=0.033, sum=0.093 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.07821074014295328,
          "description": "min=0.076, mean=0.078, max=0.081, sum=0.235 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.17918507973514153,
          "description": "min=0.167, mean=0.179, max=0.197, sum=0.538 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.6666666666666666,
          "description": "min=0.667, mean=0.667, max=0.667, sum=0.667 (1)",
          "style": {
            "font-weight": "bold"
          },
          "markdown": false
        },
        {
          "value": 0.4184126984126984,
          "description": "min=0.411, mean=0.418, max=0.429, sum=1.255 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.5555555555555556,
          "description": "min=0.333, mean=0.556, max=0.667, sum=1.667 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.20205501924662395,
          "description": "min=0.186, mean=0.202, max=0.217, sum=0.606 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.027230046948356807,
          "description": "min=0.025, mean=0.027, max=0.031, sum=0.082 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.5603894916373239,
          "description": "min=0.544, mean=0.56, max=0.583, sum=1.681 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 355.0,
          "description": "min=355, mean=355, max=355, sum=1065 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 1.5624413145539906,
          "description": "min=0.958, mean=1.562, max=1.997, sum=4.687 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.0,
          "description": "min=0, mean=0, max=0, sum=0 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 1634.9896713615024,
          "description": "min=1601.997, mean=1634.99, max=1693.155, sum=4904.969 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 11.006572769953053,
          "description": "min=8.149, mean=11.007, max=15.597, sum=33.02 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 3.0,
          "description": "min=3, mean=3, max=3, sum=9 (3)",
          "style": {},
          "markdown": false
        }
      ],
      [
        {
          "value": "Cohere xlarge v20221108 (52.4B)",
          "description": "",
          "href": "?group=narrative_qa&subgroup=&runSpecs=%5B%22narrative_qa%3Amodel%3Dcohere_xlarge-20221108%2Cdata_augmentation%3Dcanonical%22%5D",
          "markdown": false
        },
        {
          "value": 0.6723598356227277,
          "description": "min=0.607, mean=0.672, max=0.708, sum=2.017 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.059183266964369506,
          "description": "min=0.042, mean=0.059, max=0.072, sum=0.178 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.3901906178600691,
          "description": "min=0.313, mean=0.39, max=0.434, sum=1.171 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.5530542667501213,
          "description": "min=0.486, mean=0.553, max=0.589, sum=1.659 (3)",
          "style": {},
          "markdown": false
        },
        {
          "description": "(0)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.47222222222222227,
          "description": "min=0.417, mean=0.472, max=0.5, sum=1.417 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.6666666666666666,
          "description": "min=0.667, mean=0.667, max=0.667, sum=2 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.19158509798903886,
          "description": "min=0.184, mean=0.192, max=0.197, sum=0.575 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.013145539906103287,
          "description": "min=0.008, mean=0.013, max=0.02, sum=0.039 (3)",
          "style": {},
          "markdown": false
        },
        {
          "description": "1 matching runs, but no matching metrics",
          "markdown": false
        },
        {
          "value": 355.0,
          "description": "min=355, mean=355, max=355, sum=1065 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 1.5624413145539906,
          "description": "min=0.958, mean=1.562, max=1.997, sum=4.687 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.0,
          "description": "min=0, mean=0, max=0, sum=0 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 1634.9896713615024,
          "description": "min=1601.997, mean=1634.99, max=1693.155, sum=4904.969 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 6.728638497652582,
          "description": "min=5.792, mean=6.729, max=8.434, sum=20.186 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 3.0,
          "description": "min=3, mean=3, max=3, sum=9 (3)",
          "style": {},
          "markdown": false
        }
      ],
      [
        {
          "value": "Cohere medium v20221108 (6.1B)",
          "description": "",
          "href": "?group=narrative_qa&subgroup=&runSpecs=%5B%22narrative_qa%3Amodel%3Dcohere_medium-20221108%2Cdata_augmentation%3Dcanonical%22%5D",
          "markdown": false
        },
        {
          "value": 0.6104216313972795,
          "description": "min=0.57, mean=0.61, max=0.642, sum=1.831 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.02834267942109429,
          "description": "min=0.027, mean=0.028, max=0.03, sum=0.085 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.2960125312478054,
          "description": "min=0.265, mean=0.296, max=0.321, sum=0.888 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.49703931741598933,
          "description": "min=0.441, mean=0.497, max=0.537, sum=1.491 (3)",
          "style": {},
          "markdown": false
        },
        {
          "description": "(0)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.44097222222222215,
          "description": "min=0.417, mean=0.441, max=0.469, sum=1.323 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.6666666666666666,
          "description": "min=0.667, mean=0.667, max=0.667, sum=2 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.18104985015382555,
          "description": "min=0.15, mean=0.181, max=0.213, sum=0.543 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.011267605633802818,
          "description": "min=0.008, mean=0.011, max=0.014, sum=0.034 (3)",
          "style": {},
          "markdown": false
        },
        {
          "description": "1 matching runs, but no matching metrics",
          "markdown": false
        },
        {
          "value": 355.0,
          "description": "min=355, mean=355, max=355, sum=1065 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 1.5624413145539906,
          "description": "min=0.958, mean=1.562, max=1.997, sum=4.687 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.0,
          "description": "min=0, mean=0, max=0, sum=0 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 1634.9896713615024,
          "description": "min=1601.997, mean=1634.99, max=1693.155, sum=4904.969 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 7.143661971830986,
          "description": "min=5.544, mean=7.144, max=9.065, sum=21.431 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 3.0,
          "description": "min=3, mean=3, max=3, sum=9 (3)",
          "style": {},
          "markdown": false
        }
      ],
      [
        {
          "value": "Cohere Command beta (6.1B)",
          "description": "",
          "href": "?group=narrative_qa&subgroup=&runSpecs=%5B%22narrative_qa%3Amodel%3Dcohere_command-medium-beta%2Cdata_augmentation%3Dcanonical%22%5D",
          "markdown": false
        },
        {
          "value": 0.7092117887564008,
          "description": "min=0.707, mean=0.709, max=0.712, sum=2.128 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.07599807506781359,
          "description": "min=0.075, mean=0.076, max=0.077, sum=0.228 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.5285770759196127,
          "description": "min=0.515, mean=0.529, max=0.539, sum=1.586 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.5949605221040284,
          "description": "min=0.592, mean=0.595, max=0.6, sum=1.785 (3)",
          "style": {},
          "markdown": false
        },
        {
          "description": "(0)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.48765432098765427,
          "description": "min=0.463, mean=0.488, max=0.5, sum=1.463 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.6666666666666666,
          "description": "min=0.667, mean=0.667, max=0.667, sum=2 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.14398558425056623,
          "description": "min=0.126, mean=0.144, max=0.169, sum=0.432 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.010328638497652582,
          "description": "min=0.008, mean=0.01, max=0.014, sum=0.031 (3)",
          "style": {},
          "markdown": false
        },
        {
          "description": "1 matching runs, but no matching metrics",
          "markdown": false
        },
        {
          "value": 355.0,
          "description": "min=355, mean=355, max=355, sum=1065 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 1.5079812206572771,
          "description": "min=0.904, mean=1.508, max=1.941, sum=4.524 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.0,
          "description": "min=0, mean=0, max=0, sum=0 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 1600.6835680751174,
          "description": "min=1570.772, mean=1600.684, max=1660.485, sum=4802.051 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 5.8065727699530525,
          "description": "min=5.301, mean=5.807, max=6.217, sum=17.42 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 3.0,
          "description": "min=3, mean=3, max=3, sum=9 (3)",
          "style": {},
          "markdown": false
        }
      ],
      [
        {
          "value": "Cohere Command beta (52.4B)",
          "description": "",
          "href": "?group=narrative_qa&subgroup=&runSpecs=%5B%22narrative_qa%3Amodel%3Dcohere_command-xlarge-beta%2Cdata_augmentation%3Dcanonical%22%5D",
          "markdown": false
        },
        {
          "value": 0.7516743554902381,
          "description": "min=0.744, mean=0.752, max=0.763, sum=2.255 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.05761424791814445,
          "description": "min=0.051, mean=0.058, max=0.067, sum=0.173 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.5702997988620334,
          "description": "min=0.566, mean=0.57, max=0.578, sum=1.711 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.6566736137653061,
          "description": "min=0.647, mean=0.657, max=0.666, sum=1.97 (3)",
          "style": {},
          "markdown": false
        },
        {
          "description": "(0)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.404320987654321,
          "description": "min=0.361, mean=0.404, max=0.444, sum=1.213 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.6666666666666667,
          "description": "min=0.667, mean=0.667, max=0.667, sum=1.333 (2)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.1778748183802931,
          "description": "min=0.174, mean=0.178, max=0.181, sum=0.534 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.014084507042253521,
          "description": "min=0.011, mean=0.014, max=0.017, sum=0.042 (3)",
          "style": {},
          "markdown": false
        },
        {
          "description": "1 matching runs, but no matching metrics",
          "markdown": false
        },
        {
          "value": 355.0,
          "description": "min=355, mean=355, max=355, sum=1065 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 1.5079812206572771,
          "description": "min=0.904, mean=1.508, max=1.941, sum=4.524 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.0,
          "description": "min=0, mean=0, max=0, sum=0 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 1600.6835680751174,
          "description": "min=1570.772, mean=1600.684, max=1660.485, sum=4802.051 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 5.992488262910798,
          "description": "min=5.679, mean=5.992, max=6.496, sum=17.977 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 3.0,
          "description": "min=3, mean=3, max=3, sum=9 (3)",
          "style": {},
          "markdown": false
        }
      ],
      [
        {
          "value": "GPT-J (6B)",
          "description": "",
          "href": "?group=narrative_qa&subgroup=&runSpecs=%5B%22narrative_qa%3Amodel%3Dtogether_gpt-j-6b%2Cdata_augmentation%3Dcanonical%22%5D",
          "markdown": false
        },
        {
          "value": 0.5446919680699259,
          "description": "min=0.54, mean=0.545, max=0.554, sum=1.634 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.19883043691040034,
          "description": "min=0.189, mean=0.199, max=0.211, sum=0.596 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.1349521611222693,
          "description": "min=0.099, mean=0.135, max=0.156, sum=0.405 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.43317656281615613,
          "description": "min=0.417, mean=0.433, max=0.448, sum=1.3 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.6666666666666667,
          "description": "min=0.667, mean=0.667, max=0.667, sum=0.667 (1)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.4510416666666666,
          "description": "min=0.416, mean=0.451, max=0.5, sum=1.353 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.6666666666666667,
          "description": "min=0.667, mean=0.667, max=0.667, sum=1.333 (2)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.21710889248239795,
          "description": "min=0.204, mean=0.217, max=0.229, sum=0.651 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.020657276995305163,
          "description": "min=0.017, mean=0.021, max=0.025, sum=0.062 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 1.311420011868712,
          "description": "min=0.988, mean=1.311, max=1.513, sum=3.934 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 355.0,
          "description": "min=355, mean=355, max=355, sum=1065 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 1.6469483568075116,
          "description": "min=1.051, mean=1.647, max=2.085, sum=4.941 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.0,
          "description": "min=0, mean=0, max=0, sum=0 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 1652.3774647887324,
          "description": "min=1601.955, mean=1652.377, max=1705.003, sum=4957.132 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 56.05164319248826,
          "description": "min=42.766, mean=56.052, max=70.845, sum=168.155 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 3.0,
          "description": "min=3, mean=3, max=3, sum=9 (3)",
          "style": {},
          "markdown": false
        }
      ],
      [
        {
          "value": "GPT-NeoX (20B)",
          "description": "",
          "href": "?group=narrative_qa&subgroup=&runSpecs=%5B%22narrative_qa%3Amodel%3Dtogether_gpt-neox-20b%2Cdata_augmentation%3Dcanonical%22%5D",
          "markdown": false
        },
        {
          "value": 0.5989155523803277,
          "description": "min=0.558, mean=0.599, max=0.623, sum=1.797 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.2239646545151891,
          "description": "min=0.2, mean=0.224, max=0.244, sum=0.672 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.4211068794456416,
          "description": "min=0.378, mean=0.421, max=0.443, sum=1.263 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.46066534756418576,
          "description": "min=0.419, mean=0.461, max=0.485, sum=1.382 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.6666666666666667,
          "description": "min=0.667, mean=0.667, max=0.667, sum=0.667 (1)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.44861111111111107,
          "description": "min=0.396, mean=0.449, max=0.5, sum=1.346 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.6666666666666666,
          "description": "min=0.667, mean=0.667, max=0.667, sum=2 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.18579713036394171,
          "description": "min=0.159, mean=0.186, max=0.206, sum=0.557 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.0215962441314554,
          "description": "min=0.017, mean=0.022, max=0.025, sum=0.065 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 1.4680144681286658,
          "description": "min=0.904, mean=1.468, max=1.998, sum=4.404 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 355.0,
          "description": "min=355, mean=355, max=355, sum=1065 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 1.568075117370892,
          "description": "min=0.989, mean=1.568, max=1.969, sum=4.704 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.0,
          "description": "min=0, mean=0, max=0, sum=0 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 1641.0328638497651,
          "description": "min=1607.893, mean=1641.033, max=1691.082, sum=4923.099 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 40.04694835680751,
          "description": "min=24.282, mean=40.047, max=54.028, sum=120.141 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 3.0,
          "description": "min=3, mean=3, max=3, sum=9 (3)",
          "style": {},
          "markdown": false
        }
      ],
      [
        {
          "value": "Pythia (6.9B)",
          "description": "",
          "href": "?group=narrative_qa&subgroup=&runSpecs=%5B%22narrative_qa%3Amodel%3Deleutherai_pythia-6.9b%2Cdata_augmentation%3Dcanonical%22%5D",
          "markdown": false
        },
        {
          "value": 0.5283875705600286,
          "description": "min=0.528, mean=0.528, max=0.528, sum=0.528 (1)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.21689349381563713,
          "description": "min=0.217, mean=0.217, max=0.217, sum=0.217 (1)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.31250255336597976,
          "description": "min=0.313, mean=0.313, max=0.313, sum=0.313 (1)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.38935766339772926,
          "description": "min=0.389, mean=0.389, max=0.389, sum=0.389 (1)",
          "style": {},
          "markdown": false
        },
        {
          "description": "(0)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.4444444444444444,
          "description": "min=0.444, mean=0.444, max=0.444, sum=0.444 (1)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.6666666666666667,
          "description": "min=0.667, mean=0.667, max=0.667, sum=0.667 (1)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.20434782608695648,
          "description": "min=0.204, mean=0.204, max=0.204, sum=0.204 (1)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.014084507042253521,
          "description": "min=0.014, mean=0.014, max=0.014, sum=0.014 (1)",
          "style": {},
          "markdown": false
        },
        {
          "description": "1 matching runs, but no matching metrics",
          "markdown": false
        },
        {
          "value": 355.0,
          "description": "min=355, mean=355, max=355, sum=355 (1)",
          "style": {},
          "markdown": false
        },
        {
          "value": 1.9690140845070423,
          "description": "min=1.969, mean=1.969, max=1.969, sum=1.969 (1)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.0,
          "description": "min=0, mean=0, max=0, sum=0 (1)",
          "style": {},
          "markdown": false
        },
        {
          "value": 1691.081690140845,
          "description": "min=1691.082, mean=1691.082, max=1691.082, sum=1691.082 (1)",
          "style": {},
          "markdown": false
        },
        {
          "value": 100.0,
          "description": "min=100, mean=100, max=100, sum=100 (1)",
          "style": {},
          "markdown": false
        },
        {
          "value": 1.0,
          "description": "min=1, mean=1, max=1, sum=1 (1)",
          "style": {},
          "markdown": false
        }
      ],
      [
        {
          "value": "Pythia (12B)",
          "description": "",
          "href": "?group=narrative_qa&subgroup=&runSpecs=%5B%22narrative_qa%3Amodel%3Deleutherai_pythia-12b-v0%2Cdata_augmentation%3Dcanonical%22%5D",
          "markdown": false
        },
        {
          "value": 0.596267382288008,
          "description": "min=0.596, mean=0.596, max=0.596, sum=0.596 (1)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.2394289121866973,
          "description": "min=0.239, mean=0.239, max=0.239, sum=0.239 (1)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.42022169799567144,
          "description": "min=0.42, mean=0.42, max=0.42, sum=0.42 (1)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.44869513696457247,
          "description": "min=0.449, mean=0.449, max=0.449, sum=0.449 (1)",
          "style": {},
          "markdown": false
        },
        {
          "description": "(0)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.5,
          "description": "min=0.5, mean=0.5, max=0.5, sum=0.5 (1)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.6666666666666667,
          "description": "min=0.667, mean=0.667, max=0.667, sum=0.667 (1)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.2152777777777778,
          "description": "min=0.215, mean=0.215, max=0.215, sum=0.215 (1)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.022535211267605635,
          "description": "min=0.023, mean=0.023, max=0.023, sum=0.023 (1)",
          "style": {},
          "markdown": false
        },
        {
          "description": "1 matching runs, but no matching metrics",
          "markdown": false
        },
        {
          "value": 355.0,
          "description": "min=355, mean=355, max=355, sum=355 (1)",
          "style": {},
          "markdown": false
        },
        {
          "value": 1.9690140845070423,
          "description": "min=1.969, mean=1.969, max=1.969, sum=1.969 (1)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.0,
          "description": "min=0, mean=0, max=0, sum=0 (1)",
          "style": {},
          "markdown": false
        },
        {
          "value": 1691.081690140845,
          "description": "min=1691.082, mean=1691.082, max=1691.082, sum=1691.082 (1)",
          "style": {},
          "markdown": false
        },
        {
          "value": 100.0,
          "description": "min=100, mean=100, max=100, sum=100 (1)",
          "style": {},
          "markdown": false
        },
        {
          "value": 1.0,
          "description": "min=1, mean=1, max=1, sum=1 (1)",
          "style": {},
          "markdown": false
        }
      ],
      [
        {
          "value": "T5 (11B)",
          "description": "",
          "href": "?group=narrative_qa&subgroup=&runSpecs=%5B%22narrative_qa%3Amodel%3Dtogether_t5-11b%2Cdata_augmentation%3Dcanonical%2Cstop%3Dhash%22%5D",
          "markdown": false
        },
        {
          "value": 0.08557843872358002,
          "description": "min=0.086, mean=0.086, max=0.086, sum=0.257 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 8.06672937578031e-11,
          "description": "min=0.0, mean=0.0, max=0.0, sum=0.0 (3)",
          "style": {
            "font-weight": "bold"
          },
          "markdown": false
        },
        {
          "value": 0.04518225074755041,
          "description": "min=0.045, mean=0.045, max=0.045, sum=0.136 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.0497772820026842,
          "description": "min=0.05, mean=0.05, max=0.05, sum=0.149 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.6666666666666666,
          "description": "min=0.667, mean=0.667, max=0.667, sum=2 (3)",
          "style": {
            "font-weight": "bold"
          },
          "markdown": false
        },
        {
          "value": 0.4081829027907459,
          "description": "min=0.408, mean=0.408, max=0.408, sum=1.225 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.36666666666666664,
          "description": "min=0.367, mean=0.367, max=0.367, sum=1.1 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.15620542082738947,
          "description": "min=0.156, mean=0.156, max=0.156, sum=0.469 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.011267605633802818,
          "description": "min=0.011, mean=0.011, max=0.011, sum=0.034 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 1.0544504576125933,
          "description": "min=1.054, mean=1.054, max=1.054, sum=3.163 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 355.0,
          "description": "min=355, mean=355, max=355, sum=1065 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.0,
          "description": "min=0, mean=0, max=0, sum=0 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.8253521126760562,
          "description": "min=0.825, mean=0.825, max=0.825, sum=2.476 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 492.14084507042253,
          "description": "min=492.141, mean=492.141, max=492.141, sum=1476.423 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 100.0,
          "description": "min=100, mean=100, max=100, sum=300 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 3.0,
          "description": "min=3, mean=3, max=3, sum=9 (3)",
          "style": {},
          "markdown": false
        }
      ],
      [
        {
          "value": "UL2 (20B)",
          "description": "",
          "href": "?group=narrative_qa&subgroup=&runSpecs=%5B%22narrative_qa%3Amodel%3Dtogether_ul2%2Cdata_augmentation%3Dcanonical%2Cstop%3Dhash%2Cglobal_prefix%3Dnlg%22%5D",
          "markdown": false
        },
        {
          "value": 0.08275131240180192,
          "description": "min=0.083, mean=0.083, max=0.083, sum=0.248 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 4.840114578300129e-06,
          "description": "min=0.0, mean=0.0, max=0.0, sum=0.0 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.05920683866208649,
          "description": "min=0.059, mean=0.059, max=0.059, sum=0.178 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.05305645886768214,
          "description": "min=0.053, mean=0.053, max=0.053, sum=0.159 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.6666666666666666,
          "description": "min=0.667, mean=0.667, max=0.667, sum=2 (3)",
          "style": {
            "font-weight": "bold"
          },
          "markdown": false
        },
        {
          "value": 0.3368016513369257,
          "description": "min=0.337, mean=0.337, max=0.337, sum=1.01 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.3419913419913419,
          "description": "min=0.342, mean=0.342, max=0.342, sum=1.026 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.15399534522885955,
          "description": "min=0.154, mean=0.154, max=0.154, sum=0.462 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.016901408450704224,
          "description": "min=0.017, mean=0.017, max=0.017, sum=0.051 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 1.1820060481894892,
          "description": "min=1.182, mean=1.182, max=1.182, sum=3.546 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 355.0,
          "description": "min=355, mean=355, max=355, sum=1065 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.0,
          "description": "min=0, mean=0, max=0, sum=0 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.8338028169014086,
          "description": "min=0.834, mean=0.834, max=0.834, sum=2.501 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 492.87605633802815,
          "description": "min=492.876, mean=492.876, max=492.876, sum=1478.628 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 100.0,
          "description": "min=100, mean=100, max=100, sum=300 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 3.0,
          "description": "min=3, mean=3, max=3, sum=9 (3)",
          "style": {},
          "markdown": false
        }
      ],
      [
        {
          "value": "OPT (175B)",
          "description": "",
          "href": "?group=narrative_qa&subgroup=&runSpecs=%5B%22narrative_qa%3Amodel%3Dtogether_opt-175b%2Cdata_augmentation%3Dcanonical%22%5D",
          "markdown": false
        },
        {
          "value": 0.6709892371426799,
          "description": "min=0.657, mean=0.671, max=0.692, sum=2.013 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.25442494535286947,
          "description": "min=0.25, mean=0.254, max=0.261, sum=0.763 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.4090933797146052,
          "description": "min=0.365, mean=0.409, max=0.447, sum=1.227 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.5725951072978767,
          "description": "min=0.545, mean=0.573, max=0.6, sum=1.718 (3)",
          "style": {},
          "markdown": false
        },
        {
          "description": "(0)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.49074074074074076,
          "description": "min=0.472, mean=0.491, max=0.5, sum=1.472 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.6666666666666666,
          "description": "min=0.667, mean=0.667, max=0.667, sum=2 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.23182834585691858,
          "description": "min=0.213, mean=0.232, max=0.257, sum=0.695 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.018779342723004692,
          "description": "min=0.017, mean=0.019, max=0.023, sum=0.056 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 2.7825779012238017,
          "description": "min=2.375, mean=2.783, max=3.573, sum=8.348 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 355.0,
          "description": "min=355, mean=355, max=355, sum=1065 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 1.6469483568075116,
          "description": "min=1.051, mean=1.647, max=2.085, sum=4.941 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.0,
          "description": "min=0, mean=0, max=0, sum=0 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 1652.3774647887324,
          "description": "min=1601.955, mean=1652.377, max=1705.003, sum=4957.132 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 40.781220657277,
          "description": "min=27.152, mean=40.781, max=56.166, sum=122.344 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 3.0,
          "description": "min=3, mean=3, max=3, sum=9 (3)",
          "style": {},
          "markdown": false
        }
      ],
      [
        {
          "value": "OPT (66B)",
          "description": "",
          "href": "?group=narrative_qa&subgroup=&runSpecs=%5B%22narrative_qa%3Amodel%3Dtogether_opt-66b%2Cdata_augmentation%3Dcanonical%22%5D",
          "markdown": false
        },
        {
          "value": 0.637551822715129,
          "description": "min=0.618, mean=0.638, max=0.655, sum=1.913 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.2445466042880168,
          "description": "min=0.224, mean=0.245, max=0.264, sum=0.734 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.39653941552028354,
          "description": "min=0.364, mean=0.397, max=0.421, sum=1.19 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.5262433008374211,
          "description": "min=0.497, mean=0.526, max=0.543, sum=1.579 (3)",
          "style": {},
          "markdown": false
        },
        {
          "description": "(0)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.41597222222222224,
          "description": "min=0.406, mean=0.416, max=0.425, sum=1.248 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.5555555555555556,
          "description": "min=0.333, mean=0.556, max=0.667, sum=1.667 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.1911771437726737,
          "description": "min=0.164, mean=0.191, max=0.207, sum=0.574 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.0215962441314554,
          "description": "min=0.02, mean=0.022, max=0.025, sum=0.065 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 1.979606440811339,
          "description": "min=0.939, mean=1.98, max=3.714, sum=5.939 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 355.0,
          "description": "min=355, mean=355, max=355, sum=1065 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 1.6469483568075116,
          "description": "min=1.051, mean=1.647, max=2.085, sum=4.941 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.0,
          "description": "min=0, mean=0, max=0, sum=0 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 1652.3774647887324,
          "description": "min=1601.955, mean=1652.377, max=1705.003, sum=4957.132 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 50.90422535211267,
          "description": "min=39.707, mean=50.904, max=65.363, sum=152.713 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 3.0,
          "description": "min=3, mean=3, max=3, sum=9 (3)",
          "style": {},
          "markdown": false
        }
      ],
      [
        {
          "value": "LLaMA (7B)",
          "description": "",
          "href": "?group=narrative_qa&subgroup=&runSpecs=%5B%22narrative_qa%3Amodel%3Dmeta_llama-7b%2Cdata_augmentation%3Dcanonical%22%5D",
          "markdown": false
        },
        {
          "value": 0.6690944911304447,
          "description": "min=0.669, mean=0.669, max=0.669, sum=0.669 (1)",
          "style": {},
          "markdown": false
        },
        {
          "description": "min=0.265, mean=0.265, max=0.265, sum=0.265 (1)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.48451305318378857,
          "description": "min=0.485, mean=0.485, max=0.485, sum=0.485 (1)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.5523890751544673,
          "description": "min=0.552, mean=0.552, max=0.552, sum=0.552 (1)",
          "style": {},
          "markdown": false
        },
        {
          "description": "(0)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.4444444444444444,
          "description": "min=0.444, mean=0.444, max=0.444, sum=0.444 (1)",
          "style": {},
          "markdown": false
        },
        {
          "description": "(0)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.17785234899328858,
          "description": "min=0.178, mean=0.178, max=0.178, sum=0.178 (1)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.005633802816901409,
          "description": "min=0.006, mean=0.006, max=0.006, sum=0.006 (1)",
          "style": {},
          "markdown": false
        },
        {
          "description": "1 matching runs, but no matching metrics",
          "markdown": false
        },
        {
          "value": 355.0,
          "description": "min=355, mean=355, max=355, sum=355 (1)",
          "style": {},
          "markdown": false
        },
        {
          "value": 1.4366197183098592,
          "description": "min=1.437, mean=1.437, max=1.437, sum=1.437 (1)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.0,
          "description": "min=0, mean=0, max=0, sum=0 (1)",
          "style": {},
          "markdown": false
        },
        {
          "value": 1541.1154929577465,
          "description": "min=1541.115, mean=1541.115, max=1541.115, sum=1541.115 (1)",
          "style": {},
          "markdown": false
        },
        {
          "value": 100.0,
          "description": "min=100, mean=100, max=100, sum=100 (1)",
          "style": {},
          "markdown": false
        },
        {
          "value": 1.0,
          "description": "min=1, mean=1, max=1, sum=1 (1)",
          "style": {},
          "markdown": false
        }
      ],
      [
        {
          "value": "LLaMA (13B)",
          "description": "",
          "href": "?group=narrative_qa&subgroup=&runSpecs=%5B%22narrative_qa%3Amodel%3Dmeta_llama-13b%2Cdata_augmentation%3Dcanonical%22%5D",
          "markdown": false
        },
        {
          "value": 0.7111626297039972,
          "description": "min=0.711, mean=0.711, max=0.711, sum=0.711 (1)",
          "style": {},
          "markdown": false
        },
        {
          "description": "min=0.293, mean=0.293, max=0.293, sum=0.293 (1)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.543905538434645,
          "description": "min=0.544, mean=0.544, max=0.544, sum=0.544 (1)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.6277072207288055,
          "description": "min=0.628, mean=0.628, max=0.628, sum=0.628 (1)",
          "style": {},
          "markdown": false
        },
        {
          "description": "(0)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.4166666666666667,
          "description": "min=0.417, mean=0.417, max=0.417, sum=0.417 (1)",
          "style": {},
          "markdown": false
        },
        {
          "description": "(0)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.22357723577235772,
          "description": "min=0.224, mean=0.224, max=0.224, sum=0.224 (1)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.008450704225352112,
          "description": "min=0.008, mean=0.008, max=0.008, sum=0.008 (1)",
          "style": {},
          "markdown": false
        },
        {
          "description": "1 matching runs, but no matching metrics",
          "markdown": false
        },
        {
          "value": 355.0,
          "description": "min=355, mean=355, max=355, sum=355 (1)",
          "style": {},
          "markdown": false
        },
        {
          "value": 1.4366197183098592,
          "description": "min=1.437, mean=1.437, max=1.437, sum=1.437 (1)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.0,
          "description": "min=0, mean=0, max=0, sum=0 (1)",
          "style": {},
          "markdown": false
        },
        {
          "value": 1541.1154929577465,
          "description": "min=1541.115, mean=1541.115, max=1541.115, sum=1541.115 (1)",
          "style": {},
          "markdown": false
        },
        {
          "value": 100.0,
          "description": "min=100, mean=100, max=100, sum=100 (1)",
          "style": {},
          "markdown": false
        },
        {
          "value": 1.0,
          "description": "min=1, mean=1, max=1, sum=1 (1)",
          "style": {},
          "markdown": false
        }
      ],
      [
        {
          "value": "LLaMA (30B)",
          "description": "",
          "href": "?group=narrative_qa&subgroup=&runSpecs=%5B%22narrative_qa%3Amodel%3Dmeta_llama-30b%2Cdata_augmentation%3Dcanonical%22%5D",
          "markdown": false
        },
        {
          "value": 0.7524749208145961,
          "description": "min=0.752, mean=0.752, max=0.752, sum=0.752 (1)",
          "style": {},
          "markdown": false
        },
        {
          "description": "min=0.296, mean=0.296, max=0.296, sum=0.296 (1)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.6105202153922532,
          "description": "min=0.611, mean=0.611, max=0.611, sum=0.611 (1)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.6567447414077484,
          "description": "min=0.657, mean=0.657, max=0.657, sum=0.657 (1)",
          "style": {},
          "markdown": false
        },
        {
          "description": "(0)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.4,
          "description": "min=0.4, mean=0.4, max=0.4, sum=0.4 (1)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.6666666666666667,
          "description": "min=0.667, mean=0.667, max=0.667, sum=0.667 (1)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.2142857142857143,
          "description": "min=0.214, mean=0.214, max=0.214, sum=0.214 (1)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.011267605633802818,
          "description": "min=0.011, mean=0.011, max=0.011, sum=0.011 (1)",
          "style": {},
          "markdown": false
        },
        {
          "description": "1 matching runs, but no matching metrics",
          "markdown": false
        },
        {
          "value": 355.0,
          "description": "min=355, mean=355, max=355, sum=355 (1)",
          "style": {},
          "markdown": false
        },
        {
          "value": 1.4366197183098592,
          "description": "min=1.437, mean=1.437, max=1.437, sum=1.437 (1)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.0,
          "description": "min=0, mean=0, max=0, sum=0 (1)",
          "style": {},
          "markdown": false
        },
        {
          "value": 1541.1154929577465,
          "description": "min=1541.115, mean=1541.115, max=1541.115, sum=1541.115 (1)",
          "style": {},
          "markdown": false
        },
        {
          "value": 100.0,
          "description": "min=100, mean=100, max=100, sum=100 (1)",
          "style": {},
          "markdown": false
        },
        {
          "value": 1.0,
          "description": "min=1, mean=1, max=1, sum=1 (1)",
          "style": {},
          "markdown": false
        }
      ],
      [
        {
          "value": "LLaMA (65B)",
          "description": "",
          "href": "?group=narrative_qa&subgroup=&runSpecs=%5B%22narrative_qa%3Amodel%3Dmeta_llama-65b%2Cdata_augmentation%3Dcanonical%22%5D",
          "markdown": false
        },
        {
          "value": 0.7548659428655667,
          "description": "min=0.755, mean=0.755, max=0.755, sum=0.755 (1)",
          "style": {},
          "markdown": false
        },
        {
          "description": "1 matching runs, but no matching metrics",
          "markdown": false
        },
        {
          "value": 0.5674436891870642,
          "description": "min=0.567, mean=0.567, max=0.567, sum=0.567 (1)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.6614214785759094,
          "description": "min=0.661, mean=0.661, max=0.661, sum=0.661 (1)",
          "style": {},
          "markdown": false
        },
        {
          "description": "(0)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.5,
          "description": "min=0.5, mean=0.5, max=0.5, sum=0.5 (1)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.6666666666666667,
          "description": "min=0.667, mean=0.667, max=0.667, sum=0.667 (1)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.1981132075471698,
          "description": "min=0.198, mean=0.198, max=0.198, sum=0.198 (1)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.008450704225352112,
          "description": "min=0.008, mean=0.008, max=0.008, sum=0.008 (1)",
          "style": {},
          "markdown": false
        },
        {
          "description": "1 matching runs, but no matching metrics",
          "markdown": false
        },
        {
          "value": 355.0,
          "description": "min=355, mean=355, max=355, sum=355 (1)",
          "style": {},
          "markdown": false
        },
        {
          "value": 1.4366197183098592,
          "description": "min=1.437, mean=1.437, max=1.437, sum=1.437 (1)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.0,
          "description": "min=0, mean=0, max=0, sum=0 (1)",
          "style": {},
          "markdown": false
        },
        {
          "value": 1541.1154929577465,
          "description": "min=1541.115, mean=1541.115, max=1541.115, sum=1541.115 (1)",
          "style": {},
          "markdown": false
        },
        {
          "value": 1.0,
          "description": "min=1, mean=1, max=1, sum=1 (1)",
          "style": {},
          "markdown": false
        },
        {
          "value": 1.0,
          "description": "min=1, mean=1, max=1, sum=1 (1)",
          "style": {},
          "markdown": false
        }
      ],
      [
        {
          "value": "Llama 2 (7B)",
          "description": "",
          "href": "?group=narrative_qa&subgroup=&runSpecs=%5B%22narrative_qa%3Amodel%3Dmeta_llama-2-7b%2Cdata_augmentation%3Dcanonical%22%5D",
          "markdown": false
        },
        {
          "value": 0.6912328056597693,
          "description": "min=0.691, mean=0.691, max=0.691, sum=0.691 (1)",
          "style": {},
          "markdown": false
        },
        {
          "description": "1 matching runs, but no matching metrics",
          "markdown": false
        },
        {
          "value": 0.5726018964106345,
          "description": "min=0.573, mean=0.573, max=0.573, sum=0.573 (1)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.5960691234215144,
          "description": "min=0.596, mean=0.596, max=0.596, sum=0.596 (1)",
          "style": {},
          "markdown": false
        },
        {
          "description": "(0)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.3333333333333333,
          "description": "min=0.333, mean=0.333, max=0.333, sum=0.333 (1)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.6666666666666667,
          "description": "min=0.667, mean=0.667, max=0.667, sum=0.667 (1)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.20348837209302328,
          "description": "min=0.203, mean=0.203, max=0.203, sum=0.203 (1)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.011267605633802818,
          "description": "min=0.011, mean=0.011, max=0.011, sum=0.011 (1)",
          "style": {},
          "markdown": false
        },
        {
          "description": "1 matching runs, but no matching metrics",
          "markdown": false
        },
        {
          "value": 355.0,
          "description": "min=355, mean=355, max=355, sum=355 (1)",
          "style": {},
          "markdown": false
        },
        {
          "value": 4.414084507042253,
          "description": "min=4.414, mean=4.414, max=4.414, sum=4.414 (1)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.0,
          "description": "min=0, mean=0, max=0, sum=0 (1)",
          "style": {},
          "markdown": false
        },
        {
          "value": 3673.2676056338028,
          "description": "min=3673.268, mean=3673.268, max=3673.268, sum=3673.268 (1)",
          "style": {},
          "markdown": false
        },
        {
          "value": 1.0,
          "description": "min=1, mean=1, max=1, sum=1 (1)",
          "style": {},
          "markdown": false
        },
        {
          "value": 1.0,
          "description": "min=1, mean=1, max=1, sum=1 (1)",
          "style": {},
          "markdown": false
        }
      ],
      [
        {
          "value": "Llama 2 (13B)",
          "description": "",
          "href": "?group=narrative_qa&subgroup=&runSpecs=%5B%22narrative_qa%3Amodel%3Dmeta_llama-2-13b%2Cdata_augmentation%3Dcanonical%22%5D",
          "markdown": false
        },
        {
          "value": 0.7439992251158487,
          "description": "min=0.744, mean=0.744, max=0.744, sum=0.744 (1)",
          "style": {},
          "markdown": false
        },
        {
          "description": "1 matching runs, but no matching metrics",
          "markdown": false
        },
        {
          "value": 0.681791424099214,
          "description": "min=0.682, mean=0.682, max=0.682, sum=0.682 (1)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.6567284210865421,
          "description": "min=0.657, mean=0.657, max=0.657, sum=0.657 (1)",
          "style": {},
          "markdown": false
        },
        {
          "description": "(0)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.4166666666666667,
          "description": "min=0.417, mean=0.417, max=0.417, sum=0.417 (1)",
          "style": {},
          "markdown": false
        },
        {
          "description": "(0)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.21830985915492954,
          "description": "min=0.218, mean=0.218, max=0.218, sum=0.218 (1)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.014084507042253521,
          "description": "min=0.014, mean=0.014, max=0.014, sum=0.014 (1)",
          "style": {},
          "markdown": false
        },
        {
          "description": "1 matching runs, but no matching metrics",
          "markdown": false
        },
        {
          "value": 355.0,
          "description": "min=355, mean=355, max=355, sum=355 (1)",
          "style": {},
          "markdown": false
        },
        {
          "value": 4.414084507042253,
          "description": "min=4.414, mean=4.414, max=4.414, sum=4.414 (1)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.0,
          "description": "min=0, mean=0, max=0, sum=0 (1)",
          "style": {},
          "markdown": false
        },
        {
          "value": 3673.2676056338028,
          "description": "min=3673.268, mean=3673.268, max=3673.268, sum=3673.268 (1)",
          "style": {},
          "markdown": false
        },
        {
          "value": 1.0,
          "description": "min=1, mean=1, max=1, sum=1 (1)",
          "style": {},
          "markdown": false
        },
        {
          "value": 1.0,
          "description": "min=1, mean=1, max=1, sum=1 (1)",
          "style": {},
          "markdown": false
        }
      ],
      [
        {
          "value": "Llama 2 (70B)",
          "description": "",
          "href": "?group=narrative_qa&subgroup=&runSpecs=%5B%22narrative_qa%3Amodel%3Dmeta_llama-2-70b%2Cdata_augmentation%3Dcanonical%22%5D",
          "markdown": false
        },
        {
          "value": 0.7699314267415824,
          "description": "min=0.77, mean=0.77, max=0.77, sum=0.77 (1)",
          "style": {
            "font-weight": "bold"
          },
          "markdown": false
        },
        {
          "description": "1 matching runs, but no matching metrics",
          "markdown": false
        },
        {
          "value": 0.7215317388650366,
          "description": "min=0.722, mean=0.722, max=0.722, sum=0.722 (1)",
          "style": {
            "font-weight": "bold"
          },
          "markdown": false
        },
        {
          "value": 0.709497495841271,
          "description": "min=0.709, mean=0.709, max=0.709, sum=0.709 (1)",
          "style": {
            "font-weight": "bold"
          },
          "markdown": false
        },
        {
          "description": "(0)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.5,
          "description": "min=0.5, mean=0.5, max=0.5, sum=0.5 (1)",
          "style": {},
          "markdown": false
        },
        {
          "description": "(0)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.18695652173913044,
          "description": "min=0.187, mean=0.187, max=0.187, sum=0.187 (1)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.008450704225352112,
          "description": "min=0.008, mean=0.008, max=0.008, sum=0.008 (1)",
          "style": {},
          "markdown": false
        },
        {
          "description": "1 matching runs, but no matching metrics",
          "markdown": false
        },
        {
          "value": 355.0,
          "description": "min=355, mean=355, max=355, sum=355 (1)",
          "style": {},
          "markdown": false
        },
        {
          "value": 4.414084507042253,
          "description": "min=4.414, mean=4.414, max=4.414, sum=4.414 (1)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.0,
          "description": "min=0, mean=0, max=0, sum=0 (1)",
          "style": {},
          "markdown": false
        },
        {
          "value": 3673.2676056338028,
          "description": "min=3673.268, mean=3673.268, max=3673.268, sum=3673.268 (1)",
          "style": {},
          "markdown": false
        },
        {
          "value": 1.0,
          "description": "min=1, mean=1, max=1, sum=1 (1)",
          "style": {},
          "markdown": false
        },
        {
          "value": 1.0,
          "description": "min=1, mean=1, max=1, sum=1 (1)",
          "style": {},
          "markdown": false
        }
      ],
      [
        {
          "value": "Alpaca (7B)",
          "description": "",
          "href": "?group=narrative_qa&subgroup=&runSpecs=%5B%22narrative_qa%3Amodel%3Dstanford_alpaca-7b%2Cdata_augmentation%3Dcanonical%22%5D",
          "markdown": false
        },
        {
          "value": 0.3959807777296956,
          "description": "min=0.396, mean=0.396, max=0.396, sum=0.396 (1)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.045878175333070315,
          "description": "min=0.046, mean=0.046, max=0.046, sum=0.046 (1)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.24590950452109447,
          "description": "min=0.246, mean=0.246, max=0.246, sum=0.246 (1)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.2987402817318288,
          "description": "min=0.299, mean=0.299, max=0.299, sum=0.299 (1)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.6666666666666667,
          "description": "min=0.667, mean=0.667, max=0.667, sum=0.667 (1)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.41025641025641024,
          "description": "min=0.41, mean=0.41, max=0.41, sum=0.41 (1)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.6666666666666667,
          "description": "min=0.667, mean=0.667, max=0.667, sum=0.667 (1)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.19627507163323785,
          "description": "min=0.196, mean=0.196, max=0.196, sum=0.196 (1)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.005633802816901409,
          "description": "min=0.006, mean=0.006, max=0.006, sum=0.006 (1)",
          "style": {},
          "markdown": false
        },
        {
          "description": "1 matching runs, but no matching metrics",
          "markdown": false
        },
        {
          "value": 355.0,
          "description": "min=355, mean=355, max=355, sum=355 (1)",
          "style": {},
          "markdown": false
        },
        {
          "value": 1.4366197183098592,
          "description": "min=1.437, mean=1.437, max=1.437, sum=1.437 (1)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.0,
          "description": "min=0, mean=0, max=0, sum=0 (1)",
          "style": {},
          "markdown": false
        },
        {
          "value": 1541.1154929577465,
          "description": "min=1541.115, mean=1541.115, max=1541.115, sum=1541.115 (1)",
          "style": {},
          "markdown": false
        },
        {
          "value": 26.005633802816902,
          "description": "min=26.006, mean=26.006, max=26.006, sum=26.006 (1)",
          "style": {},
          "markdown": false
        },
        {
          "value": 1.0,
          "description": "min=1, mean=1, max=1, sum=1 (1)",
          "style": {},
          "markdown": false
        }
      ],
      [
        {
          "value": "Vicuna v1.3 (7B)",
          "description": "",
          "href": "?group=narrative_qa&subgroup=&runSpecs=%5B%22narrative_qa%3Amodel%3Dlmsys_vicuna-7b-v1.3%2Cdata_augmentation%3Dcanonical%22%5D",
          "markdown": false
        },
        {
          "value": 0.6431800151411557,
          "description": "min=0.643, mean=0.643, max=0.643, sum=0.643 (1)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.08355639800803456,
          "description": "min=0.084, mean=0.084, max=0.084, sum=0.084 (1)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.499695916561912,
          "description": "min=0.5, mean=0.5, max=0.5, sum=0.5 (1)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.5528194590567359,
          "description": "min=0.553, mean=0.553, max=0.553, sum=0.553 (1)",
          "style": {},
          "markdown": false
        },
        {
          "description": "(0)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.3794642857142857,
          "description": "min=0.379, mean=0.379, max=0.379, sum=0.379 (1)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.37254901960784315,
          "description": "min=0.373, mean=0.373, max=0.373, sum=0.373 (1)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.18604651162790695,
          "description": "min=0.186, mean=0.186, max=0.186, sum=0.186 (1)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.008450704225352112,
          "description": "min=0.008, mean=0.008, max=0.008, sum=0.008 (1)",
          "style": {},
          "markdown": false
        },
        {
          "description": "1 matching runs, but no matching metrics",
          "markdown": false
        },
        {
          "value": 355.0,
          "description": "min=355, mean=355, max=355, sum=355 (1)",
          "style": {},
          "markdown": false
        },
        {
          "value": 1.4366197183098592,
          "description": "min=1.437, mean=1.437, max=1.437, sum=1.437 (1)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.0,
          "description": "min=0, mean=0, max=0, sum=0 (1)",
          "style": {},
          "markdown": false
        },
        {
          "value": 1541.1154929577465,
          "description": "min=1541.115, mean=1541.115, max=1541.115, sum=1541.115 (1)",
          "style": {},
          "markdown": false
        },
        {
          "value": 19.28732394366197,
          "description": "min=19.287, mean=19.287, max=19.287, sum=19.287 (1)",
          "style": {},
          "markdown": false
        },
        {
          "value": 1.0,
          "description": "min=1, mean=1, max=1, sum=1 (1)",
          "style": {},
          "markdown": false
        }
      ],
      [
        {
          "value": "Vicuna v1.3 (13B)",
          "description": "",
          "href": "?group=narrative_qa&subgroup=&runSpecs=%5B%22narrative_qa%3Amodel%3Dlmsys_vicuna-13b-v1.3%2Cdata_augmentation%3Dcanonical%22%5D",
          "markdown": false
        },
        {
          "value": 0.6906914174160148,
          "description": "min=0.691, mean=0.691, max=0.691, sum=0.691 (1)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.25677737638719905,
          "description": "min=0.257, mean=0.257, max=0.257, sum=0.257 (1)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.5253621693457193,
          "description": "min=0.525, mean=0.525, max=0.525, sum=0.525 (1)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.6066076692752655,
          "description": "min=0.607, mean=0.607, max=0.607, sum=0.607 (1)",
          "style": {},
          "markdown": false
        },
        {
          "description": "(0)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.41666666666666663,
          "description": "min=0.417, mean=0.417, max=0.417, sum=0.417 (1)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.6666666666666667,
          "description": "min=0.667, mean=0.667, max=0.667, sum=0.667 (1)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.1806282722513089,
          "description": "min=0.181, mean=0.181, max=0.181, sum=0.181 (1)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.008450704225352112,
          "description": "min=0.008, mean=0.008, max=0.008, sum=0.008 (1)",
          "style": {},
          "markdown": false
        },
        {
          "description": "1 matching runs, but no matching metrics",
          "markdown": false
        },
        {
          "value": 355.0,
          "description": "min=355, mean=355, max=355, sum=355 (1)",
          "style": {},
          "markdown": false
        },
        {
          "value": 1.4366197183098592,
          "description": "min=1.437, mean=1.437, max=1.437, sum=1.437 (1)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.0,
          "description": "min=0, mean=0, max=0, sum=0 (1)",
          "style": {},
          "markdown": false
        },
        {
          "value": 1541.1154929577465,
          "description": "min=1541.115, mean=1541.115, max=1541.115, sum=1541.115 (1)",
          "style": {},
          "markdown": false
        },
        {
          "value": 67.57464788732395,
          "description": "min=67.575, mean=67.575, max=67.575, sum=67.575 (1)",
          "style": {},
          "markdown": false
        },
        {
          "value": 1.0,
          "description": "min=1, mean=1, max=1, sum=1 (1)",
          "style": {},
          "markdown": false
        }
      ],
      [
        {
          "value": "Mistral v0.1 (7B)",
          "description": "",
          "href": "?group=narrative_qa&subgroup=&runSpecs=%5B%22narrative_qa%3Amodel%3Dmistralai_mistral-7b-v0.1%2Cdata_augmentation%3Dcanonical%22%5D",
          "markdown": false
        },
        {
          "value": 0.7164585897241792,
          "description": "min=0.716, mean=0.716, max=0.716, sum=0.716 (1)",
          "style": {},
          "markdown": false
        },
        {
          "description": "1 matching runs, but no matching metrics",
          "markdown": false
        },
        {
          "value": 0.6485445694648198,
          "description": "min=0.649, mean=0.649, max=0.649, sum=0.649 (1)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.6436697691254157,
          "description": "min=0.644, mean=0.644, max=0.644, sum=0.644 (1)",
          "style": {},
          "markdown": false
        },
        {
          "description": "(0)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.5,
          "description": "min=0.5, mean=0.5, max=0.5, sum=0.5 (1)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.6666666666666667,
          "description": "min=0.667, mean=0.667, max=0.667, sum=0.667 (1)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.1730769230769231,
          "description": "min=0.173, mean=0.173, max=0.173, sum=0.173 (1)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.008450704225352112,
          "description": "min=0.008, mean=0.008, max=0.008, sum=0.008 (1)",
          "style": {},
          "markdown": false
        },
        {
          "description": "1 matching runs, but no matching metrics",
          "markdown": false
        },
        {
          "value": 355.0,
          "description": "min=355, mean=355, max=355, sum=355 (1)",
          "style": {},
          "markdown": false
        },
        {
          "value": 4.574647887323944,
          "description": "min=4.575, mean=4.575, max=4.575, sum=4.575 (1)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.0,
          "description": "min=0, mean=0, max=0, sum=0 (1)",
          "style": {},
          "markdown": false
        },
        {
          "value": 3627.7154929577464,
          "description": "min=3627.715, mean=3627.715, max=3627.715, sum=3627.715 (1)",
          "style": {},
          "markdown": false
        },
        {
          "value": 1.0,
          "description": "min=1, mean=1, max=1, sum=1 (1)",
          "style": {},
          "markdown": false
        },
        {
          "value": 1.0,
          "description": "min=1, mean=1, max=1, sum=1 (1)",
          "style": {},
          "markdown": false
        }
      ],
      [
        {
          "value": "TNLG v2 (530B)",
          "description": "",
          "href": "?group=narrative_qa&subgroup=&runSpecs=%5B%22narrative_qa%3Amodel%3Dmicrosoft_TNLGv2_530B%2Cdata_augmentation%3Dcanonical%22%5D",
          "markdown": false
        },
        {
          "value": 0.7219452089083314,
          "description": "min=0.692, mean=0.722, max=0.743, sum=2.166 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.05012197972633472,
          "description": "min=0.026, mean=0.05, max=0.075, sum=0.15 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.31894751591392195,
          "description": "min=0.22, mean=0.319, max=0.405, sum=0.957 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.6318169391667601,
          "description": "min=0.601, mean=0.632, max=0.664, sum=1.895 (3)",
          "style": {},
          "markdown": false
        },
        {
          "description": "(0)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.3952991452991453,
          "description": "min=0.375, mean=0.395, max=0.436, sum=1.186 (3)",
          "style": {},
          "markdown": false
        },
        {
          "description": "(0)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.22112892189926373,
          "description": "min=0.204, mean=0.221, max=0.239, sum=0.663 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.012206572769953052,
          "description": "min=0.011, mean=0.012, max=0.014, sum=0.037 (3)",
          "style": {},
          "markdown": false
        },
        {
          "description": "1 matching runs, but no matching metrics",
          "markdown": false
        },
        {
          "value": 355.0,
          "description": "min=355, mean=355, max=355, sum=1065 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 1.6460093896713615,
          "description": "min=1.051, mean=1.646, max=2.085, sum=4.938 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.0,
          "description": "min=0, mean=0, max=0, sum=0 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 1651.8478873239437,
          "description": "min=1600.366, mean=1651.848, max=1705.003, sum=4955.544 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 5.982159624413145,
          "description": "min=5.113, mean=5.982, max=7.265, sum=17.946 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 3.0,
          "description": "min=3, mean=3, max=3, sum=9 (3)",
          "style": {},
          "markdown": false
        }
      ],
      [
        {
          "value": "TNLG v2 (6.7B)",
          "description": "",
          "href": "?group=narrative_qa&subgroup=&runSpecs=%5B%22narrative_qa%3Amodel%3Dmicrosoft_TNLGv2_7B%2Cdata_augmentation%3Dcanonical%22%5D",
          "markdown": false
        },
        {
          "value": 0.6309132248806418,
          "description": "min=0.612, mean=0.631, max=0.644, sum=1.893 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.0461090042242735,
          "description": "min=0.045, mean=0.046, max=0.047, sum=0.138 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.35196743378602896,
          "description": "min=0.314, mean=0.352, max=0.375, sum=1.056 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.5173113464127798,
          "description": "min=0.492, mean=0.517, max=0.532, sum=1.552 (3)",
          "style": {},
          "markdown": false
        },
        {
          "description": "(0)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.47625,
          "description": "min=0.46, mean=0.476, max=0.5, sum=1.429 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.6666666666666666,
          "description": "min=0.667, mean=0.667, max=0.667, sum=2 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.21227319042207152,
          "description": "min=0.203, mean=0.212, max=0.221, sum=0.637 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.011267605633802816,
          "description": "min=0.008, mean=0.011, max=0.014, sum=0.034 (3)",
          "style": {},
          "markdown": false
        },
        {
          "description": "1 matching runs, but no matching metrics",
          "markdown": false
        },
        {
          "value": 355.0,
          "description": "min=355, mean=355, max=355, sum=1065 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 1.6460093896713615,
          "description": "min=1.051, mean=1.646, max=2.085, sum=4.938 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.0,
          "description": "min=0, mean=0, max=0, sum=0 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 1651.8478873239437,
          "description": "min=1600.366, mean=1651.848, max=1705.003, sum=4955.544 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 6.498591549295774,
          "description": "min=5.189, mean=6.499, max=7.989, sum=19.496 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 3.0,
          "description": "min=3, mean=3, max=3, sum=9 (3)",
          "style": {},
          "markdown": false
        }
      ],
      [
        {
          "value": "davinci (175B)",
          "description": "",
          "href": "?group=narrative_qa&subgroup=&runSpecs=%5B%22narrative_qa%3Amodel%3Dopenai_davinci%2Cdata_augmentation%3Dcanonical%22%5D",
          "markdown": false
        },
        {
          "value": 0.6868798106625772,
          "description": "min=0.664, mean=0.687, max=0.706, sum=2.061 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.06738212205854943,
          "description": "min=0.041, mean=0.067, max=0.109, sum=0.202 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.4976057829109271,
          "description": "min=0.476, mean=0.498, max=0.52, sum=1.493 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.5970096000459133,
          "description": "min=0.556, mean=0.597, max=0.634, sum=1.791 (3)",
          "style": {},
          "markdown": false
        },
        {
          "description": "(0)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.44285714285714284,
          "description": "min=0.4, mean=0.443, max=0.5, sum=1.329 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.6666666666666667,
          "description": "min=0.667, mean=0.667, max=0.667, sum=1.333 (2)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.2075773756101625,
          "description": "min=0.199, mean=0.208, max=0.221, sum=0.623 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.012206572769953052,
          "description": "min=0.008, mean=0.012, max=0.014, sum=0.037 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.3694498019366194,
          "description": "min=0.36, mean=0.369, max=0.384, sum=1.108 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 355.0,
          "description": "min=355, mean=355, max=355, sum=1065 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 1.6469483568075116,
          "description": "min=1.051, mean=1.647, max=2.085, sum=4.941 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.0,
          "description": "min=0, mean=0, max=0, sum=0 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 1652.3774647887324,
          "description": "min=1601.955, mean=1652.377, max=1705.003, sum=4957.132 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 5.708920187793427,
          "description": "min=5.338, mean=5.709, max=6.197, sum=17.127 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 3.0,
          "description": "min=3, mean=3, max=3, sum=9 (3)",
          "style": {},
          "markdown": false
        }
      ],
      [
        {
          "value": "curie (6.7B)",
          "description": "",
          "href": "?group=narrative_qa&subgroup=&runSpecs=%5B%22narrative_qa%3Amodel%3Dopenai_curie%2Cdata_augmentation%3Dcanonical%22%5D",
          "markdown": false
        },
        {
          "value": 0.6044087313123448,
          "description": "min=0.588, mean=0.604, max=0.632, sum=1.813 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.044936394093581626,
          "description": "min=0.031, mean=0.045, max=0.056, sum=0.135 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.36665112128820915,
          "description": "min=0.352, mean=0.367, max=0.39, sum=1.1 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.48150959406800437,
          "description": "min=0.453, mean=0.482, max=0.515, sum=1.445 (3)",
          "style": {},
          "markdown": false
        },
        {
          "description": "(0)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.45462962962962966,
          "description": "min=0.431, mean=0.455, max=0.5, sum=1.364 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.6666666666666667,
          "description": "min=0.667, mean=0.667, max=0.667, sum=1.333 (2)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.2292955082742317,
          "description": "min=0.209, mean=0.229, max=0.267, sum=0.688 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.016901408450704224,
          "description": "min=0.017, mean=0.017, max=0.017, sum=0.051 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.15159477332746474,
          "description": "min=0.14, mean=0.152, max=0.166, sum=0.455 (3)",
          "style": {
            "font-weight": "bold"
          },
          "markdown": false
        },
        {
          "value": 355.0,
          "description": "min=355, mean=355, max=355, sum=1065 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 1.6469483568075116,
          "description": "min=1.051, mean=1.647, max=2.085, sum=4.941 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.0,
          "description": "min=0, mean=0, max=0, sum=0 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 1652.3774647887324,
          "description": "min=1601.955, mean=1652.377, max=1705.003, sum=4957.132 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 6.606572769953051,
          "description": "min=4.775, mean=6.607, max=8.732, sum=19.82 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 3.0,
          "description": "min=3, mean=3, max=3, sum=9 (3)",
          "style": {},
          "markdown": false
        }
      ],
      [
        {
          "value": "babbage (1.3B)",
          "description": "",
          "href": "?group=narrative_qa&subgroup=&runSpecs=%5B%22narrative_qa%3Amodel%3Dopenai_babbage%2Cdata_augmentation%3Dcanonical%22%5D",
          "markdown": false
        },
        {
          "value": 0.4913412520282267,
          "description": "min=0.468, mean=0.491, max=0.525, sum=1.474 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.027162479976532598,
          "description": "min=0.025, mean=0.027, max=0.03, sum=0.081 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.2547490737014401,
          "description": "min=0.232, mean=0.255, max=0.266, sum=0.764 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.3669650821225828,
          "description": "min=0.334, mean=0.367, max=0.396, sum=1.101 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.6666666666666667,
          "description": "min=0.667, mean=0.667, max=0.667, sum=0.667 (1)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.44511511879932936,
          "description": "min=0.404, mean=0.445, max=0.5, sum=1.335 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.6666666666666667,
          "description": "min=0.667, mean=0.667, max=0.667, sum=1.333 (2)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.1912053369170701,
          "description": "min=0.142, mean=0.191, max=0.246, sum=0.574 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.01596244131455399,
          "description": "min=0.011, mean=0.016, max=0.023, sum=0.048 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.1762964825410799,
          "description": "min=0.164, mean=0.176, max=0.194, sum=0.529 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 355.0,
          "description": "min=355, mean=355, max=355, sum=1065 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 1.6469483568075116,
          "description": "min=1.051, mean=1.647, max=2.085, sum=4.941 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.0,
          "description": "min=0, mean=0, max=0, sum=0 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 1652.3774647887324,
          "description": "min=1601.955, mean=1652.377, max=1705.003, sum=4957.132 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 8.83474178403756,
          "description": "min=6.659, mean=8.835, max=11.769, sum=26.504 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 3.0,
          "description": "min=3, mean=3, max=3, sum=9 (3)",
          "style": {},
          "markdown": false
        }
      ],
      [
        {
          "value": "ada (350M)",
          "description": "",
          "href": "?group=narrative_qa&subgroup=&runSpecs=%5B%22narrative_qa%3Amodel%3Dopenai_ada%2Cdata_augmentation%3Dcanonical%22%5D",
          "markdown": false
        },
        {
          "value": 0.32610438211460974,
          "description": "min=0.311, mean=0.326, max=0.35, sum=0.978 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.04605131521940172,
          "description": "min=0.034, mean=0.046, max=0.064, sum=0.138 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.10413260236022294,
          "description": "min=0.094, mean=0.104, max=0.11, sum=0.312 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.20535614023925777,
          "description": "min=0.191, mean=0.205, max=0.221, sum=0.616 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.6666666666666667,
          "description": "min=0.667, mean=0.667, max=0.667, sum=1.333 (2)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.44422611988401467,
          "description": "min=0.415, mean=0.444, max=0.464, sum=1.333 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.6666666666666667,
          "description": "min=0.667, mean=0.667, max=0.667, sum=1.333 (2)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.13244266197852694,
          "description": "min=0.074, mean=0.132, max=0.198, sum=0.397 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.030046948356807508,
          "description": "min=0.025, mean=0.03, max=0.037, sum=0.09 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.21074192341549294,
          "description": "min=0.203, mean=0.211, max=0.224, sum=0.632 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 355.0,
          "description": "min=355, mean=355, max=355, sum=1065 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 1.6469483568075116,
          "description": "min=1.051, mean=1.647, max=2.085, sum=4.941 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.0,
          "description": "min=0, mean=0, max=0, sum=0 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 1652.3774647887324,
          "description": "min=1601.955, mean=1652.377, max=1705.003, sum=4957.132 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 12.381220657276996,
          "description": "min=11.13, mean=12.381, max=14.623, sum=37.144 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 3.0,
          "description": "min=3, mean=3, max=3, sum=9 (3)",
          "style": {},
          "markdown": false
        }
      ],
      [
        {
          "value": "text-davinci-003",
          "description": "",
          "href": "?group=narrative_qa&subgroup=&runSpecs=%5B%22narrative_qa%3Amodel%3Dopenai_text-davinci-003%2Cdata_augmentation%3Dcanonical%22%5D",
          "markdown": false
        },
        {
          "value": 0.7270632910132128,
          "description": "min=0.703, mean=0.727, max=0.747, sum=2.181 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.3702182824812234,
          "description": "min=0.346, mean=0.37, max=0.389, sum=1.111 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.6939161040603179,
          "description": "min=0.673, mean=0.694, max=0.713, sum=2.082 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.6644210581739292,
          "description": "min=0.643, mean=0.664, max=0.682, sum=1.993 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.6666666666666667,
          "description": "min=0.667, mean=0.667, max=0.667, sum=0.667 (1)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.44232989232989234,
          "description": "min=0.424, mean=0.442, max=0.464, sum=1.327 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.6666666666666666,
          "description": "min=0.667, mean=0.667, max=0.667, sum=2 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.17722658310007708,
          "description": "min=0.169, mean=0.177, max=0.187, sum=0.532 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.013145539906103287,
          "description": "min=0.011, mean=0.013, max=0.014, sum=0.039 (3)",
          "style": {},
          "markdown": false
        },
        {
          "description": "1 matching runs, but no matching metrics",
          "markdown": false
        },
        {
          "value": 355.0,
          "description": "min=355, mean=355, max=355, sum=1065 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 4.532394366197183,
          "description": "min=4.259, mean=4.532, max=4.955, sum=13.597 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.0,
          "description": "min=0, mean=0, max=0, sum=0 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 3579.092957746479,
          "description": "min=3479.563, mean=3579.093, max=3633.659, sum=10737.279 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 9.16431924882629,
          "description": "min=8.231, mean=9.164, max=9.732, sum=27.493 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 3.0,
          "description": "min=3, mean=3, max=3, sum=9 (3)",
          "style": {},
          "markdown": false
        }
      ],
      [
        {
          "value": "text-davinci-002",
          "description": "",
          "href": "?group=narrative_qa&subgroup=&runSpecs=%5B%22narrative_qa%3Amodel%3Dopenai_text-davinci-002%2Cdata_augmentation%3Dcanonical%22%5D",
          "markdown": false
        },
        {
          "value": 0.7271738722981128,
          "description": "min=0.711, mean=0.727, max=0.752, sum=2.182 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.2393596998509794,
          "description": "min=0.214, mean=0.239, max=0.268, sum=0.718 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.6382180079306305,
          "description": "min=0.61, mean=0.638, max=0.663, sum=1.915 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.6459531095726224,
          "description": "min=0.637, mean=0.646, max=0.664, sum=1.938 (3)",
          "style": {},
          "markdown": false
        },
        {
          "description": "(0)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.39479717813051146,
          "description": "min=0.363, mean=0.395, max=0.417, sum=1.184 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.6666666666666667,
          "description": "min=0.667, mean=0.667, max=0.667, sum=0.667 (1)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.18948121770702417,
          "description": "min=0.17, mean=0.189, max=0.21, sum=0.568 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.013145539906103286,
          "description": "min=0.008, mean=0.013, max=0.017, sum=0.039 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.5124278205692486,
          "description": "min=0.48, mean=0.512, max=0.539, sum=1.537 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 355.0,
          "description": "min=355, mean=355, max=355, sum=1065 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 4.532394366197183,
          "description": "min=4.259, mean=4.532, max=4.955, sum=13.597 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.0,
          "description": "min=0, mean=0, max=0, sum=0 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 3579.092957746479,
          "description": "min=3479.563, mean=3579.093, max=3633.659, sum=10737.279 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 7.378403755868544,
          "description": "min=6.158, mean=7.378, max=8.448, sum=22.135 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 3.0,
          "description": "min=3, mean=3, max=3, sum=9 (3)",
          "style": {},
          "markdown": false
        }
      ],
      [
        {
          "value": "text-curie-001",
          "description": "",
          "href": "?group=narrative_qa&subgroup=&runSpecs=%5B%22narrative_qa%3Amodel%3Dopenai_text-curie-001%2Cdata_augmentation%3Dcanonical%22%5D",
          "markdown": false
        },
        {
          "value": 0.5819233043307469,
          "description": "min=0.55, mean=0.582, max=0.63, sum=1.746 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.22125645338584943,
          "description": "min=0.198, mean=0.221, max=0.233, sum=0.664 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.33989457936851464,
          "description": "min=0.299, mean=0.34, max=0.38, sum=1.02 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.4630759323159577,
          "description": "min=0.428, mean=0.463, max=0.5, sum=1.389 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.6666666666666667,
          "description": "min=0.667, mean=0.667, max=0.667, sum=1.333 (2)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.44628176056747487,
          "description": "min=0.436, mean=0.446, max=0.453, sum=1.339 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.6091954022988506,
          "description": "min=0.494, mean=0.609, max=0.667, sum=1.828 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.1896444305777106,
          "description": "min=0.161, mean=0.19, max=0.207, sum=0.569 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.015023474178403754,
          "description": "min=0.014, mean=0.015, max=0.017, sum=0.045 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.20493085387323948,
          "description": "min=0.19, mean=0.205, max=0.217, sum=0.615 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 355.0,
          "description": "min=355, mean=355, max=355, sum=1065 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 1.6469483568075116,
          "description": "min=1.051, mean=1.647, max=2.085, sum=4.941 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.0,
          "description": "min=0, mean=0, max=0, sum=0 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 1652.3774647887324,
          "description": "min=1601.955, mean=1652.377, max=1705.003, sum=4957.132 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 8.970892018779344,
          "description": "min=6.645, mean=8.971, max=10.738, sum=26.913 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 3.0,
          "description": "min=3, mean=3, max=3, sum=9 (3)",
          "style": {},
          "markdown": false
        }
      ],
      [
        {
          "value": "text-babbage-001",
          "description": "",
          "href": "?group=narrative_qa&subgroup=&runSpecs=%5B%22narrative_qa%3Amodel%3Dopenai_text-babbage-001%2Cdata_augmentation%3Dcanonical%22%5D",
          "markdown": false
        },
        {
          "value": 0.42935871198092457,
          "description": "min=0.412, mean=0.429, max=0.463, sum=1.288 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.18581698260430923,
          "description": "min=0.158, mean=0.186, max=0.215, sum=0.557 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.12577588570182116,
          "description": "min=0.101, mean=0.126, max=0.154, sum=0.377 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.29864937428822036,
          "description": "min=0.277, mean=0.299, max=0.335, sum=0.896 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.6666666666666667,
          "description": "min=0.667, mean=0.667, max=0.667, sum=0.667 (1)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.40286362942612947,
          "description": "min=0.382, mean=0.403, max=0.433, sum=1.209 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.6666666666666666,
          "description": "min=0.667, mean=0.667, max=0.667, sum=2 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.13153743304740043,
          "description": "min=0.089, mean=0.132, max=0.178, sum=0.395 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.009389671361502348,
          "description": "min=0.003, mean=0.009, max=0.02, sum=0.028 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.24279079738849765,
          "description": "min=0.239, mean=0.243, max=0.246, sum=0.728 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 355.0,
          "description": "min=355, mean=355, max=355, sum=1065 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 1.6469483568075116,
          "description": "min=1.051, mean=1.647, max=2.085, sum=4.941 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.0,
          "description": "min=0, mean=0, max=0, sum=0 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 1652.3774647887324,
          "description": "min=1601.955, mean=1652.377, max=1705.003, sum=4957.132 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 12.829107981220657,
          "description": "min=12.048, mean=12.829, max=13.307, sum=38.487 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 3.0,
          "description": "min=3, mean=3, max=3, sum=9 (3)",
          "style": {},
          "markdown": false
        }
      ],
      [
        {
          "value": "text-ada-001",
          "description": "",
          "href": "?group=narrative_qa&subgroup=&runSpecs=%5B%22narrative_qa%3Amodel%3Dopenai_text-ada-001%2Cdata_augmentation%3Dcanonical%22%5D",
          "markdown": false
        },
        {
          "value": 0.23810811048034744,
          "description": "min=0.22, mean=0.238, max=0.273, sum=0.714 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.318718698868713,
          "description": "min=0.248, mean=0.319, max=0.386, sum=0.956 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.05828828370185365,
          "description": "min=0.049, mean=0.058, max=0.075, sum=0.175 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.1187630501762329,
          "description": "min=0.11, mean=0.119, max=0.126, sum=0.356 (3)",
          "style": {},
          "markdown": false
        },
        {
          "description": "(0)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.40317130936696155,
          "description": "min=0.382, mean=0.403, max=0.438, sum=1.21 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.6666666666666666,
          "description": "min=0.667, mean=0.667, max=0.667, sum=2 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.20287726757892108,
          "description": "min=0.151, mean=0.203, max=0.252, sum=0.609 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.005633802816901408,
          "description": "min=0.003, mean=0.006, max=0.008, sum=0.017 (3)",
          "style": {
            "font-weight": "bold"
          },
          "markdown": false
        },
        {
          "value": 0.1710890294894365,
          "description": "min=0.16, mean=0.171, max=0.186, sum=0.513 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 355.0,
          "description": "min=355, mean=355, max=355, sum=1065 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 1.6469483568075116,
          "description": "min=1.051, mean=1.647, max=2.085, sum=4.941 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.0,
          "description": "min=0, mean=0, max=0, sum=0 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 1652.3774647887324,
          "description": "min=1601.955, mean=1652.377, max=1705.003, sum=4957.132 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 10.755868544600938,
          "description": "min=9.054, mean=10.756, max=13.293, sum=32.268 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 3.0,
          "description": "min=3, mean=3, max=3, sum=9 (3)",
          "style": {},
          "markdown": false
        }
      ],
      [
        {
          "value": "gpt-3.5-turbo-0301",
          "description": "",
          "href": "?group=narrative_qa&subgroup=&runSpecs=%5B%22narrative_qa%3Amodel%3Dopenai_gpt-3.5-turbo-0301%2Cdata_augmentation%3Dcanonical%22%5D",
          "markdown": false
        },
        {
          "value": 0.6630439822107776,
          "description": "min=0.663, mean=0.663, max=0.663, sum=0.663 (1)",
          "style": {},
          "markdown": false
        },
        {
          "description": "1 matching runs, but no matching metrics",
          "markdown": false
        },
        {
          "value": 0.6017866194784781,
          "description": "min=0.602, mean=0.602, max=0.602, sum=0.602 (1)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.5846601621436455,
          "description": "min=0.585, mean=0.585, max=0.585, sum=0.585 (1)",
          "style": {},
          "markdown": false
        },
        {
          "description": "(0)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.4789473684210526,
          "description": "min=0.479, mean=0.479, max=0.479, sum=0.479 (1)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.33333333333333337,
          "description": "min=0.333, mean=0.333, max=0.333, sum=0.333 (1)",
          "style": {
            "font-weight": "bold"
          },
          "markdown": false
        },
        {
          "value": 0.21590909090909088,
          "description": "min=0.216, mean=0.216, max=0.216, sum=0.216 (1)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.011267605633802818,
          "description": "min=0.011, mean=0.011, max=0.011, sum=0.011 (1)",
          "style": {},
          "markdown": false
        },
        {
          "description": "1 matching runs, but no matching metrics",
          "markdown": false
        },
        {
          "value": 355.0,
          "description": "min=355, mean=355, max=355, sum=355 (1)",
          "style": {},
          "markdown": false
        },
        {
          "value": 4.966197183098592,
          "description": "min=4.966, mean=4.966, max=4.966, sum=4.966 (1)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.0,
          "description": "min=0, mean=0, max=0, sum=0 (1)",
          "style": {},
          "markdown": false
        },
        {
          "value": 3443.349295774648,
          "description": "min=3443.349, mean=3443.349, max=3443.349, sum=3443.349 (1)",
          "style": {},
          "markdown": false
        },
        {
          "value": 11.185915492957747,
          "description": "min=11.186, mean=11.186, max=11.186, sum=11.186 (1)",
          "style": {},
          "markdown": false
        },
        {
          "value": 1.0,
          "description": "min=1, mean=1, max=1, sum=1 (1)",
          "style": {},
          "markdown": false
        }
      ],
      [
        {
          "value": "gpt-3.5-turbo-0613",
          "description": "",
          "href": "?group=narrative_qa&subgroup=&runSpecs=%5B%22narrative_qa%3Amodel%3Dopenai_gpt-3.5-turbo-0613%2Cdata_augmentation%3Dcanonical%22%5D",
          "markdown": false
        },
        {
          "value": 0.625078363047123,
          "description": "min=0.625, mean=0.625, max=0.625, sum=0.625 (1)",
          "style": {},
          "markdown": false
        },
        {
          "description": "1 matching runs, but no matching metrics",
          "markdown": false
        },
        {
          "value": 0.5658549915417233,
          "description": "min=0.566, mean=0.566, max=0.566, sum=0.566 (1)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.546599991762967,
          "description": "min=0.547, mean=0.547, max=0.547, sum=0.547 (1)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.6666666666666667,
          "description": "min=0.667, mean=0.667, max=0.667, sum=0.667 (1)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.45454545454545453,
          "description": "min=0.455, mean=0.455, max=0.455, sum=0.455 (1)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.42857142857142855,
          "description": "min=0.429, mean=0.429, max=0.429, sum=0.429 (1)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.16860465116279072,
          "description": "min=0.169, mean=0.169, max=0.169, sum=0.169 (1)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.011267605633802818,
          "description": "min=0.011, mean=0.011, max=0.011, sum=0.011 (1)",
          "style": {},
          "markdown": false
        },
        {
          "description": "1 matching runs, but no matching metrics",
          "markdown": false
        },
        {
          "value": 355.0,
          "description": "min=355, mean=355, max=355, sum=355 (1)",
          "style": {},
          "markdown": false
        },
        {
          "value": 4.966197183098592,
          "description": "min=4.966, mean=4.966, max=4.966, sum=4.966 (1)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.0,
          "description": "min=0, mean=0, max=0, sum=0 (1)",
          "style": {},
          "markdown": false
        },
        {
          "value": 3443.349295774648,
          "description": "min=3443.349, mean=3443.349, max=3443.349, sum=3443.349 (1)",
          "style": {},
          "markdown": false
        },
        {
          "value": 12.194366197183099,
          "description": "min=12.194, mean=12.194, max=12.194, sum=12.194 (1)",
          "style": {},
          "markdown": false
        },
        {
          "value": 1.0,
          "description": "min=1, mean=1, max=1, sum=1 (1)",
          "style": {},
          "markdown": false
        }
      ],
      [
        {
          "value": "RedPajama-INCITE-Base-v1 (3B)",
          "description": "",
          "href": "?group=narrative_qa&subgroup=&runSpecs=%5B%22narrative_qa%3Amodel%3Dtogether_redpajama-incite-base-3b-v1%2Cdata_augmentation%3Dcanonical%22%5D",
          "markdown": false
        },
        {
          "value": 0.5551120381419948,
          "description": "min=0.555, mean=0.555, max=0.555, sum=0.555 (1)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.2338003327407993,
          "description": "min=0.234, mean=0.234, max=0.234, sum=0.234 (1)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.3460535146763825,
          "description": "min=0.346, mean=0.346, max=0.346, sum=0.346 (1)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.42019517663794076,
          "description": "min=0.42, mean=0.42, max=0.42, sum=0.42 (1)",
          "style": {},
          "markdown": false
        },
        {
          "description": "(0)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.4629629629629629,
          "description": "min=0.463, mean=0.463, max=0.463, sum=0.463 (1)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.6666666666666667,
          "description": "min=0.667, mean=0.667, max=0.667, sum=0.667 (1)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.16666666666666666,
          "description": "min=0.167, mean=0.167, max=0.167, sum=0.167 (1)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.008450704225352112,
          "description": "min=0.008, mean=0.008, max=0.008, sum=0.008 (1)",
          "style": {},
          "markdown": false
        },
        {
          "description": "1 matching runs, but no matching metrics",
          "markdown": false
        },
        {
          "value": 355.0,
          "description": "min=355, mean=355, max=355, sum=355 (1)",
          "style": {},
          "markdown": false
        },
        {
          "value": 1.9690140845070423,
          "description": "min=1.969, mean=1.969, max=1.969, sum=1.969 (1)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.0,
          "description": "min=0, mean=0, max=0, sum=0 (1)",
          "style": {},
          "markdown": false
        },
        {
          "value": 1691.081690140845,
          "description": "min=1691.082, mean=1691.082, max=1691.082, sum=1691.082 (1)",
          "style": {},
          "markdown": false
        },
        {
          "value": 100.0,
          "description": "min=100, mean=100, max=100, sum=100 (1)",
          "style": {},
          "markdown": false
        },
        {
          "value": 1.0,
          "description": "min=1, mean=1, max=1, sum=1 (1)",
          "style": {},
          "markdown": false
        }
      ],
      [
        {
          "value": "RedPajama-INCITE-Instruct-v1 (3B)",
          "description": "",
          "href": "?group=narrative_qa&subgroup=&runSpecs=%5B%22narrative_qa%3Amodel%3Dtogether_redpajama-incite-instruct-3b-v1%2Cdata_augmentation%3Dcanonical%22%5D",
          "markdown": false
        },
        {
          "value": 0.6375767780843438,
          "description": "min=0.638, mean=0.638, max=0.638, sum=0.638 (1)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.25351615672342864,
          "description": "min=0.254, mean=0.254, max=0.254, sum=0.254 (1)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.4034697604028265,
          "description": "min=0.403, mean=0.403, max=0.403, sum=0.403 (1)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.5060331991298288,
          "description": "min=0.506, mean=0.506, max=0.506, sum=0.506 (1)",
          "style": {},
          "markdown": false
        },
        {
          "description": "(0)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.5,
          "description": "min=0.5, mean=0.5, max=0.5, sum=0.5 (1)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.6666666666666667,
          "description": "min=0.667, mean=0.667, max=0.667, sum=0.667 (1)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.18354430379746836,
          "description": "min=0.184, mean=0.184, max=0.184, sum=0.184 (1)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.014084507042253521,
          "description": "min=0.014, mean=0.014, max=0.014, sum=0.014 (1)",
          "style": {},
          "markdown": false
        },
        {
          "description": "1 matching runs, but no matching metrics",
          "markdown": false
        },
        {
          "value": 355.0,
          "description": "min=355, mean=355, max=355, sum=355 (1)",
          "style": {},
          "markdown": false
        },
        {
          "value": 1.9690140845070423,
          "description": "min=1.969, mean=1.969, max=1.969, sum=1.969 (1)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.0,
          "description": "min=0, mean=0, max=0, sum=0 (1)",
          "style": {},
          "markdown": false
        },
        {
          "value": 1691.081690140845,
          "description": "min=1691.082, mean=1691.082, max=1691.082, sum=1691.082 (1)",
          "style": {},
          "markdown": false
        },
        {
          "value": 100.0,
          "description": "min=100, mean=100, max=100, sum=100 (1)",
          "style": {},
          "markdown": false
        },
        {
          "value": 1.0,
          "description": "min=1, mean=1, max=1, sum=1 (1)",
          "style": {},
          "markdown": false
        }
      ],
      [
        {
          "value": "RedPajama-INCITE-Base (7B)",
          "description": "",
          "href": "?group=narrative_qa&subgroup=&runSpecs=%5B%22narrative_qa%3Amodel%3Dtogether_redpajama-incite-base-7b%2Cdata_augmentation%3Dcanonical%22%5D",
          "markdown": false
        },
        {
          "value": 0.6173357069497865,
          "description": "min=0.617, mean=0.617, max=0.617, sum=0.617 (1)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.27605359630786236,
          "description": "min=0.276, mean=0.276, max=0.276, sum=0.276 (1)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.4240469400392869,
          "description": "min=0.424, mean=0.424, max=0.424, sum=0.424 (1)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.5239003837979788,
          "description": "min=0.524, mean=0.524, max=0.524, sum=0.524 (1)",
          "style": {},
          "markdown": false
        },
        {
          "description": "(0)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.4375,
          "description": "min=0.438, mean=0.438, max=0.438, sum=0.438 (1)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.6666666666666667,
          "description": "min=0.667, mean=0.667, max=0.667, sum=0.667 (1)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.17123287671232879,
          "description": "min=0.171, mean=0.171, max=0.171, sum=0.171 (1)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.014084507042253521,
          "description": "min=0.014, mean=0.014, max=0.014, sum=0.014 (1)",
          "style": {},
          "markdown": false
        },
        {
          "description": "1 matching runs, but no matching metrics",
          "markdown": false
        },
        {
          "value": 355.0,
          "description": "min=355, mean=355, max=355, sum=355 (1)",
          "style": {},
          "markdown": false
        },
        {
          "value": 1.9690140845070423,
          "description": "min=1.969, mean=1.969, max=1.969, sum=1.969 (1)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.0,
          "description": "min=0, mean=0, max=0, sum=0 (1)",
          "style": {},
          "markdown": false
        },
        {
          "value": 1691.081690140845,
          "description": "min=1691.082, mean=1691.082, max=1691.082, sum=1691.082 (1)",
          "style": {},
          "markdown": false
        },
        {
          "value": 100.0,
          "description": "min=100, mean=100, max=100, sum=100 (1)",
          "style": {},
          "markdown": false
        },
        {
          "value": 1.0,
          "description": "min=1, mean=1, max=1, sum=1 (1)",
          "style": {},
          "markdown": false
        }
      ],
      [
        {
          "value": "RedPajama-INCITE-Instruct (7B)",
          "description": "",
          "href": "?group=narrative_qa&subgroup=&runSpecs=%5B%22narrative_qa%3Amodel%3Dtogether_redpajama-incite-instruct-7b%2Cdata_augmentation%3Dcanonical%22%5D",
          "markdown": false
        },
        {
          "value": 0.6376816720476394,
          "description": "min=0.638, mean=0.638, max=0.638, sum=0.638 (1)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.24703559378209236,
          "description": "min=0.247, mean=0.247, max=0.247, sum=0.247 (1)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.4816661888359549,
          "description": "min=0.482, mean=0.482, max=0.482, sum=0.482 (1)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.5062845788047843,
          "description": "min=0.506, mean=0.506, max=0.506, sum=0.506 (1)",
          "style": {},
          "markdown": false
        },
        {
          "description": "(0)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.5,
          "description": "min=0.5, mean=0.5, max=0.5, sum=0.5 (1)",
          "style": {},
          "markdown": false
        },
        {
          "description": "(0)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.19318181818181815,
          "description": "min=0.193, mean=0.193, max=0.193, sum=0.193 (1)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.02535211267605634,
          "description": "min=0.025, mean=0.025, max=0.025, sum=0.025 (1)",
          "style": {},
          "markdown": false
        },
        {
          "description": "1 matching runs, but no matching metrics",
          "markdown": false
        },
        {
          "value": 355.0,
          "description": "min=355, mean=355, max=355, sum=355 (1)",
          "style": {},
          "markdown": false
        },
        {
          "value": 1.9690140845070423,
          "description": "min=1.969, mean=1.969, max=1.969, sum=1.969 (1)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.0,
          "description": "min=0, mean=0, max=0, sum=0 (1)",
          "style": {},
          "markdown": false
        },
        {
          "value": 1691.081690140845,
          "description": "min=1691.082, mean=1691.082, max=1691.082, sum=1691.082 (1)",
          "style": {},
          "markdown": false
        },
        {
          "value": 100.0,
          "description": "min=100, mean=100, max=100, sum=100 (1)",
          "style": {},
          "markdown": false
        },
        {
          "value": 1.0,
          "description": "min=1, mean=1, max=1, sum=1 (1)",
          "style": {},
          "markdown": false
        }
      ],
      [
        {
          "value": "MPT (30B)",
          "description": "",
          "href": "?group=narrative_qa&subgroup=&runSpecs=%5B%22narrative_qa%3Amodel%3Dmosaicml_mpt-30b%2Cdata_augmentation%3Dcanonical%22%5D",
          "markdown": false
        },
        {
          "value": 0.7315258420006264,
          "description": "min=0.732, mean=0.732, max=0.732, sum=0.732 (1)",
          "style": {},
          "markdown": false
        },
        {
          "description": "1 matching runs, but no matching metrics",
          "markdown": false
        },
        {
          "value": 0.5840358182644836,
          "description": "min=0.584, mean=0.584, max=0.584, sum=0.584 (1)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.6525810359656932,
          "description": "min=0.653, mean=0.653, max=0.653, sum=0.653 (1)",
          "style": {},
          "markdown": false
        },
        {
          "description": "(0)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.5,
          "description": "min=0.5, mean=0.5, max=0.5, sum=0.5 (1)",
          "style": {},
          "markdown": false
        },
        {
          "description": "(0)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.2377049180327869,
          "description": "min=0.238, mean=0.238, max=0.238, sum=0.238 (1)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.01971830985915493,
          "description": "min=0.02, mean=0.02, max=0.02, sum=0.02 (1)",
          "style": {},
          "markdown": false
        },
        {
          "description": "1 matching runs, but no matching metrics",
          "markdown": false
        },
        {
          "value": 355.0,
          "description": "min=355, mean=355, max=355, sum=355 (1)",
          "style": {},
          "markdown": false
        },
        {
          "value": 1.9690140845070423,
          "description": "min=1.969, mean=1.969, max=1.969, sum=1.969 (1)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.0,
          "description": "min=0, mean=0, max=0, sum=0 (1)",
          "style": {},
          "markdown": false
        },
        {
          "value": 1691.081690140845,
          "description": "min=1691.082, mean=1691.082, max=1691.082, sum=1691.082 (1)",
          "style": {},
          "markdown": false
        },
        {
          "value": 1.0,
          "description": "min=1, mean=1, max=1, sum=1 (1)",
          "style": {},
          "markdown": false
        },
        {
          "value": 1.0,
          "description": "min=1, mean=1, max=1, sum=1 (1)",
          "style": {},
          "markdown": false
        }
      ],
      [
        {
          "value": "MPT-Instruct (30B)",
          "description": "",
          "href": "?group=narrative_qa&subgroup=&runSpecs=%5B%22narrative_qa%3Amodel%3Dmosaicml_mpt-instruct-30b%2Cdata_augmentation%3Dcanonical%22%5D",
          "markdown": false
        },
        {
          "value": 0.732860816220429,
          "description": "min=0.733, mean=0.733, max=0.733, sum=0.733 (1)",
          "style": {},
          "markdown": false
        },
        {
          "description": "1 matching runs, but no matching metrics",
          "markdown": false
        },
        {
          "value": 0.6233490338408667,
          "description": "min=0.623, mean=0.623, max=0.623, sum=0.623 (1)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.6330893045624563,
          "description": "min=0.633, mean=0.633, max=0.633, sum=0.633 (1)",
          "style": {},
          "markdown": false
        },
        {
          "description": "(0)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.5,
          "description": "min=0.5, mean=0.5, max=0.5, sum=0.5 (1)",
          "style": {},
          "markdown": false
        },
        {
          "description": "(0)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.22357723577235772,
          "description": "min=0.224, mean=0.224, max=0.224, sum=0.224 (1)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.016901408450704224,
          "description": "min=0.017, mean=0.017, max=0.017, sum=0.017 (1)",
          "style": {},
          "markdown": false
        },
        {
          "description": "1 matching runs, but no matching metrics",
          "markdown": false
        },
        {
          "value": 355.0,
          "description": "min=355, mean=355, max=355, sum=355 (1)",
          "style": {},
          "markdown": false
        },
        {
          "value": 1.9690140845070423,
          "description": "min=1.969, mean=1.969, max=1.969, sum=1.969 (1)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.0,
          "description": "min=0, mean=0, max=0, sum=0 (1)",
          "style": {},
          "markdown": false
        },
        {
          "value": 1691.081690140845,
          "description": "min=1691.082, mean=1691.082, max=1691.082, sum=1691.082 (1)",
          "style": {},
          "markdown": false
        },
        {
          "value": 1.0,
          "description": "min=1, mean=1, max=1, sum=1 (1)",
          "style": {},
          "markdown": false
        },
        {
          "value": 1.0,
          "description": "min=1, mean=1, max=1, sum=1 (1)",
          "style": {},
          "markdown": false
        }
      ],
      [
        {
          "value": "Falcon (7B)",
          "description": "",
          "href": "?group=narrative_qa&subgroup=&runSpecs=%5B%22narrative_qa%3Amodel%3Dtiiuae_falcon-7b%2Cdata_augmentation%3Dcanonical%22%5D",
          "markdown": false
        },
        {
          "value": 0.6209478967260336,
          "description": "min=0.621, mean=0.621, max=0.621, sum=0.621 (1)",
          "style": {},
          "markdown": false
        },
        {
          "description": "1 matching runs, but no matching metrics",
          "markdown": false
        },
        {
          "value": 0.4358401092976052,
          "description": "min=0.436, mean=0.436, max=0.436, sum=0.436 (1)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.5199130399003071,
          "description": "min=0.52, mean=0.52, max=0.52, sum=0.52 (1)",
          "style": {},
          "markdown": false
        },
        {
          "description": "(0)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.4444444444444444,
          "description": "min=0.444, mean=0.444, max=0.444, sum=0.444 (1)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.6666666666666667,
          "description": "min=0.667, mean=0.667, max=0.667, sum=0.667 (1)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.2046979865771812,
          "description": "min=0.205, mean=0.205, max=0.205, sum=0.205 (1)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.016901408450704224,
          "description": "min=0.017, mean=0.017, max=0.017, sum=0.017 (1)",
          "style": {},
          "markdown": false
        },
        {
          "description": "1 matching runs, but no matching metrics",
          "markdown": false
        },
        {
          "value": 355.0,
          "description": "min=355, mean=355, max=355, sum=355 (1)",
          "style": {},
          "markdown": false
        },
        {
          "value": 2.0253521126760563,
          "description": "min=2.025, mean=2.025, max=2.025, sum=2.025 (1)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.0,
          "description": "min=0, mean=0, max=0, sum=0 (1)",
          "style": {},
          "markdown": false
        },
        {
          "value": 1694.081690140845,
          "description": "min=1694.082, mean=1694.082, max=1694.082, sum=1694.082 (1)",
          "style": {},
          "markdown": false
        },
        {
          "value": 1.0,
          "description": "min=1, mean=1, max=1, sum=1 (1)",
          "style": {},
          "markdown": false
        },
        {
          "value": 1.0,
          "description": "min=1, mean=1, max=1, sum=1 (1)",
          "style": {},
          "markdown": false
        }
      ],
      [
        {
          "value": "Falcon-Instruct (7B)",
          "description": "",
          "href": "?group=narrative_qa&subgroup=&runSpecs=%5B%22narrative_qa%3Amodel%3Dtiiuae_falcon-7b-instruct%2Cdata_augmentation%3Dcanonical%22%5D",
          "markdown": false
        },
        {
          "value": 0.47631318018835694,
          "description": "min=0.476, mean=0.476, max=0.476, sum=0.476 (1)",
          "style": {},
          "markdown": false
        },
        {
          "description": "1 matching runs, but no matching metrics",
          "markdown": false
        },
        {
          "value": 0.2582769089885097,
          "description": "min=0.258, mean=0.258, max=0.258, sum=0.258 (1)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.3536054591455644,
          "description": "min=0.354, mean=0.354, max=0.354, sum=0.354 (1)",
          "style": {},
          "markdown": false
        },
        {
          "description": "(0)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.4444444444444444,
          "description": "min=0.444, mean=0.444, max=0.444, sum=0.444 (1)",
          "style": {},
          "markdown": false
        },
        {
          "description": "(0)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.1870229007633588,
          "description": "min=0.187, mean=0.187, max=0.187, sum=0.187 (1)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.016901408450704224,
          "description": "min=0.017, mean=0.017, max=0.017, sum=0.017 (1)",
          "style": {},
          "markdown": false
        },
        {
          "description": "1 matching runs, but no matching metrics",
          "markdown": false
        },
        {
          "value": 355.0,
          "description": "min=355, mean=355, max=355, sum=355 (1)",
          "style": {},
          "markdown": false
        },
        {
          "value": 2.0253521126760563,
          "description": "min=2.025, mean=2.025, max=2.025, sum=2.025 (1)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.0,
          "description": "min=0, mean=0, max=0, sum=0 (1)",
          "style": {},
          "markdown": false
        },
        {
          "value": 1694.081690140845,
          "description": "min=1694.082, mean=1694.082, max=1694.082, sum=1694.082 (1)",
          "style": {},
          "markdown": false
        },
        {
          "value": 1.0,
          "description": "min=1, mean=1, max=1, sum=1 (1)",
          "style": {},
          "markdown": false
        },
        {
          "value": 1.0,
          "description": "min=1, mean=1, max=1, sum=1 (1)",
          "style": {},
          "markdown": false
        }
      ],
      [
        {
          "value": "Falcon (40B)",
          "description": "",
          "href": "?group=narrative_qa&subgroup=&runSpecs=%5B%22narrative_qa%3Amodel%3Dtiiuae_falcon-40b%2Cdata_augmentation%3Dcanonical%22%5D",
          "markdown": false
        },
        {
          "value": 0.672629994827555,
          "description": "min=0.673, mean=0.673, max=0.673, sum=0.673 (1)",
          "style": {},
          "markdown": false
        },
        {
          "description": "1 matching runs, but no matching metrics",
          "markdown": false
        },
        {
          "value": 0.5574684493620005,
          "description": "min=0.557, mean=0.557, max=0.557, sum=0.557 (1)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.5589601433703856,
          "description": "min=0.559, mean=0.559, max=0.559, sum=0.559 (1)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.6666666666666667,
          "description": "min=0.667, mean=0.667, max=0.667, sum=0.667 (1)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.39814814814814814,
          "description": "min=0.398, mean=0.398, max=0.398, sum=0.398 (1)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.6666666666666667,
          "description": "min=0.667, mean=0.667, max=0.667, sum=0.667 (1)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.19148936170212763,
          "description": "min=0.191, mean=0.191, max=0.191, sum=0.191 (1)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.01971830985915493,
          "description": "min=0.02, mean=0.02, max=0.02, sum=0.02 (1)",
          "style": {},
          "markdown": false
        },
        {
          "description": "1 matching runs, but no matching metrics",
          "markdown": false
        },
        {
          "value": 355.0,
          "description": "min=355, mean=355, max=355, sum=355 (1)",
          "style": {},
          "markdown": false
        },
        {
          "value": 2.0253521126760563,
          "description": "min=2.025, mean=2.025, max=2.025, sum=2.025 (1)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.0,
          "description": "min=0, mean=0, max=0, sum=0 (1)",
          "style": {},
          "markdown": false
        },
        {
          "value": 1694.081690140845,
          "description": "min=1694.082, mean=1694.082, max=1694.082, sum=1694.082 (1)",
          "style": {},
          "markdown": false
        },
        {
          "value": 1.0,
          "description": "min=1, mean=1, max=1, sum=1 (1)",
          "style": {},
          "markdown": false
        },
        {
          "value": 1.0,
          "description": "min=1, mean=1, max=1, sum=1 (1)",
          "style": {},
          "markdown": false
        }
      ],
      [
        {
          "value": "Falcon-Instruct (40B)",
          "description": "",
          "href": "?group=narrative_qa&subgroup=&runSpecs=%5B%22narrative_qa%3Amodel%3Dtiiuae_falcon-40b-instruct%2Cdata_augmentation%3Dcanonical%22%5D",
          "markdown": false
        },
        {
          "value": 0.6246600584363529,
          "description": "min=0.625, mean=0.625, max=0.625, sum=0.625 (1)",
          "style": {},
          "markdown": false
        },
        {
          "description": "1 matching runs, but no matching metrics",
          "markdown": false
        },
        {
          "value": 0.5082425698893845,
          "description": "min=0.508, mean=0.508, max=0.508, sum=0.508 (1)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.543279669317833,
          "description": "min=0.543, mean=0.543, max=0.543, sum=0.543 (1)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.6666666666666667,
          "description": "min=0.667, mean=0.667, max=0.667, sum=0.667 (1)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.33194444444444443,
          "description": "min=0.332, mean=0.332, max=0.332, sum=0.332 (1)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.4666666666666667,
          "description": "min=0.467, mean=0.467, max=0.467, sum=0.467 (1)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.17464114832535887,
          "description": "min=0.175, mean=0.175, max=0.175, sum=0.175 (1)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.011267605633802818,
          "description": "min=0.011, mean=0.011, max=0.011, sum=0.011 (1)",
          "style": {},
          "markdown": false
        },
        {
          "description": "1 matching runs, but no matching metrics",
          "markdown": false
        },
        {
          "value": 355.0,
          "description": "min=355, mean=355, max=355, sum=355 (1)",
          "style": {},
          "markdown": false
        },
        {
          "value": 2.0253521126760563,
          "description": "min=2.025, mean=2.025, max=2.025, sum=2.025 (1)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.0,
          "description": "min=0, mean=0, max=0, sum=0 (1)",
          "style": {},
          "markdown": false
        },
        {
          "value": 1694.081690140845,
          "description": "min=1694.082, mean=1694.082, max=1694.082, sum=1694.082 (1)",
          "style": {},
          "markdown": false
        },
        {
          "value": 1.0,
          "description": "min=1, mean=1, max=1, sum=1 (1)",
          "style": {},
          "markdown": false
        },
        {
          "value": 1.0,
          "description": "min=1, mean=1, max=1, sum=1 (1)",
          "style": {},
          "markdown": false
        }
      ],
      [
        {
          "value": "GLM (130B)",
          "description": "",
          "href": "?group=narrative_qa&subgroup=&runSpecs=%5B%22narrative_qa%3Amodel%3Dtogether_glm%2Cdata_augmentation%3Dcanonical%2Cstop%3Dhash%22%5D",
          "markdown": false
        },
        {
          "value": 0.7059235974790917,
          "description": "min=0.655, mean=0.706, max=0.736, sum=2.118 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.03732324115716399,
          "description": "min=0.027, mean=0.037, max=0.058, sum=0.112 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.6293880948208791,
          "description": "min=0.531, mean=0.629, max=0.682, sum=1.888 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.6154230898629193,
          "description": "min=0.55, mean=0.615, max=0.656, sum=1.846 (3)",
          "style": {},
          "markdown": false
        },
        {
          "description": "(0)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.3717948717948718,
          "description": "min=0.365, mean=0.372, max=0.375, sum=1.115 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.6666666666666667,
          "description": "min=0.667, mean=0.667, max=0.667, sum=0.667 (1)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.1896318370894642,
          "description": "min=0.168, mean=0.19, max=0.215, sum=0.569 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.012206572769953052,
          "description": "min=0.011, mean=0.012, max=0.014, sum=0.037 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 2.3151894005635367,
          "description": "min=1.78, mean=2.315, max=3.197, sum=6.946 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 355.0,
          "description": "min=355, mean=355, max=355, sum=1065 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 1.6751173708920186,
          "description": "min=1.101, mean=1.675, max=2.11, sum=5.025 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.0,
          "description": "min=0, mean=0, max=0, sum=0 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 1658.8112676056337,
          "description": "min=1597.372, mean=1658.811, max=1711.876, sum=4976.434 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 9.938967136150234,
          "description": "min=6.008, mean=9.939, max=17.439, sum=29.817 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 3.0,
          "description": "min=3, mean=3, max=3, sum=9 (3)",
          "style": {},
          "markdown": false
        }
      ],
      [
        {
          "value": "InstructPalmyra (30B)",
          "description": "",
          "href": "?group=narrative_qa&subgroup=&runSpecs=%5B%22narrative_qa%3Amodel%3Dwriter_palmyra-instruct-30%2Cdata_augmentation%3Dcanonical%22%5D",
          "markdown": false
        },
        {
          "value": 0.49645549460257793,
          "description": "min=0.253, mean=0.496, max=0.636, sum=1.489 (3)",
          "style": {},
          "markdown": false
        },
        {
          "description": "1 matching runs, but no matching metrics",
          "markdown": false
        },
        {
          "value": 0.3173185298582432,
          "description": "min=0.091, mean=0.317, max=0.444, sum=0.952 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.40467419690737483,
          "description": "min=0.18, mean=0.405, max=0.538, sum=1.214 (3)",
          "style": {},
          "markdown": false
        },
        {
          "description": "(0)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.44516594516594515,
          "description": "min=0.381, mean=0.445, max=0.5, sum=1.335 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.4444444444444445,
          "description": "min=0.333, mean=0.444, max=0.667, sum=1.333 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.1960646593836042,
          "description": "min=0.164, mean=0.196, max=0.241, sum=0.588 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.01220657276995305,
          "description": "min=0.003, mean=0.012, max=0.017, sum=0.037 (3)",
          "style": {},
          "markdown": false
        },
        {
          "description": "1 matching runs, but no matching metrics",
          "markdown": false
        },
        {
          "value": 355.0,
          "description": "min=355, mean=355, max=355, sum=1065 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 1.6460093896713615,
          "description": "min=1.051, mean=1.646, max=2.085, sum=4.938 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.0,
          "description": "min=0, mean=0, max=0, sum=0 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 1651.8478873239437,
          "description": "min=1600.366, mean=1651.848, max=1705.003, sum=4955.544 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 5.347417840375587,
          "description": "min=1.93, mean=5.347, max=7.079, sum=16.042 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 3.0,
          "description": "min=3, mean=3, max=3, sum=9 (3)",
          "style": {},
          "markdown": false
        }
      ],
      [
        {
          "value": "Palmyra X (43B)",
          "description": "",
          "href": "?group=narrative_qa&subgroup=&runSpecs=%5B%22narrative_qa%3Amodel%3Dwriter_palmyra-x%2Cdata_augmentation%3Dcanonical%22%5D",
          "markdown": false
        },
        {
          "value": 0.7418788396572448,
          "description": "min=0.732, mean=0.742, max=0.748, sum=2.226 (3)",
          "style": {},
          "markdown": false
        },
        {
          "description": "1 matching runs, but no matching metrics",
          "markdown": false
        },
        {
          "value": 0.6719021727640991,
          "description": "min=0.667, mean=0.672, max=0.68, sum=2.016 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.6506183133514157,
          "description": "min=0.64, mean=0.651, max=0.659, sum=1.952 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.6666666666666667,
          "description": "min=0.667, mean=0.667, max=0.667, sum=1.333 (2)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.39814814814814814,
          "description": "min=0.396, mean=0.398, max=0.403, sum=1.194 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.6666666666666666,
          "description": "min=0.667, mean=0.667, max=0.667, sum=2 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.15935305534542177,
          "description": "min=0.149, mean=0.159, max=0.181, sum=0.478 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.011267605633802818,
          "description": "min=0.008, mean=0.011, max=0.014, sum=0.034 (3)",
          "style": {},
          "markdown": false
        },
        {
          "description": "1 matching runs, but no matching metrics",
          "markdown": false
        },
        {
          "value": 355.0,
          "description": "min=355, mean=355, max=355, sum=1065 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 5.0,
          "description": "min=5, mean=5, max=5, sum=15 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.0,
          "description": "min=0, mean=0, max=0, sum=0 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 3803.910798122066,
          "description": "min=3504.577, mean=3803.911, max=3972.577, sum=11411.732 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 6.272300469483568,
          "description": "min=5.375, mean=6.272, max=7.29, sum=18.817 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 3.0,
          "description": "min=3, mean=3, max=3, sum=9 (3)",
          "style": {},
          "markdown": false
        }
      ],
      [
        {
          "value": "YaLM (100B)",
          "description": "",
          "href": "?group=narrative_qa&subgroup=&runSpecs=%5B%22narrative_qa%3Amodel%3Dtogether_yalm%2Cdata_augmentation%3Dcanonical%22%5D",
          "markdown": false
        },
        {
          "value": 0.2521219532517845,
          "description": "min=0.213, mean=0.252, max=0.297, sum=0.756 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.05960283323299867,
          "description": "min=0.029, mean=0.06, max=0.101, sum=0.179 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.08788676556219112,
          "description": "min=0.078, mean=0.088, max=0.096, sum=0.264 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.14573784149261218,
          "description": "min=0.131, mean=0.146, max=0.169, sum=0.437 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.6666666666666666,
          "description": "min=0.667, mean=0.667, max=0.667, sum=2 (3)",
          "style": {
            "font-weight": "bold"
          },
          "markdown": false
        },
        {
          "value": 0.449065994913171,
          "description": "min=0.434, mean=0.449, max=0.478, sum=1.347 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.5676937441643325,
          "description": "min=0.429, mean=0.568, max=0.667, sum=1.703 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.17681914997964296,
          "description": "min=0.127, mean=0.177, max=0.216, sum=0.53 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.016901408450704227,
          "description": "min=0.014, mean=0.017, max=0.02, sum=0.051 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 2.314193915889056,
          "description": "min=2.158, mean=2.314, max=2.397, sum=6.943 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 355.0,
          "description": "min=355, mean=355, max=355, sum=1065 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 1.603755868544601,
          "description": "min=1.028, mean=1.604, max=2.008, sum=4.811 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 0.0,
          "description": "min=0, mean=0, max=0, sum=0 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 1644.8779342723003,
          "description": "min=1603.569, mean=1644.878, max=1690.352, sum=4934.634 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 96.01784037558686,
          "description": "min=94.115, mean=96.018, max=98.566, sum=288.054 (3)",
          "style": {},
          "markdown": false
        },
        {
          "value": 3.0,
          "description": "min=3, mean=3, max=3, sum=9 (3)",
          "style": {},
          "markdown": false
        }
      ]
    ],
    "links": [
      {
        "text": "LaTeX",
        "href": "/nlp/scr4/nlp/crfm/yifanmai/helm-release/benchmark_output/releases/v0.4.0/groups/latex/narrative_qa_narrative_qa_.tex"
      },
      {
        "text": "JSON",
        "href": "/nlp/scr4/nlp/crfm/yifanmai/helm-release/benchmark_output/releases/v0.4.0/groups/json/narrative_qa_narrative_qa_.json"
      }
    ],
    "name": "narrative_qa_"
  }
]