Score for iteration 500
Answer Metrics
	Hits@1:  0.6676
	Hits@3:  0.8579
	Hits@5:  0.8991
	Hits@10:  0.9383
	Hits@20:  0.9621
	MRR:  0.7726
Per Hop Answer Metrics
	3-Hop
		Hits@1:  0.5494
		MRR:  0.6886
	1-Hop
		Hits@1:  0.8040
		MRR:  0.8693
	2-Hop
		Hits@1:  0.6893
		MRR:  0.7884
Valid Action Count at Each Step
	Overall Average: 27.4164
		Step 1:  8.5170
		Step 2: 39.0669
		Step 3: 34.6653
Entropy Metrics
	Question Entropy:  1.4190
	Path Entropy:  4.2571
		Step 1:  0.6190
		Step 2:  2.0803
		Step 3:  1.5579
Reasoning Diagnostics (Top-Rollout)
	Special Step Rate:  0.1159
	Restart Rate:  0.0000
	No-Op Rate:  0.1159
	Cycle Rate:  0.2221
	Backtrack Rate:  0.1977
	Unique Edges:  2.0593
	Redundancy:  0.2071
	Avg Segment Hops:  2.6523
Answer(s) Endpoint Coverage Metrics
	Recall:  0.9173
	Precision:  0.1812
	F1 Score:  0.2315

Score for iteration 1000
Answer Metrics
	Hits@1:  0.7256
	Hits@3:  0.8912
	Hits@5:  0.9199
	Hits@10:  0.9508
	Hits@20:  0.9713
	MRR:  0.8157
Per Hop Answer Metrics
	3-Hop
		Hits@1:  0.6233
		MRR:  0.7366
	1-Hop
		Hits@1:  0.8291
		MRR:  0.8909
	2-Hop
		Hits@1:  0.7542
		MRR:  0.8411
Valid Action Count at Each Step
	Overall Average: 29.7100
		Step 1:  8.5170
		Step 2: 42.6175
		Step 3: 37.9955
Entropy Metrics
	Question Entropy:  1.2050
	Path Entropy:  3.6150
		Step 1:  0.3989
		Step 2:  1.8211
		Step 3:  1.3950
Reasoning Diagnostics (Top-Rollout)
	Special Step Rate:  0.1213
	Restart Rate:  0.0000
	No-Op Rate:  0.1213
	Cycle Rate:  0.2041
	Backtrack Rate:  0.1864
	Unique Edges:  2.0845
	Redundancy:  0.1929
	Avg Segment Hops:  2.6362
Answer(s) Endpoint Coverage Metrics
	Recall:  0.9289
	Precision:  0.1892
	F1 Score:  0.2369

Score for iteration 1500
Answer Metrics
	Hits@1:  0.7572
	Hits@3:  0.9238
	Hits@5:  0.9521
	Hits@10:  0.9757
	Hits@20:  0.9884
	MRR:  0.8460
Per Hop Answer Metrics
	3-Hop
		Hits@1:  0.6791
		MRR:  0.7833
	2-Hop
		Hits@1:  0.7900
		MRR:  0.8804
	1-Hop
		Hits@1:  0.8200
		MRR:  0.8845
Valid Action Count at Each Step
	Overall Average: 28.5513
		Step 1:  8.5170
		Step 2: 39.5960
		Step 3: 37.5409
Entropy Metrics
	Question Entropy:  1.0596
	Path Entropy:  3.1789
		Step 1:  0.3384
		Step 2:  1.5988
		Step 3:  1.2417
Reasoning Diagnostics (Top-Rollout)
	Special Step Rate:  0.1255
	Restart Rate:  0.0000
	No-Op Rate:  0.1255
	Cycle Rate:  0.1852
	Backtrack Rate:  0.1678
	Unique Edges:  2.1291
	Redundancy:  0.1735
	Avg Segment Hops:  2.6234
Answer(s) Endpoint Coverage Metrics
	Recall:  0.9604
	Precision:  0.1773
	F1 Score:  0.2380

Score for iteration 2000
Answer Metrics
	Hits@1:  0.7856
	Hits@3:  0.9393
	Hits@5:  0.9634
	Hits@10:  0.9829
	Hits@20:  0.9924
	MRR:  0.8671
Per Hop Answer Metrics
	3-Hop
		Hits@1:  0.7187
		MRR:  0.8156
	1-Hop
		Hits@1:  0.8230
		MRR:  0.8858
	2-Hop
		Hits@1:  0.8246
		MRR:  0.9040
Valid Action Count at Each Step
	Overall Average: 28.5362
		Step 1:  8.5170
		Step 2: 39.3229
		Step 3: 37.7687
Entropy Metrics
	Question Entropy:  0.9846
	Path Entropy:  2.9537
		Step 1:  0.2870
		Step 2:  1.4669
		Step 3:  1.1998
Reasoning Diagnostics (Top-Rollout)
	Special Step Rate:  0.1282
	Restart Rate:  0.0000
	No-Op Rate:  0.1282
	Cycle Rate:  0.1775
	Backtrack Rate:  0.1545
	Unique Edges:  2.1616
	Redundancy:  0.1592
	Avg Segment Hops:  2.6155
Answer(s) Endpoint Coverage Metrics
	Recall:  0.9693
	Precision:  0.1802
	F1 Score:  0.2425

Score for iteration 2500
Answer Metrics
	Hits@1:  0.8126
	Hits@3:  0.9581
	Hits@5:  0.9781
	Hits@10:  0.9896
	Hits@20:  0.9946
	MRR:  0.8881
Per Hop Answer Metrics
	3-Hop
		Hits@1:  0.7830
		MRR:  0.8685
	1-Hop
		Hits@1:  0.8229
		MRR:  0.8850
	2-Hop
		Hits@1:  0.8341
		MRR:  0.9090
Valid Action Count at Each Step
	Overall Average: 30.0532
		Step 1:  8.5170
		Step 2: 41.6845
		Step 3: 39.9581
Entropy Metrics
	Question Entropy:  0.9358
	Path Entropy:  2.8075
		Step 1:  0.2537
		Step 2:  1.3740
		Step 3:  1.1799
Reasoning Diagnostics (Top-Rollout)
	Special Step Rate:  0.1270
	Restart Rate:  0.0000
	No-Op Rate:  0.1270
	Cycle Rate:  0.1674
	Backtrack Rate:  0.1493
	Unique Edges:  2.1841
	Redundancy:  0.1527
	Avg Segment Hops:  2.6190
Answer(s) Endpoint Coverage Metrics
	Recall:  0.9745
	Precision:  0.1942
	F1 Score:  0.2558

Score for iteration 3000
Answer Metrics
	Hits@1:  0.8212
	Hits@3:  0.9629
	Hits@5:  0.9790
	Hits@10:  0.9899
	Hits@20:  0.9952
	MRR:  0.8938
Per Hop Answer Metrics
	3-Hop
		Hits@1:  0.8024
		MRR:  0.8816
	1-Hop
		Hits@1:  0.8251
		MRR:  0.8858
	2-Hop
		Hits@1:  0.8367
		MRR:  0.9109
Valid Action Count at Each Step
	Overall Average: 30.4981
		Step 1:  8.5170
		Step 2: 41.3586
		Step 3: 41.6188
Entropy Metrics
	Question Entropy:  0.8958
	Path Entropy:  2.6873
		Step 1:  0.2215
		Step 2:  1.2938
		Step 3:  1.1720
Reasoning Diagnostics (Top-Rollout)
	Special Step Rate:  0.1270
	Restart Rate:  0.0000
	No-Op Rate:  0.1270
	Cycle Rate:  0.1644
	Backtrack Rate:  0.1465
	Unique Edges:  2.1928
	Redundancy:  0.1496
	Avg Segment Hops:  2.6189
Answer(s) Endpoint Coverage Metrics
	Recall:  0.9784
	Precision:  0.1953
	F1 Score:  0.2580

Score for iteration 3500
Answer Metrics
	Hits@1:  0.8334
	Hits@3:  0.9678
	Hits@5:  0.9824
	Hits@10:  0.9909
	Hits@20:  0.9954
	MRR:  0.9022
Per Hop Answer Metrics
	3-Hop
		Hits@1:  0.8242
		MRR:  0.8960
	1-Hop
		Hits@1:  0.8340
		MRR:  0.8921
	2-Hop
		Hits@1:  0.8418
		MRR:  0.9148
Valid Action Count at Each Step
	Overall Average: 30.9400
		Step 1:  8.5170
		Step 2: 42.1085
		Step 3: 42.1945
Entropy Metrics
	Question Entropy:  0.8959
	Path Entropy:  2.6878
		Step 1:  0.2061
		Step 2:  1.3086
		Step 3:  1.1732
Reasoning Diagnostics (Top-Rollout)
	Special Step Rate:  0.1275
	Restart Rate:  0.0000
	No-Op Rate:  0.1275
	Cycle Rate:  0.1631
	Backtrack Rate:  0.1450
	Unique Edges:  2.1944
	Redundancy:  0.1488
	Avg Segment Hops:  2.6176
Answer(s) Endpoint Coverage Metrics
	Recall:  0.9806
	Precision:  0.1992
	F1 Score:  0.2616

Score for iteration 4000
Answer Metrics
	Hits@1:  0.8389
	Hits@3:  0.9683
	Hits@5:  0.9824
	Hits@10:  0.9913
	Hits@20:  0.9957
	MRR:  0.9053
Per Hop Answer Metrics
	3-Hop
		Hits@1:  0.8342
		MRR:  0.9016
	1-Hop
		Hits@1:  0.8381
		MRR:  0.8948
	2-Hop
		Hits@1:  0.8440
		MRR:  0.9159
Valid Action Count at Each Step
	Overall Average: 32.1550
		Step 1:  8.5170
		Step 2: 43.1856
		Step 3: 44.7625
Entropy Metrics
	Question Entropy:  0.8713
	Path Entropy:  2.6140
		Step 1:  0.1912
		Step 2:  1.2504
		Step 3:  1.1724
Reasoning Diagnostics (Top-Rollout)
	Special Step Rate:  0.1276
	Restart Rate:  0.0000
	No-Op Rate:  0.1276
	Cycle Rate:  0.1615
	Backtrack Rate:  0.1444
	Unique Edges:  2.1974
	Redundancy:  0.1477
	Avg Segment Hops:  2.6171
Answer(s) Endpoint Coverage Metrics
	Recall:  0.9789
	Precision:  0.2028
	F1 Score:  0.2628

Score for iteration 4500
Answer Metrics
	Hits@1:  0.8414
	Hits@3:  0.9703
	Hits@5:  0.9838
	Hits@10:  0.9920
	Hits@20:  0.9960
	MRR:  0.9073
Per Hop Answer Metrics
	3-Hop
		Hits@1:  0.8321
		MRR:  0.9013
	1-Hop
		Hits@1:  0.8474
		MRR:  0.9015
	2-Hop
		Hits@1:  0.8462
		MRR:  0.9170
Valid Action Count at Each Step
	Overall Average: 31.4202
		Step 1:  8.5170
		Step 2: 41.7010
		Step 3: 44.0425
Entropy Metrics
	Question Entropy:  0.8595
	Path Entropy:  2.5786
		Step 1:  0.1868
		Step 2:  1.2413
		Step 3:  1.1505
Reasoning Diagnostics (Top-Rollout)
	Special Step Rate:  0.1276
	Restart Rate:  0.0000
	No-Op Rate:  0.1276
	Cycle Rate:  0.1611
	Backtrack Rate:  0.1443
	Unique Edges:  2.1991
	Redundancy:  0.1470
	Avg Segment Hops:  2.6173
Answer(s) Endpoint Coverage Metrics
	Recall:  0.9821
	Precision:  0.2018
	F1 Score:  0.2631

Score for iteration 5000
Answer Metrics
	Hits@1:  0.8461
	Hits@3:  0.9723
	Hits@5:  0.9846
	Hits@10:  0.9927
	Hits@20:  0.9959
	MRR:  0.9103
Per Hop Answer Metrics
	3-Hop
		Hits@1:  0.8380
		MRR:  0.9051
	1-Hop
		Hits@1:  0.8515
		MRR:  0.9046
	2-Hop
		Hits@1:  0.8503
		MRR:  0.9192
Valid Action Count at Each Step
	Overall Average: 31.4069
		Step 1:  8.5170
		Step 2: 41.5916
		Step 3: 44.1120
Entropy Metrics
	Question Entropy:  0.8428
	Path Entropy:  2.5284
		Step 1:  0.1762
		Step 2:  1.2117
		Step 3:  1.1405
Reasoning Diagnostics (Top-Rollout)
	Special Step Rate:  0.1273
	Restart Rate:  0.0000
	No-Op Rate:  0.1273
	Cycle Rate:  0.1595
	Backtrack Rate:  0.1426
	Unique Edges:  2.2029
	Redundancy:  0.1456
	Avg Segment Hops:  2.6181
Answer(s) Endpoint Coverage Metrics
	Recall:  0.9834
	Precision:  0.1998
	F1 Score:  0.2609

Score for iteration 5500
Answer Metrics
	Hits@1:  0.8525
	Hits@3:  0.9746
	Hits@5:  0.9866
	Hits@10:  0.9937
	Hits@20:  0.9967
	MRR:  0.9148
Per Hop Answer Metrics
	3-Hop
		Hits@1:  0.8479
		MRR:  0.9119
	1-Hop
		Hits@1:  0.8594
		MRR:  0.9102
	2-Hop
		Hits@1:  0.8523
		MRR:  0.9206
Valid Action Count at Each Step
	Overall Average: 32.2992
		Step 1:  8.5170
		Step 2: 43.1145
		Step 3: 45.2661
Entropy Metrics
	Question Entropy:  0.8071
	Path Entropy:  2.4213
		Step 1:  0.1575
		Step 2:  1.1635
		Step 3:  1.1002
Reasoning Diagnostics (Top-Rollout)
	Special Step Rate:  0.1269
	Restart Rate:  0.0000
	No-Op Rate:  0.1269
	Cycle Rate:  0.1600
	Backtrack Rate:  0.1445
	Unique Edges:  2.2015
	Redundancy:  0.1465
	Avg Segment Hops:  2.6194
Answer(s) Endpoint Coverage Metrics
	Recall:  0.9848
	Precision:  0.2020
	F1 Score:  0.2646

Score for iteration 6000
Answer Metrics
	Hits@1:  0.8557
	Hits@3:  0.9752
	Hits@5:  0.9869
	Hits@10:  0.9935
	Hits@20:  0.9966
	MRR:  0.9168
Per Hop Answer Metrics
	3-Hop
		Hits@1:  0.8532
		MRR:  0.9155
	1-Hop
		Hits@1:  0.8643
		MRR:  0.9140
	2-Hop
		Hits@1:  0.8524
		MRR:  0.9198
Valid Action Count at Each Step
	Overall Average: 32.5535
		Step 1:  8.5170
		Step 2: 44.3927
		Step 3: 44.7508
Entropy Metrics
	Question Entropy:  0.7960
	Path Entropy:  2.3881
		Step 1:  0.1555
		Step 2:  1.1776
		Step 3:  1.0549
Reasoning Diagnostics (Top-Rollout)
	Special Step Rate:  0.1265
	Restart Rate:  0.0000
	No-Op Rate:  0.1265
	Cycle Rate:  0.1598
	Backtrack Rate:  0.1442
	Unique Edges:  2.2025
	Redundancy:  0.1463
	Avg Segment Hops:  2.6206
Answer(s) Endpoint Coverage Metrics
	Recall:  0.9837
	Precision:  0.2067
	F1 Score:  0.2687

Score for iteration 6500
Answer Metrics
	Hits@1:  0.8605
	Hits@3:  0.9776
	Hits@5:  0.9879
	Hits@10:  0.9939
	Hits@20:  0.9967
	MRR:  0.9200
Per Hop Answer Metrics
	3-Hop
		Hits@1:  0.8546
		MRR:  0.9164
	1-Hop
		Hits@1:  0.8693
		MRR:  0.9174
	2-Hop
		Hits@1:  0.8603
		MRR:  0.9253
Valid Action Count at Each Step
	Overall Average: 32.3882
		Step 1:  8.5170
		Step 2: 43.6341
		Step 3: 45.0136
Entropy Metrics
	Question Entropy:  0.7853
	Path Entropy:  2.3558
		Step 1:  0.1506
		Step 2:  1.1416
		Step 3:  1.0636
Reasoning Diagnostics (Top-Rollout)
	Special Step Rate:  0.1275
	Restart Rate:  0.0000
	No-Op Rate:  0.1275
	Cycle Rate:  0.1595
	Backtrack Rate:  0.1451
	Unique Edges:  2.1982
	Redundancy:  0.1469
	Avg Segment Hops:  2.6176
Answer(s) Endpoint Coverage Metrics
	Recall:  0.9846
	Precision:  0.2045
	F1 Score:  0.2663

Score for iteration 7000
Answer Metrics
	Hits@1:  0.8632
	Hits@3:  0.9781
	Hits@5:  0.9883
	Hits@10:  0.9945
	Hits@20:  0.9969
	MRR:  0.9215
Per Hop Answer Metrics
	3-Hop
		Hits@1:  0.8580
		MRR:  0.9179
	1-Hop
		Hits@1:  0.8749
		MRR:  0.9217
	2-Hop
		Hits@1:  0.8603
		MRR:  0.9249
Valid Action Count at Each Step
	Overall Average: 31.2984
		Step 1:  8.5170
		Step 2: 41.5584
		Step 3: 43.8197
Entropy Metrics
	Question Entropy:  0.7236
	Path Entropy:  2.1707
		Step 1:  0.1402
		Step 2:  1.0565
		Step 3:  0.9740
Reasoning Diagnostics (Top-Rollout)
	Special Step Rate:  0.1274
	Restart Rate:  0.0000
	No-Op Rate:  0.1274
	Cycle Rate:  0.1585
	Backtrack Rate:  0.1439
	Unique Edges:  2.2015
	Redundancy:  0.1456
	Avg Segment Hops:  2.6178
Answer(s) Endpoint Coverage Metrics
	Recall:  0.9848
	Precision:  0.1985
	F1 Score:  0.2605

Score for iteration 7500
Answer Metrics
	Hits@1:  0.8665
	Hits@3:  0.9789
	Hits@5:  0.9894
	Hits@10:  0.9948
	Hits@20:  0.9971
	MRR:  0.9237
Per Hop Answer Metrics
	3-Hop
		Hits@1:  0.8637
		MRR:  0.9211
	1-Hop
		Hits@1:  0.8741
		MRR:  0.9225
	2-Hop
		Hits@1:  0.8641
		MRR:  0.9270
Valid Action Count at Each Step
	Overall Average: 31.6681
		Step 1:  8.5170
		Step 2: 42.5347
		Step 3: 43.9526
Entropy Metrics
	Question Entropy:  0.7262
	Path Entropy:  2.1787
		Step 1:  0.1316
		Step 2:  1.0604
		Step 3:  0.9866
Reasoning Diagnostics (Top-Rollout)
	Special Step Rate:  0.1268
	Restart Rate:  0.0000
	No-Op Rate:  0.1268
	Cycle Rate:  0.1576
	Backtrack Rate:  0.1436
	Unique Edges:  2.2038
	Redundancy:  0.1453
	Avg Segment Hops:  2.6196
Answer(s) Endpoint Coverage Metrics
	Recall:  0.9864
	Precision:  0.1967
	F1 Score:  0.2591

Score for iteration 8000
Answer Metrics
	Hits@1:  0.8661
	Hits@3:  0.9785
	Hits@5:  0.9886
	Hits@10:  0.9941
	Hits@20:  0.9967
	MRR:  0.9231
Per Hop Answer Metrics
	3-Hop
		Hits@1:  0.8597
		MRR:  0.9185
	1-Hop
		Hits@1:  0.8782
		MRR:  0.9253
	2-Hop
		Hits@1:  0.8641
		MRR:  0.9262
Valid Action Count at Each Step
	Overall Average: 31.7765
		Step 1:  8.5170
		Step 2: 43.0713
		Step 3: 43.7411
Entropy Metrics
	Question Entropy:  0.7160
	Path Entropy:  2.1481
		Step 1:  0.1314
		Step 2:  1.0588
		Step 3:  0.9579
Reasoning Diagnostics (Top-Rollout)
	Special Step Rate:  0.1270
	Restart Rate:  0.0000
	No-Op Rate:  0.1270
	Cycle Rate:  0.1579
	Backtrack Rate:  0.1434
	Unique Edges:  2.2020
	Redundancy:  0.1455
	Avg Segment Hops:  2.6190
Answer(s) Endpoint Coverage Metrics
	Recall:  0.9851
	Precision:  0.1931
	F1 Score:  0.2556

Score for iteration 8500
Answer Metrics
	Hits@1:  0.8713
	Hits@3:  0.9807
	Hits@5:  0.9899
	Hits@10:  0.9950
	Hits@20:  0.9970
	MRR:  0.9268
Per Hop Answer Metrics
	3-Hop
		Hits@1:  0.8666
		MRR:  0.9231
	1-Hop
		Hits@1:  0.8854
		MRR:  0.9300
	2-Hop
		Hits@1:  0.8663
		MRR:  0.9281
Valid Action Count at Each Step
	Overall Average: 33.0236
		Step 1:  8.5170
		Step 2: 44.6133
		Step 3: 45.9406
Entropy Metrics
	Question Entropy:  0.7195
	Path Entropy:  2.1586
		Step 1:  0.1279
		Step 2:  1.0556
		Step 3:  0.9752
Reasoning Diagnostics (Top-Rollout)
	Special Step Rate:  0.1266
	Restart Rate:  0.0000
	No-Op Rate:  0.1266
	Cycle Rate:  0.1578
	Backtrack Rate:  0.1440
	Unique Edges:  2.2033
	Redundancy:  0.1455
	Avg Segment Hops:  2.6203
Answer(s) Endpoint Coverage Metrics
	Recall:  0.9845
	Precision:  0.2028
	F1 Score:  0.2645

Score for iteration 9000
Answer Metrics
	Hits@1:  0.8719
	Hits@3:  0.9806
	Hits@5:  0.9895
	Hits@10:  0.9947
	Hits@20:  0.9970
	MRR:  0.9269
Per Hop Answer Metrics
	3-Hop
		Hits@1:  0.8686
		MRR:  0.9238
	1-Hop
		Hits@1:  0.8844
		MRR:  0.9292
	2-Hop
		Hits@1:  0.8667
		MRR:  0.9282
Valid Action Count at Each Step
	Overall Average: 31.1258
		Step 1:  8.5170
		Step 2: 41.8812
		Step 3: 42.9791
Entropy Metrics
	Question Entropy:  0.6610
	Path Entropy:  1.9831
		Step 1:  0.1188
		Step 2:  0.9716
		Step 3:  0.8927
Reasoning Diagnostics (Top-Rollout)
	Special Step Rate:  0.1267
	Restart Rate:  0.0000
	No-Op Rate:  0.1267
	Cycle Rate:  0.1571
	Backtrack Rate:  0.1440
	Unique Edges:  2.2029
	Redundancy:  0.1456
	Avg Segment Hops:  2.6200
Answer(s) Endpoint Coverage Metrics
	Recall:  0.9863
	Precision:  0.1917
	F1 Score:  0.2538

Score for iteration 9500
Answer Metrics
	Hits@1:  0.8743
	Hits@3:  0.9810
	Hits@5:  0.9905
	Hits@10:  0.9951
	Hits@20:  0.9970
	MRR:  0.9282
Per Hop Answer Metrics
	3-Hop
		Hits@1:  0.8693
		MRR:  0.9235
	1-Hop
		Hits@1:  0.8878
		MRR:  0.9318
	2-Hop
		Hits@1:  0.8700
		MRR:  0.9303
Valid Action Count at Each Step
	Overall Average: 31.5100
		Step 1:  8.5170
		Step 2: 40.5887
		Step 3: 45.4243
Entropy Metrics
	Question Entropy:  0.6657
	Path Entropy:  1.9971
		Step 1:  0.1188
		Step 2:  0.9332
		Step 3:  0.9451
Reasoning Diagnostics (Top-Rollout)
	Special Step Rate:  0.1281
	Restart Rate:  0.0000
	No-Op Rate:  0.1281
	Cycle Rate:  0.1570
	Backtrack Rate:  0.1441
	Unique Edges:  2.1989
	Redundancy:  0.1455
	Avg Segment Hops:  2.6157
Answer(s) Endpoint Coverage Metrics
	Recall:  0.9861
	Precision:  0.1886
	F1 Score:  0.2501

Score for iteration 10000
Answer Metrics
	Hits@1:  0.8784
	Hits@3:  0.9823
	Hits@5:  0.9907
	Hits@10:  0.9955
	Hits@20:  0.9972
	MRR:  0.9308
Per Hop Answer Metrics
	3-Hop
		Hits@1:  0.8738
		MRR:  0.9268
	1-Hop
		Hits@1:  0.8920
		MRR:  0.9341
	2-Hop
		Hits@1:  0.8736
		MRR:  0.9325
Valid Action Count at Each Step
	Overall Average: 32.2543
		Step 1:  8.5170
		Step 2: 42.3988
		Step 3: 45.8471
Entropy Metrics
	Question Entropy:  0.6555
	Path Entropy:  1.9664
		Step 1:  0.1139
		Step 2:  0.9528
		Step 3:  0.8996
Reasoning Diagnostics (Top-Rollout)
	Special Step Rate:  0.1271
	Restart Rate:  0.0000
	No-Op Rate:  0.1271
	Cycle Rate:  0.1562
	Backtrack Rate:  0.1429
	Unique Edges:  2.2043
	Redundancy:  0.1445
	Avg Segment Hops:  2.6188
Answer(s) Endpoint Coverage Metrics
	Recall:  0.9859
	Precision:  0.1903
	F1 Score:  0.2513

Score for iteration 10500
Answer Metrics
	Hits@1:  0.8783
	Hits@3:  0.9829
	Hits@5:  0.9911
	Hits@10:  0.9952
	Hits@20:  0.9969
	MRR:  0.9309
Per Hop Answer Metrics
	3-Hop
		Hits@1:  0.8744
		MRR:  0.9276
	1-Hop
		Hits@1:  0.8942
		MRR:  0.9354
	2-Hop
		Hits@1:  0.8714
		MRR:  0.9309
Valid Action Count at Each Step
	Overall Average: 32.0185
		Step 1:  8.5170
		Step 2: 42.6126
		Step 3: 44.9260
Entropy Metrics
	Question Entropy:  0.6552
	Path Entropy:  1.9657
		Step 1:  0.1122
		Step 2:  0.9715
		Step 3:  0.8820
Reasoning Diagnostics (Top-Rollout)
	Special Step Rate:  0.1268
	Restart Rate:  0.0000
	No-Op Rate:  0.1268
	Cycle Rate:  0.1576
	Backtrack Rate:  0.1445
	Unique Edges:  2.2005
	Redundancy:  0.1462
	Avg Segment Hops:  2.6197
Answer(s) Endpoint Coverage Metrics
	Recall:  0.9862
	Precision:  0.1935
	F1 Score:  0.2550

Score for iteration 11000
Answer Metrics
	Hits@1:  0.8816
	Hits@3:  0.9832
	Hits@5:  0.9914
	Hits@10:  0.9957
	Hits@20:  0.9972
	MRR:  0.9329
Per Hop Answer Metrics
	3-Hop
		Hits@1:  0.8795
		MRR:  0.9308
	1-Hop
		Hits@1:  0.8947
		MRR:  0.9362
	2-Hop
		Hits@1:  0.8748
		MRR:  0.9326
Valid Action Count at Each Step
	Overall Average: 31.9374
		Step 1:  8.5170
		Step 2: 42.6400
		Step 3: 44.6551
Entropy Metrics
	Question Entropy:  0.6555
	Path Entropy:  1.9664
		Step 1:  0.1086
		Step 2:  0.9787
		Step 3:  0.8791
Reasoning Diagnostics (Top-Rollout)
	Special Step Rate:  0.1267
	Restart Rate:  0.0000
	No-Op Rate:  0.1267
	Cycle Rate:  0.1554
	Backtrack Rate:  0.1422
	Unique Edges:  2.2070
	Redundancy:  0.1439
	Avg Segment Hops:  2.6199
Answer(s) Endpoint Coverage Metrics
	Recall:  0.9869
	Precision:  0.1965
	F1 Score:  0.2587

Score for iteration 11500
Answer Metrics
	Hits@1:  0.8819
	Hits@3:  0.9831
	Hits@5:  0.9909
	Hits@10:  0.9956
	Hits@20:  0.9972
	MRR:  0.9329
Per Hop Answer Metrics
	3-Hop
		Hits@1:  0.8766
		MRR:  0.9291
	1-Hop
		Hits@1:  0.8977
		MRR:  0.9376
	2-Hop
		Hits@1:  0.8765
		MRR:  0.9335
Valid Action Count at Each Step
	Overall Average: 32.7771
		Step 1:  8.5170
		Step 2: 43.9100
		Step 3: 45.9045
Entropy Metrics
	Question Entropy:  0.6601
	Path Entropy:  1.9803
		Step 1:  0.1095
		Step 2:  0.9751
		Step 3:  0.8957
Reasoning Diagnostics (Top-Rollout)
	Special Step Rate:  0.1264
	Restart Rate:  0.0000
	No-Op Rate:  0.1264
	Cycle Rate:  0.1566
	Backtrack Rate:  0.1441
	Unique Edges:  2.2035
	Redundancy:  0.1451
	Avg Segment Hops:  2.6207
Answer(s) Endpoint Coverage Metrics
	Recall:  0.9861
	Precision:  0.1981
	F1 Score:  0.2594

Score for iteration 12000
Answer Metrics
	Hits@1:  0.8819
	Hits@3:  0.9829
	Hits@5:  0.9906
	Hits@10:  0.9955
	Hits@20:  0.9971
	MRR:  0.9328
Per Hop Answer Metrics
	3-Hop
		Hits@1:  0.8787
		MRR:  0.9300
	1-Hop
		Hits@1:  0.8943
		MRR:  0.9356
	2-Hop
		Hits@1:  0.8766
		MRR:  0.9338
Valid Action Count at Each Step
	Overall Average: 31.9127
		Step 1:  8.5170
		Step 2: 42.2918
		Step 3: 44.9292
Entropy Metrics
	Question Entropy:  0.6258
	Path Entropy:  1.8773
		Step 1:  0.1069
		Step 2:  0.9194
		Step 3:  0.8511
Reasoning Diagnostics (Top-Rollout)
	Special Step Rate:  0.1267
	Restart Rate:  0.0000
	No-Op Rate:  0.1267
	Cycle Rate:  0.1548
	Backtrack Rate:  0.1420
	Unique Edges:  2.2077
	Redundancy:  0.1435
	Avg Segment Hops:  2.6198
Answer(s) Endpoint Coverage Metrics
	Recall:  0.9862
	Precision:  0.1908
	F1 Score:  0.2518

Score for iteration 12500
Answer Metrics
	Hits@1:  0.8851
	Hits@3:  0.9835
	Hits@5:  0.9911
	Hits@10:  0.9954
	Hits@20:  0.9972
	MRR:  0.9347
Per Hop Answer Metrics
	3-Hop
		Hits@1:  0.8827
		MRR:  0.9324
	1-Hop
		Hits@1:  0.8951
		MRR:  0.9361
	2-Hop
		Hits@1:  0.8808
		MRR:  0.9359
Valid Action Count at Each Step
	Overall Average: 31.7394
		Step 1:  8.5170
		Step 2: 41.9441
		Step 3: 44.7570
Entropy Metrics
	Question Entropy:  0.6172
	Path Entropy:  1.8516
		Step 1:  0.1013
		Step 2:  0.9076
		Step 3:  0.8427
Reasoning Diagnostics (Top-Rollout)
	Special Step Rate:  0.1269
	Restart Rate:  0.0000
	No-Op Rate:  0.1269
	Cycle Rate:  0.1539
	Backtrack Rate:  0.1410
	Unique Edges:  2.2094
	Redundancy:  0.1424
	Avg Segment Hops:  2.6192
Answer(s) Endpoint Coverage Metrics
	Recall:  0.9870
	Precision:  0.1912
	F1 Score:  0.2524

Score for iteration 13000
Answer Metrics
	Hits@1:  0.8852
	Hits@3:  0.9836
	Hits@5:  0.9918
	Hits@10:  0.9957
	Hits@20:  0.9973
	MRR:  0.9349
Per Hop Answer Metrics
	3-Hop
		Hits@1:  0.8822
		MRR:  0.9326
	1-Hop
		Hits@1:  0.8969
		MRR:  0.9374
	2-Hop
		Hits@1:  0.8801
		MRR:  0.9354
Valid Action Count at Each Step
	Overall Average: 32.6323
		Step 1:  8.5170
		Step 2: 42.9376
		Step 3: 46.4423
Entropy Metrics
	Question Entropy:  0.6214
	Path Entropy:  1.8642
		Step 1:  0.1018
		Step 2:  0.9011
		Step 3:  0.8612
Reasoning Diagnostics (Top-Rollout)
	Special Step Rate:  0.1267
	Restart Rate:  0.0000
	No-Op Rate:  0.1267
	Cycle Rate:  0.1539
	Backtrack Rate:  0.1413
	Unique Edges:  2.2104
	Redundancy:  0.1424
	Avg Segment Hops:  2.6200
Answer(s) Endpoint Coverage Metrics
	Recall:  0.9857
	Precision:  0.1948
	F1 Score:  0.2556

Score for iteration 13500
Answer Metrics
	Hits@1:  0.8838
	Hits@3:  0.9822
	Hits@5:  0.9899
	Hits@10:  0.9949
	Hits@20:  0.9969
	MRR:  0.9335
Per Hop Answer Metrics
	3-Hop
		Hits@1:  0.8834
		MRR:  0.9325
	1-Hop
		Hits@1:  0.8956
		MRR:  0.9367
	2-Hop
		Hits@1:  0.8763
		MRR:  0.9324
Valid Action Count at Each Step
	Overall Average: 32.4103
		Step 1:  8.5170
		Step 2: 43.1017
		Step 3: 45.6123
Entropy Metrics
	Question Entropy:  0.6170
	Path Entropy:  1.8510
		Step 1:  0.0997
		Step 2:  0.9203
		Step 3:  0.8309
Reasoning Diagnostics (Top-Rollout)
	Special Step Rate:  0.1260
	Restart Rate:  0.0000
	No-Op Rate:  0.1260
	Cycle Rate:  0.1537
	Backtrack Rate:  0.1414
	Unique Edges:  2.2107
	Redundancy:  0.1429
	Avg Segment Hops:  2.6221
Answer(s) Endpoint Coverage Metrics
	Recall:  0.9860
	Precision:  0.1887
	F1 Score:  0.2499

Score for iteration 14000
Answer Metrics
	Hits@1:  0.8869
	Hits@3:  0.9840
	Hits@5:  0.9917
	Hits@10:  0.9959
	Hits@20:  0.9974
	MRR:  0.9358
Per Hop Answer Metrics
	3-Hop
		Hits@1:  0.8847
		MRR:  0.9338
	1-Hop
		Hits@1:  0.8985
		MRR:  0.9379
	2-Hop
		Hits@1:  0.8812
		MRR:  0.9364
Valid Action Count at Each Step
	Overall Average: 31.8537
		Step 1:  8.5170
		Step 2: 42.3088
		Step 3: 44.7354
Entropy Metrics
	Question Entropy:  0.6040
	Path Entropy:  1.8119
		Step 1:  0.1002
		Step 2:  0.9063
		Step 3:  0.8055
Reasoning Diagnostics (Top-Rollout)
	Special Step Rate:  0.1265
	Restart Rate:  0.0000
	No-Op Rate:  0.1265
	Cycle Rate:  0.1539
	Backtrack Rate:  0.1420
	Unique Edges:  2.2087
	Redundancy:  0.1432
	Avg Segment Hops:  2.6204
Answer(s) Endpoint Coverage Metrics
	Recall:  0.9878
	Precision:  0.1909
	F1 Score:  0.2522

Score for iteration 14500
Answer Metrics
	Hits@1:  0.8892
	Hits@3:  0.9844
	Hits@5:  0.9920
	Hits@10:  0.9957
	Hits@20:  0.9972
	MRR:  0.9372
Per Hop Answer Metrics
	3-Hop
		Hits@1:  0.8879
		MRR:  0.9357
	1-Hop
		Hits@1:  0.8975
		MRR:  0.9374
	2-Hop
		Hits@1:  0.8849
		MRR:  0.9385
Valid Action Count at Each Step
	Overall Average: 31.1760
		Step 1:  8.5170
		Step 2: 40.7990
		Step 3: 44.2119
Entropy Metrics
	Question Entropy:  0.5971
	Path Entropy:  1.7913
		Step 1:  0.0975
		Step 2:  0.8880
		Step 3:  0.8059
Reasoning Diagnostics (Top-Rollout)
	Special Step Rate:  0.1268
	Restart Rate:  0.0000
	No-Op Rate:  0.1268
	Cycle Rate:  0.1517
	Backtrack Rate:  0.1403
	Unique Edges:  2.2123
	Redundancy:  0.1415
	Avg Segment Hops:  2.6196
Answer(s) Endpoint Coverage Metrics
	Recall:  0.9876
	Precision:  0.1887
	F1 Score:  0.2491

Score for iteration 15000
Answer Metrics
	Hits@1:  0.8908
	Hits@3:  0.9839
	Hits@5:  0.9917
	Hits@10:  0.9956
	Hits@20:  0.9969
	MRR:  0.9380
Per Hop Answer Metrics
	3-Hop
		Hits@1:  0.8904
		MRR:  0.9375
	1-Hop
		Hits@1:  0.8995
		MRR:  0.9382
	2-Hop
		Hits@1:  0.8854
		MRR:  0.9383
Valid Action Count at Each Step
	Overall Average: 31.8949
		Step 1:  8.5170
		Step 2: 42.8180
		Step 3: 44.3497
Entropy Metrics
	Question Entropy:  0.6051
	Path Entropy:  1.8154
		Step 1:  0.0960
		Step 2:  0.9220
		Step 3:  0.7974
Reasoning Diagnostics (Top-Rollout)
	Special Step Rate:  0.1264
	Restart Rate:  0.0000
	No-Op Rate:  0.1264
	Cycle Rate:  0.1517
	Backtrack Rate:  0.1399
	Unique Edges:  2.2146
	Redundancy:  0.1410
	Avg Segment Hops:  2.6209
Answer(s) Endpoint Coverage Metrics
	Recall:  0.9869
	Precision:  0.1931
	F1 Score:  0.2542

Test (beam) scores with best model from output/metaqa/qa_nhop_reason_3hop_seed0/model/model.ckpt
Answer Metrics
	Hits@1:  0.8967
	Hits@3:  0.9847
	Hits@5:  0.9922
	Hits@10:  0.9964
	Hits@20:  0.9979
	MRR:  0.9414
Per Hop Answer Metrics
	3-Hop
		Hits@1:  0.8994
		MRR:  0.9423
	2-Hop
		Hits@1:  0.8876
		MRR:  0.9395
	1-Hop
		Hits@1:  0.9064
		MRR:  0.9429
Valid Action Count at Each Step
	Overall Average: 31.9374
		Step 1:  8.5566
		Step 2: 42.5323
		Step 3: 44.7234
Entropy Metrics
	Question Entropy:  0.6065
	Path Entropy:  1.8195
		Step 1:  0.0965
		Step 2:  0.9188
		Step 3:  0.8041
Reasoning Diagnostics (Top-Rollout)
	Special Step Rate:  0.1263
	Restart Rate:  0.0000
	No-Op Rate:  0.1263
	Cycle Rate:  0.1520
	Backtrack Rate:  0.1399
	Unique Edges:  2.2142
	Redundancy:  0.1411
	Avg Segment Hops:  2.6211
Answer(s) Endpoint Coverage Metrics
	Recall:  0.9865
	Precision:  0.1954
	F1 Score:  0.2565

