Score for iteration 500
Answer Metrics
	Hits@1:  0.6487
	Hits@3:  0.8067
	Hits@5:  0.8358
	Hits@10:  0.8642
	Hits@20:  0.8870
	MRR:  0.7350
Per Hop Answer Metrics
	3-Hop
		Hits@1:  0.5621
		MRR:  0.6957
	1-Hop
		Hits@1:  0.7938
		MRR:  0.8406
	2-Hop
		Hits@1:  0.6341
		MRR:  0.7018
Valid Action Count at Each Step
	Overall Average: 28.9228
		Step 1:  8.5170
		Step 2: 40.6226
		Step 3: 37.6287
Entropy Metrics
	Question Entropy:  1.4133
	Path Entropy:  4.2398
		Step 1:  0.5568
		Step 2:  2.1323
		Step 3:  1.5507
Reasoning Diagnostics (Top-Rollout)
	Special Step Rate:  0.1000
	Restart Rate:  0.0000
	No-Op Rate:  0.1000
	Cycle Rate:  0.2302
	Backtrack Rate:  0.1875
	Unique Edges:  2.1342
	Redundancy:  0.1932
	Avg Segment Hops:  2.7000
Answer(s) Endpoint Coverage Metrics
	Recall:  0.8561
	Precision:  0.1651
	F1 Score:  0.2110

Score for iteration 1000
Answer Metrics
	Hits@1:  0.6777
	Hits@3:  0.8189
	Hits@5:  0.8442
	Hits@10:  0.8716
	Hits@20:  0.8938
	MRR:  0.7555
Per Hop Answer Metrics
	3-Hop
		Hits@1:  0.6286
		MRR:  0.7396
	1-Hop
		Hits@1:  0.7891
		MRR:  0.8464
	2-Hop
		Hits@1:  0.6499
		MRR:  0.7097
Valid Action Count at Each Step
	Overall Average: 29.9732
		Step 1:  8.5170
		Step 2: 42.2532
		Step 3: 39.1495
Entropy Metrics
	Question Entropy:  1.2232
	Path Entropy:  3.6695
		Step 1:  0.4036
		Step 2:  1.8601
		Step 3:  1.4058
Reasoning Diagnostics (Top-Rollout)
	Special Step Rate:  0.0988
	Restart Rate:  0.0000
	No-Op Rate:  0.0988
	Cycle Rate:  0.2131
	Backtrack Rate:  0.1984
	Unique Edges:  2.1199
	Redundancy:  0.1996
	Avg Segment Hops:  2.7036
Answer(s) Endpoint Coverage Metrics
	Recall:  0.8651
	Precision:  0.1640
	F1 Score:  0.2117

Score for iteration 1500
Answer Metrics
	Hits@1:  0.7041
	Hits@3:  0.8419
	Hits@5:  0.8663
	Hits@10:  0.8886
	Hits@20:  0.9064
	MRR:  0.7790
Per Hop Answer Metrics
	3-Hop
		Hits@1:  0.6615
		MRR:  0.7642
	1-Hop
		Hits@1:  0.8381
		MRR:  0.8976
	2-Hop
		Hits@1:  0.6551
		MRR:  0.7136
Valid Action Count at Each Step
	Overall Average: 29.3066
		Step 1:  8.5170
		Step 2: 41.3173
		Step 3: 38.0855
Entropy Metrics
	Question Entropy:  1.1249
	Path Entropy:  3.3747
		Step 1:  0.3367
		Step 2:  1.7137
		Step 3:  1.3243
Reasoning Diagnostics (Top-Rollout)
	Special Step Rate:  0.0988
	Restart Rate:  0.0000
	No-Op Rate:  0.0988
	Cycle Rate:  0.2015
	Backtrack Rate:  0.1798
	Unique Edges:  2.1732
	Redundancy:  0.1812
	Avg Segment Hops:  2.7035
Answer(s) Endpoint Coverage Metrics
	Recall:  0.8844
	Precision:  0.1606
	F1 Score:  0.2128

Score for iteration 2000
Answer Metrics
	Hits@1:  0.7188
	Hits@3:  0.8515
	Hits@5:  0.8734
	Hits@10:  0.8947
	Hits@20:  0.9102
	MRR:  0.7906
Per Hop Answer Metrics
	3-Hop
		Hits@1:  0.6936
		MRR:  0.7901
	1-Hop
		Hits@1:  0.8377
		MRR:  0.8978
	2-Hop
		Hits@1:  0.6631
		MRR:  0.7190
Valid Action Count at Each Step
	Overall Average: 29.8277
		Step 1:  8.5170
		Step 2: 42.0647
		Step 3: 38.9014
Entropy Metrics
	Question Entropy:  1.0667
	Path Entropy:  3.2002
		Step 1:  0.2874
		Step 2:  1.6224
		Step 3:  1.2904
Reasoning Diagnostics (Top-Rollout)
	Special Step Rate:  0.0988
	Restart Rate:  0.0000
	No-Op Rate:  0.0988
	Cycle Rate:  0.1969
	Backtrack Rate:  0.1777
	Unique Edges:  2.1817
	Redundancy:  0.1785
	Avg Segment Hops:  2.7036
Answer(s) Endpoint Coverage Metrics
	Recall:  0.8946
	Precision:  0.1654
	F1 Score:  0.2185

Score for iteration 2500
Answer Metrics
	Hits@1:  0.7444
	Hits@3:  0.8719
	Hits@5:  0.8924
	Hits@10:  0.9084
	Hits@20:  0.9197
	MRR:  0.8124
Per Hop Answer Metrics
	3-Hop
		Hits@1:  0.7449
		MRR:  0.8389
	1-Hop
		Hits@1:  0.8539
		MRR:  0.9087
	2-Hop
		Hits@1:  0.6703
		MRR:  0.7223
Valid Action Count at Each Step
	Overall Average: 28.4248
		Step 1:  8.5170
		Step 2: 39.0235
		Step 3: 37.7338
Entropy Metrics
	Question Entropy:  1.0322
	Path Entropy:  3.0965
		Step 1:  0.2909
		Step 2:  1.5666
		Step 3:  1.2390
Reasoning Diagnostics (Top-Rollout)
	Special Step Rate:  0.0988
	Restart Rate:  0.0000
	No-Op Rate:  0.0988
	Cycle Rate:  0.1922
	Backtrack Rate:  0.1755
	Unique Edges:  2.1888
	Redundancy:  0.1761
	Avg Segment Hops:  2.7036
Answer(s) Endpoint Coverage Metrics
	Recall:  0.9093
	Precision:  0.1631
	F1 Score:  0.2183

Score for iteration 3000
Answer Metrics
	Hits@1:  0.7663
	Hits@3:  0.8900
	Hits@5:  0.9035
	Hits@10:  0.9137
	Hits@20:  0.9220
	MRR:  0.8302
Per Hop Answer Metrics
	3-Hop
		Hits@1:  0.7974
		MRR:  0.8821
	1-Hop
		Hits@1:  0.8578
		MRR:  0.9115
	2-Hop
		Hits@1:  0.6750
		MRR:  0.7259
Valid Action Count at Each Step
	Overall Average: 30.6728
		Step 1:  8.5170
		Step 2: 42.6260
		Step 3: 40.8754
Entropy Metrics
	Question Entropy:  0.9868
	Path Entropy:  2.9605
		Step 1:  0.2552
		Step 2:  1.4958
		Step 3:  1.2095
Reasoning Diagnostics (Top-Rollout)
	Special Step Rate:  0.0988
	Restart Rate:  0.0000
	No-Op Rate:  0.0988
	Cycle Rate:  0.1802
	Backtrack Rate:  0.1651
	Unique Edges:  2.2205
	Redundancy:  0.1655
	Avg Segment Hops:  2.7037
Answer(s) Endpoint Coverage Metrics
	Recall:  0.9133
	Precision:  0.1800
	F1 Score:  0.2330

Score for iteration 3500
Answer Metrics
	Hits@1:  0.7760
	Hits@3:  0.8905
	Hits@5:  0.9043
	Hits@10:  0.9145
	Hits@20:  0.9247
	MRR:  0.8358
Per Hop Answer Metrics
	3-Hop
		Hits@1:  0.8150
		MRR:  0.8922
	1-Hop
		Hits@1:  0.8644
		MRR:  0.9154
	2-Hop
		Hits@1:  0.6791
		MRR:  0.7281
Valid Action Count at Each Step
	Overall Average: 30.4997
		Step 1:  8.5170
		Step 2: 41.5408
		Step 3: 41.4412
Entropy Metrics
	Question Entropy:  0.9254
	Path Entropy:  2.7761
		Step 1:  0.2281
		Step 2:  1.3955
		Step 3:  1.1525
Reasoning Diagnostics (Top-Rollout)
	Special Step Rate:  0.0989
	Restart Rate:  0.0000
	No-Op Rate:  0.0989
	Cycle Rate:  0.1780
	Backtrack Rate:  0.1621
	Unique Edges:  2.2284
	Redundancy:  0.1625
	Avg Segment Hops:  2.7034
Answer(s) Endpoint Coverage Metrics
	Recall:  0.9178
	Precision:  0.1786
	F1 Score:  0.2316

Score for iteration 4000
Answer Metrics
	Hits@1:  0.7817
	Hits@3:  0.8917
	Hits@5:  0.9050
	Hits@10:  0.9152
	Hits@20:  0.9240
	MRR:  0.8391
Per Hop Answer Metrics
	3-Hop
		Hits@1:  0.8253
		MRR:  0.8982
	1-Hop
		Hits@1:  0.8704
		MRR:  0.9201
	2-Hop
		Hits@1:  0.6802
		MRR:  0.7280
Valid Action Count at Each Step
	Overall Average: 29.7469
		Step 1:  8.5170
		Step 2: 39.5591
		Step 3: 41.1645
Entropy Metrics
	Question Entropy:  0.8711
	Path Entropy:  2.6133
		Step 1:  0.2035
		Step 2:  1.3126
		Step 3:  1.0972
Reasoning Diagnostics (Top-Rollout)
	Special Step Rate:  0.0988
	Restart Rate:  0.0000
	No-Op Rate:  0.0988
	Cycle Rate:  0.1781
	Backtrack Rate:  0.1631
	Unique Edges:  2.2261
	Redundancy:  0.1632
	Avg Segment Hops:  2.7035
Answer(s) Endpoint Coverage Metrics
	Recall:  0.9201
	Precision:  0.1690
	F1 Score:  0.2241

Score for iteration 4500
Answer Metrics
	Hits@1:  0.7882
	Hits@3:  0.9012
	Hits@5:  0.9148
	Hits@10:  0.9260
	Hits@20:  0.9369
	MRR:  0.8475
Per Hop Answer Metrics
	3-Hop
		Hits@1:  0.8305
		MRR:  0.9020
	1-Hop
		Hits@1:  0.8765
		MRR:  0.9250
	2-Hop
		Hits@1:  0.6884
		MRR:  0.7432
Valid Action Count at Each Step
	Overall Average: 31.1529
		Step 1:  8.5170
		Step 2: 41.2361
		Step 3: 43.7058
Entropy Metrics
	Question Entropy:  0.8728
	Path Entropy:  2.6183
		Step 1:  0.1934
		Step 2:  1.3295
		Step 3:  1.0954
Reasoning Diagnostics (Top-Rollout)
	Special Step Rate:  0.1016
	Restart Rate:  0.0000
	No-Op Rate:  0.1016
	Cycle Rate:  0.1756
	Backtrack Rate:  0.1591
	Unique Edges:  2.2312
	Redundancy:  0.1592
	Avg Segment Hops:  2.6952
Answer(s) Endpoint Coverage Metrics
	Recall:  0.9329
	Precision:  0.1774
	F1 Score:  0.2332

Score for iteration 5000
Answer Metrics
	Hits@1:  0.8035
	Hits@3:  0.9118
	Hits@5:  0.9240
	Hits@10:  0.9346
	Hits@20:  0.9446
	MRR:  0.8601
Per Hop Answer Metrics
	3-Hop
		Hits@1:  0.8432
		MRR:  0.9098
	1-Hop
		Hits@1:  0.8848
		MRR:  0.9302
	2-Hop
		Hits@1:  0.7109
		MRR:  0.7654
Valid Action Count at Each Step
	Overall Average: 30.6008
		Step 1:  8.5170
		Step 2: 41.6303
		Step 3: 41.6551
Entropy Metrics
	Question Entropy:  0.8356
	Path Entropy:  2.5067
		Step 1:  0.1761
		Step 2:  1.3022
		Step 3:  1.0283
Reasoning Diagnostics (Top-Rollout)
	Special Step Rate:  0.1037
	Restart Rate:  0.0000
	No-Op Rate:  0.1037
	Cycle Rate:  0.1752
	Backtrack Rate:  0.1599
	Unique Edges:  2.2227
	Redundancy:  0.1600
	Avg Segment Hops:  2.6888
Answer(s) Endpoint Coverage Metrics
	Recall:  0.9415
	Precision:  0.1792
	F1 Score:  0.2372

Score for iteration 5500
Answer Metrics
	Hits@1:  0.8114
	Hits@3:  0.9169
	Hits@5:  0.9303
	Hits@10:  0.9416
	Hits@20:  0.9509
	MRR:  0.8670
Per Hop Answer Metrics
	3-Hop
		Hits@1:  0.8524
		MRR:  0.9153
	1-Hop
		Hits@1:  0.8846
		MRR:  0.9297
	2-Hop
		Hits@1:  0.7230
		MRR:  0.7784
Valid Action Count at Each Step
	Overall Average: 30.1467
		Step 1:  8.5170
		Step 2: 40.4799
		Step 3: 41.4431
Entropy Metrics
	Question Entropy:  0.8097
	Path Entropy:  2.4290
		Step 1:  0.1681
		Step 2:  1.2650
		Step 3:  0.9959
Reasoning Diagnostics (Top-Rollout)
	Special Step Rate:  0.1062
	Restart Rate:  0.0000
	No-Op Rate:  0.1062
	Cycle Rate:  0.1713
	Backtrack Rate:  0.1570
	Unique Edges:  2.2243
	Redundancy:  0.1572
	Avg Segment Hops:  2.6813
Answer(s) Endpoint Coverage Metrics
	Recall:  0.9474
	Precision:  0.1776
	F1 Score:  0.2364

Score for iteration 6000
Answer Metrics
	Hits@1:  0.8193
	Hits@3:  0.9264
	Hits@5:  0.9382
	Hits@10:  0.9461
	Hits@20:  0.9545
	MRR:  0.8750
Per Hop Answer Metrics
	3-Hop
		Hits@1:  0.8541
		MRR:  0.9168
	1-Hop
		Hits@1:  0.8877
		MRR:  0.9324
	2-Hop
		Hits@1:  0.7400
		MRR:  0.7964
Valid Action Count at Each Step
	Overall Average: 30.5779
		Step 1:  8.5170
		Step 2: 40.6790
		Step 3: 42.5376
Entropy Metrics
	Question Entropy:  0.8147
	Path Entropy:  2.4442
		Step 1:  0.1612
		Step 2:  1.2773
		Step 3:  1.0056
Reasoning Diagnostics (Top-Rollout)
	Special Step Rate:  0.1095
	Restart Rate:  0.0000
	No-Op Rate:  0.1095
	Cycle Rate:  0.1694
	Backtrack Rate:  0.1554
	Unique Edges:  2.2206
	Redundancy:  0.1555
	Avg Segment Hops:  2.6715
Answer(s) Endpoint Coverage Metrics
	Recall:  0.9519
	Precision:  0.1776
	F1 Score:  0.2371

Score for iteration 6500
Answer Metrics
	Hits@1:  0.8433
	Hits@3:  0.9580
	Hits@5:  0.9724
	Hits@10:  0.9829
	Hits@20:  0.9895
	MRR:  0.9030
Per Hop Answer Metrics
	3-Hop
		Hits@1:  0.8520
		MRR:  0.9152
	1-Hop
		Hits@1:  0.8926
		MRR:  0.9353
	2-Hop
		Hits@1:  0.8020
		MRR:  0.8695
Valid Action Count at Each Step
	Overall Average: 30.2846
		Step 1:  8.5170
		Step 2: 38.5580
		Step 3: 43.7789
Entropy Metrics
	Question Entropy:  0.7789
	Path Entropy:  2.3367
		Step 1:  0.1543
		Step 2:  1.2178
		Step 3:  0.9647
Reasoning Diagnostics (Top-Rollout)
	Special Step Rate:  0.1223
	Restart Rate:  0.0000
	No-Op Rate:  0.1223
	Cycle Rate:  0.1665
	Backtrack Rate:  0.1528
	Unique Edges:  2.1923
	Redundancy:  0.1533
	Avg Segment Hops:  2.6331
Answer(s) Endpoint Coverage Metrics
	Recall:  0.9791
	Precision:  0.1791
	F1 Score:  0.2407

Score for iteration 7000
Answer Metrics
	Hits@1:  0.8748
	Hits@3:  0.9815
	Hits@5:  0.9910
	Hits@10:  0.9960
	Hits@20:  0.9978
	MRR:  0.9288
Per Hop Answer Metrics
	3-Hop
		Hits@1:  0.8679
		MRR:  0.9244
	1-Hop
		Hits@1:  0.8910
		MRR:  0.9343
	2-Hop
		Hits@1:  0.8705
		MRR:  0.9293
Valid Action Count at Each Step
	Overall Average: 29.9102
		Step 1:  8.5170
		Step 2: 38.7362
		Step 3: 42.4774
Entropy Metrics
	Question Entropy:  0.7504
	Path Entropy:  2.2511
		Step 1:  0.1415
		Step 2:  1.1600
		Step 3:  0.9497
Reasoning Diagnostics (Top-Rollout)
	Special Step Rate:  0.1279
	Restart Rate:  0.0000
	No-Op Rate:  0.1279
	Cycle Rate:  0.1580
	Backtrack Rate:  0.1457
	Unique Edges:  2.1980
	Redundancy:  0.1457
	Avg Segment Hops:  2.6164
Answer(s) Endpoint Coverage Metrics
	Recall:  0.9887
	Precision:  0.1852
	F1 Score:  0.2486

Score for iteration 7500
Answer Metrics
	Hits@1:  0.8785
	Hits@3:  0.9836
	Hits@5:  0.9921
	Hits@10:  0.9963
	Hits@20:  0.9980
	MRR:  0.9312
Per Hop Answer Metrics
	3-Hop
		Hits@1:  0.8704
		MRR:  0.9260
	1-Hop
		Hits@1:  0.8953
		MRR:  0.9369
	2-Hop
		Hits@1:  0.8749
		MRR:  0.9325
Valid Action Count at Each Step
	Overall Average: 30.3648
		Step 1:  8.5170
		Step 2: 39.9861
		Step 3: 42.5912
Entropy Metrics
	Question Entropy:  0.7278
	Path Entropy:  2.1835
		Step 1:  0.1308
		Step 2:  1.1399
		Step 3:  0.9128
Reasoning Diagnostics (Top-Rollout)
	Special Step Rate:  0.1290
	Restart Rate:  0.0000
	No-Op Rate:  0.1290
	Cycle Rate:  0.1578
	Backtrack Rate:  0.1456
	Unique Edges:  2.1953
	Redundancy:  0.1456
	Avg Segment Hops:  2.6131
Answer(s) Endpoint Coverage Metrics
	Recall:  0.9892
	Precision:  0.1876
	F1 Score:  0.2509

Score for iteration 8000
Answer Metrics
	Hits@1:  0.8801
	Hits@3:  0.9843
	Hits@5:  0.9921
	Hits@10:  0.9963
	Hits@20:  0.9979
	MRR:  0.9324
Per Hop Answer Metrics
	3-Hop
		Hits@1:  0.8721
		MRR:  0.9272
	1-Hop
		Hits@1:  0.8986
		MRR:  0.9390
	2-Hop
		Hits@1:  0.8754
		MRR:  0.9331
Valid Action Count at Each Step
	Overall Average: 29.9438
		Step 1:  8.5170
		Step 2: 39.2656
		Step 3: 42.0489
Entropy Metrics
	Question Entropy:  0.7145
	Path Entropy:  2.1434
		Step 1:  0.1239
		Step 2:  1.1257
		Step 3:  0.8938
Reasoning Diagnostics (Top-Rollout)
	Special Step Rate:  0.1288
	Restart Rate:  0.0000
	No-Op Rate:  0.1288
	Cycle Rate:  0.1580
	Backtrack Rate:  0.1460
	Unique Edges:  2.1946
	Redundancy:  0.1461
	Avg Segment Hops:  2.6137
Answer(s) Endpoint Coverage Metrics
	Recall:  0.9892
	Precision:  0.1853
	F1 Score:  0.2479

Score for iteration 8500
Answer Metrics
	Hits@1:  0.8816
	Hits@3:  0.9842
	Hits@5:  0.9927
	Hits@10:  0.9965
	Hits@20:  0.9980
	MRR:  0.9333
Per Hop Answer Metrics
	3-Hop
		Hits@1:  0.8730
		MRR:  0.9279
	1-Hop
		Hits@1:  0.8995
		MRR:  0.9399
	2-Hop
		Hits@1:  0.8779
		MRR:  0.9342
Valid Action Count at Each Step
	Overall Average: 30.0354
		Step 1:  8.5170
		Step 2: 39.3486
		Step 3: 42.2405
Entropy Metrics
	Question Entropy:  0.6927
	Path Entropy:  2.0780
		Step 1:  0.1180
		Step 2:  1.0966
		Step 3:  0.8634
Reasoning Diagnostics (Top-Rollout)
	Special Step Rate:  0.1289
	Restart Rate:  0.0000
	No-Op Rate:  0.1289
	Cycle Rate:  0.1569
	Backtrack Rate:  0.1453
	Unique Edges:  2.1958
	Redundancy:  0.1454
	Avg Segment Hops:  2.6132
Answer(s) Endpoint Coverage Metrics
	Recall:  0.9892
	Precision:  0.1843
	F1 Score:  0.2469

Score for iteration 9000
Answer Metrics
	Hits@1:  0.8833
	Hits@3:  0.9850
	Hits@5:  0.9926
	Hits@10:  0.9966
	Hits@20:  0.9982
	MRR:  0.9343
Per Hop Answer Metrics
	3-Hop
		Hits@1:  0.8763
		MRR:  0.9297
	1-Hop
		Hits@1:  0.8981
		MRR:  0.9389
	2-Hop
		Hits@1:  0.8800
		MRR:  0.9356
Valid Action Count at Each Step
	Overall Average: 29.9050
		Step 1:  8.5170
		Step 2: 39.2505
		Step 3: 41.9476
Entropy Metrics
	Question Entropy:  0.6598
	Path Entropy:  1.9794
		Step 1:  0.1122
		Step 2:  1.0539
		Step 3:  0.8133
Reasoning Diagnostics (Top-Rollout)
	Special Step Rate:  0.1297
	Restart Rate:  0.0000
	No-Op Rate:  0.1297
	Cycle Rate:  0.1554
	Backtrack Rate:  0.1441
	Unique Edges:  2.1969
	Redundancy:  0.1442
	Avg Segment Hops:  2.6109
Answer(s) Endpoint Coverage Metrics
	Recall:  0.9888
	Precision:  0.1836
	F1 Score:  0.2465

Score for iteration 9500
Answer Metrics
	Hits@1:  0.8848
	Hits@3:  0.9848
	Hits@5:  0.9926
	Hits@10:  0.9966
	Hits@20:  0.9980
	MRR:  0.9351
Per Hop Answer Metrics
	3-Hop
		Hits@1:  0.8762
		MRR:  0.9297
	1-Hop
		Hits@1:  0.9026
		MRR:  0.9410
	2-Hop
		Hits@1:  0.8810
		MRR:  0.9364
Valid Action Count at Each Step
	Overall Average: 30.0065
		Step 1:  8.5170
		Step 2: 40.0426
		Step 3: 41.4599
Entropy Metrics
	Question Entropy:  0.6681
	Path Entropy:  2.0042
		Step 1:  0.1130
		Step 2:  1.0701
		Step 3:  0.8211
Reasoning Diagnostics (Top-Rollout)
	Special Step Rate:  0.1284
	Restart Rate:  0.0000
	No-Op Rate:  0.1284
	Cycle Rate:  0.1557
	Backtrack Rate:  0.1438
	Unique Edges:  2.2013
	Redundancy:  0.1439
	Avg Segment Hops:  2.6147
Answer(s) Endpoint Coverage Metrics
	Recall:  0.9889
	Precision:  0.1880
	F1 Score:  0.2509

Score for iteration 10000
Answer Metrics
	Hits@1:  0.8862
	Hits@3:  0.9851
	Hits@5:  0.9933
	Hits@10:  0.9966
	Hits@20:  0.9981
	MRR:  0.9360
Per Hop Answer Metrics
	3-Hop
		Hits@1:  0.8789
		MRR:  0.9315
	1-Hop
		Hits@1:  0.9027
		MRR:  0.9411
	2-Hop
		Hits@1:  0.8821
		MRR:  0.9370
Valid Action Count at Each Step
	Overall Average: 29.8171
		Step 1:  8.5170
		Step 2: 39.0037
		Step 3: 41.9305
Entropy Metrics
	Question Entropy:  0.6536
	Path Entropy:  1.9608
		Step 1:  0.1058
		Step 2:  1.0429
		Step 3:  0.8120
Reasoning Diagnostics (Top-Rollout)
	Special Step Rate:  0.1293
	Restart Rate:  0.0000
	No-Op Rate:  0.1293
	Cycle Rate:  0.1547
	Backtrack Rate:  0.1433
	Unique Edges:  2.2002
	Redundancy:  0.1433
	Avg Segment Hops:  2.6121
Answer(s) Endpoint Coverage Metrics
	Recall:  0.9894
	Precision:  0.1867
	F1 Score:  0.2494

Score for iteration 10500
Answer Metrics
	Hits@1:  0.8864
	Hits@3:  0.9844
	Hits@5:  0.9928
	Hits@10:  0.9967
	Hits@20:  0.9981
	MRR:  0.9360
Per Hop Answer Metrics
	3-Hop
		Hits@1:  0.8796
		MRR:  0.9316
	1-Hop
		Hits@1:  0.9036
		MRR:  0.9418
	2-Hop
		Hits@1:  0.8815
		MRR:  0.9365
Valid Action Count at Each Step
	Overall Average: 28.5143
		Step 1:  8.5170
		Step 2: 36.7697
		Step 3: 40.2563
Entropy Metrics
	Question Entropy:  0.6150
	Path Entropy:  1.8451
		Step 1:  0.1009
		Step 2:  0.9769
		Step 3:  0.7674
Reasoning Diagnostics (Top-Rollout)
	Special Step Rate:  0.1292
	Restart Rate:  0.0000
	No-Op Rate:  0.1292
	Cycle Rate:  0.1549
	Backtrack Rate:  0.1432
	Unique Edges:  2.2005
	Redundancy:  0.1433
	Avg Segment Hops:  2.6123
Answer(s) Endpoint Coverage Metrics
	Recall:  0.9894
	Precision:  0.1830
	F1 Score:  0.2452

Score for iteration 11000
Answer Metrics
	Hits@1:  0.8874
	Hits@3:  0.9854
	Hits@5:  0.9931
	Hits@10:  0.9967
	Hits@20:  0.9979
	MRR:  0.9369
Per Hop Answer Metrics
	3-Hop
		Hits@1:  0.8777
		MRR:  0.9309
	1-Hop
		Hits@1:  0.9073
		MRR:  0.9442
	2-Hop
		Hits@1:  0.8834
		MRR:  0.9377
Valid Action Count at Each Step
	Overall Average: 29.7730
		Step 1:  8.5170
		Step 2: 39.1960
		Step 3: 41.6058
Entropy Metrics
	Question Entropy:  0.6630
	Path Entropy:  1.9891
		Step 1:  0.1028
		Step 2:  1.0544
		Step 3:  0.8318
Reasoning Diagnostics (Top-Rollout)
	Special Step Rate:  0.1288
	Restart Rate:  0.0000
	No-Op Rate:  0.1288
	Cycle Rate:  0.1558
	Backtrack Rate:  0.1443
	Unique Edges:  2.1982
	Redundancy:  0.1444
	Avg Segment Hops:  2.6136
Answer(s) Endpoint Coverage Metrics
	Recall:  0.9905
	Precision:  0.1838
	F1 Score:  0.2464

Score for iteration 11500
Answer Metrics
	Hits@1:  0.8885
	Hits@3:  0.9859
	Hits@5:  0.9930
	Hits@10:  0.9964
	Hits@20:  0.9980
	MRR:  0.9375
Per Hop Answer Metrics
	3-Hop
		Hits@1:  0.8810
		MRR:  0.9327
	1-Hop
		Hits@1:  0.9055
		MRR:  0.9430
	2-Hop
		Hits@1:  0.8843
		MRR:  0.9385
Valid Action Count at Each Step
	Overall Average: 30.2498
		Step 1:  8.5170
		Step 2: 40.1847
		Step 3: 42.0476
Entropy Metrics
	Question Entropy:  0.6516
	Path Entropy:  1.9547
		Step 1:  0.0959
		Step 2:  1.0380
		Step 3:  0.8208
Reasoning Diagnostics (Top-Rollout)
	Special Step Rate:  0.1293
	Restart Rate:  0.0000
	No-Op Rate:  0.1293
	Cycle Rate:  0.1542
	Backtrack Rate:  0.1430
	Unique Edges:  2.2006
	Redundancy:  0.1430
	Avg Segment Hops:  2.6120
Answer(s) Endpoint Coverage Metrics
	Recall:  0.9894
	Precision:  0.1865
	F1 Score:  0.2484

Score for iteration 12000
Answer Metrics
	Hits@1:  0.8889
	Hits@3:  0.9861
	Hits@5:  0.9933
	Hits@10:  0.9966
	Hits@20:  0.9981
	MRR:  0.9377
Per Hop Answer Metrics
	3-Hop
		Hits@1:  0.8813
		MRR:  0.9332
	1-Hop
		Hits@1:  0.9054
		MRR:  0.9428
	2-Hop
		Hits@1:  0.8850
		MRR:  0.9387
Valid Action Count at Each Step
	Overall Average: 29.9841
		Step 1:  8.5170
		Step 2: 39.6173
		Step 3: 41.8180
Entropy Metrics
	Question Entropy:  0.6262
	Path Entropy:  1.8786
		Step 1:  0.0932
		Step 2:  0.9929
		Step 3:  0.7924
Reasoning Diagnostics (Top-Rollout)
	Special Step Rate:  0.1283
	Restart Rate:  0.0000
	No-Op Rate:  0.1283
	Cycle Rate:  0.1552
	Backtrack Rate:  0.1439
	Unique Edges:  2.2009
	Redundancy:  0.1439
	Avg Segment Hops:  2.6152
Answer(s) Endpoint Coverage Metrics
	Recall:  0.9892
	Precision:  0.1850
	F1 Score:  0.2468

Score for iteration 12500
Answer Metrics
	Hits@1:  0.8908
	Hits@3:  0.9854
	Hits@5:  0.9930
	Hits@10:  0.9962
	Hits@20:  0.9980
	MRR:  0.9385
Per Hop Answer Metrics
	3-Hop
		Hits@1:  0.8848
		MRR:  0.9348
	1-Hop
		Hits@1:  0.9070
		MRR:  0.9434
	2-Hop
		Hits@1:  0.8858
		MRR:  0.9387
Valid Action Count at Each Step
	Overall Average: 30.4042
		Step 1:  8.5170
		Step 2: 39.8783
		Step 3: 42.8174
Entropy Metrics
	Question Entropy:  0.6349
	Path Entropy:  1.9048
		Step 1:  0.0915
		Step 2:  1.0096
		Step 3:  0.8038
Reasoning Diagnostics (Top-Rollout)
	Special Step Rate:  0.1290
	Restart Rate:  0.0000
	No-Op Rate:  0.1290
	Cycle Rate:  0.1542
	Backtrack Rate:  0.1425
	Unique Edges:  2.2026
	Redundancy:  0.1426
	Avg Segment Hops:  2.6130
Answer(s) Endpoint Coverage Metrics
	Recall:  0.9892
	Precision:  0.1844
	F1 Score:  0.2461

Score for iteration 13000
Answer Metrics
	Hits@1:  0.8914
	Hits@3:  0.9860
	Hits@5:  0.9936
	Hits@10:  0.9968
	Hits@20:  0.9982
	MRR:  0.9391
Per Hop Answer Metrics
	3-Hop
		Hits@1:  0.8857
		MRR:  0.9353
	1-Hop
		Hits@1:  0.9078
		MRR:  0.9444
	2-Hop
		Hits@1:  0.8858
		MRR:  0.9392
Valid Action Count at Each Step
	Overall Average: 29.5716
		Step 1:  8.5170
		Step 2: 38.7680
		Step 3: 41.4297
Entropy Metrics
	Question Entropy:  0.6136
	Path Entropy:  1.8409
		Step 1:  0.0891
		Step 2:  0.9715
		Step 3:  0.7803
Reasoning Diagnostics (Top-Rollout)
	Special Step Rate:  0.1291
	Restart Rate:  0.0000
	No-Op Rate:  0.1291
	Cycle Rate:  0.1543
	Backtrack Rate:  0.1427
	Unique Edges:  2.2019
	Redundancy:  0.1428
	Avg Segment Hops:  2.6128
Answer(s) Endpoint Coverage Metrics
	Recall:  0.9901
	Precision:  0.1827
	F1 Score:  0.2444

Score for iteration 13500
Answer Metrics
	Hits@1:  0.8919
	Hits@3:  0.9864
	Hits@5:  0.9936
	Hits@10:  0.9969
	Hits@20:  0.9982
	MRR:  0.9396
Per Hop Answer Metrics
	3-Hop
		Hits@1:  0.8877
		MRR:  0.9365
	1-Hop
		Hits@1:  0.9081
		MRR:  0.9445
	2-Hop
		Hits@1:  0.8851
		MRR:  0.9392
Valid Action Count at Each Step
	Overall Average: 29.9833
		Step 1:  8.5170
		Step 2: 38.8822
		Step 3: 42.5507
Entropy Metrics
	Question Entropy:  0.6173
	Path Entropy:  1.8520
		Step 1:  0.0884
		Step 2:  0.9720
		Step 3:  0.7915
Reasoning Diagnostics (Top-Rollout)
	Special Step Rate:  0.1291
	Restart Rate:  0.0000
	No-Op Rate:  0.1291
	Cycle Rate:  0.1535
	Backtrack Rate:  0.1423
	Unique Edges:  2.2033
	Redundancy:  0.1423
	Avg Segment Hops:  2.6128
Answer(s) Endpoint Coverage Metrics
	Recall:  0.9898
	Precision:  0.1822
	F1 Score:  0.2438

Score for iteration 14000
Answer Metrics
	Hits@1:  0.8937
	Hits@3:  0.9849
	Hits@5:  0.9928
	Hits@10:  0.9964
	Hits@20:  0.9982
	MRR:  0.9398
Per Hop Answer Metrics
	3-Hop
		Hits@1:  0.8883
		MRR:  0.9361
	1-Hop
		Hits@1:  0.9071
		MRR:  0.9432
	2-Hop
		Hits@1:  0.8899
		MRR:  0.9410
Valid Action Count at Each Step
	Overall Average: 30.6128
		Step 1:  8.5170
		Step 2: 39.3985
		Step 3: 43.9228
Entropy Metrics
	Question Entropy:  0.6009
	Path Entropy:  1.8026
		Step 1:  0.0869
		Step 2:  0.9413
		Step 3:  0.7744
Reasoning Diagnostics (Top-Rollout)
	Special Step Rate:  0.1296
	Restart Rate:  0.0000
	No-Op Rate:  0.1296
	Cycle Rate:  0.1520
	Backtrack Rate:  0.1410
	Unique Edges:  2.2049
	Redundancy:  0.1411
	Avg Segment Hops:  2.6112
Answer(s) Endpoint Coverage Metrics
	Recall:  0.9895
	Precision:  0.1780
	F1 Score:  0.2394

Score for iteration 14500
Answer Metrics
	Hits@1:  0.8946
	Hits@3:  0.9859
	Hits@5:  0.9930
	Hits@10:  0.9967
	Hits@20:  0.9981
	MRR:  0.9406
Per Hop Answer Metrics
	3-Hop
		Hits@1:  0.8884
		MRR:  0.9366
	1-Hop
		Hits@1:  0.9077
		MRR:  0.9437
	2-Hop
		Hits@1:  0.8918
		MRR:  0.9424
Valid Action Count at Each Step
	Overall Average: 29.1531
		Step 1:  8.5170
		Step 2: 37.7573
		Step 3: 41.1850
Entropy Metrics
	Question Entropy:  0.5853
	Path Entropy:  1.7560
		Step 1:  0.0867
		Step 2:  0.9261
		Step 3:  0.7431
Reasoning Diagnostics (Top-Rollout)
	Special Step Rate:  0.1291
	Restart Rate:  0.0000
	No-Op Rate:  0.1291
	Cycle Rate:  0.1511
	Backtrack Rate:  0.1398
	Unique Edges:  2.2092
	Redundancy:  0.1399
	Avg Segment Hops:  2.6127
Answer(s) Endpoint Coverage Metrics
	Recall:  0.9901
	Precision:  0.1797
	F1 Score:  0.2413

Score for iteration 15000
Answer Metrics
	Hits@1:  0.8953
	Hits@3:  0.9857
	Hits@5:  0.9932
	Hits@10:  0.9965
	Hits@20:  0.9981
	MRR:  0.9408
Per Hop Answer Metrics
	3-Hop
		Hits@1:  0.8897
		MRR:  0.9370
	1-Hop
		Hits@1:  0.9071
		MRR:  0.9435
	2-Hop
		Hits@1:  0.8928
		MRR:  0.9427
Valid Action Count at Each Step
	Overall Average: 29.6894
		Step 1:  8.5170
		Step 2: 37.5555
		Step 3: 42.9957
Entropy Metrics
	Question Entropy:  0.5824
	Path Entropy:  1.7471
		Step 1:  0.0859
		Step 2:  0.9162
		Step 3:  0.7449
Reasoning Diagnostics (Top-Rollout)
	Special Step Rate:  0.1301
	Restart Rate:  0.0000
	No-Op Rate:  0.1301
	Cycle Rate:  0.1506
	Backtrack Rate:  0.1399
	Unique Edges:  2.2064
	Redundancy:  0.1400
	Avg Segment Hops:  2.6098
Answer(s) Endpoint Coverage Metrics
	Recall:  0.9903
	Precision:  0.1746
	F1 Score:  0.2355

Test (beam) scores with best model from output/metaqa/qa_nhop_reason_3hop_seed42/model/model.ckpt
Answer Metrics
	Hits@1:  0.8978
	Hits@3:  0.9864
	Hits@5:  0.9932
	Hits@10:  0.9970
	Hits@20:  0.9984
	MRR:  0.9421
Per Hop Answer Metrics
	3-Hop
		Hits@1:  0.8970
		MRR:  0.9409
	2-Hop
		Hits@1:  0.8911
		MRR:  0.9419
	1-Hop
		Hits@1:  0.9089
		MRR:  0.9441
Valid Action Count at Each Step
	Overall Average: 29.6920
		Step 1:  8.5566
		Step 2: 37.2743
		Step 3: 43.2449
Entropy Metrics
	Question Entropy:  0.5815
	Path Entropy:  1.7444
		Step 1:  0.0863
		Step 2:  0.9092
		Step 3:  0.7489
Reasoning Diagnostics (Top-Rollout)
	Special Step Rate:  0.1301
	Restart Rate:  0.0000
	No-Op Rate:  0.1301
	Cycle Rate:  0.1495
	Backtrack Rate:  0.1386
	Unique Edges:  2.2098
	Redundancy:  0.1387
	Avg Segment Hops:  2.6096
Answer(s) Endpoint Coverage Metrics
	Recall:  0.9898
	Precision:  0.1758
	F1 Score:  0.2368

