Score for iteration 500
Answer Metrics
	Hits@1:  0.6636
	Hits@3:  0.8465
	Hits@5:  0.8808
	Hits@10:  0.9161
	Hits@20:  0.9425
	MRR:  0.7639
Per Hop Answer Metrics
	3-Hop
		Hits@1:  0.5404
		MRR:  0.6690
	1-Hop
		Hits@1:  0.7807
		MRR:  0.8341
	2-Hop
		Hits@1:  0.7033
		MRR:  0.8077
Valid Action Count at Each Step
	Overall Average: 27.9476
		Step 1:  8.5170
		Step 2: 39.6036
		Step 3: 35.7223
Entropy Metrics
	Question Entropy:  1.4116
	Path Entropy:  4.2347
		Step 1:  0.5537
		Step 2:  2.0991
		Step 3:  1.5819
Reasoning Diagnostics (Top-Rollout)
	Special Step Rate:  0.1240
	Restart Rate:  0.0000
	No-Op Rate:  0.1240
	Cycle Rate:  0.2226
	Backtrack Rate:  0.1842
	Unique Edges:  2.0706
	Redundancy:  0.1959
	Avg Segment Hops:  2.6280
Answer(s) Endpoint Coverage Metrics
	Recall:  0.8980
	Precision:  0.1680
	F1 Score:  0.2219

Score for iteration 1000
Answer Metrics
	Hits@1:  0.7269
	Hits@3:  0.8921
	Hits@5:  0.9184
	Hits@10:  0.9452
	Hits@20:  0.9640
	MRR:  0.8157
Per Hop Answer Metrics
	3-Hop
		Hits@1:  0.6265
		MRR:  0.7369
	1-Hop
		Hits@1:  0.8318
		MRR:  0.8918
	2-Hop
		Hits@1:  0.7529
		MRR:  0.8403
Valid Action Count at Each Step
	Overall Average: 29.4840
		Step 1:  8.5170
		Step 2: 42.4040
		Step 3: 37.5309
Entropy Metrics
	Question Entropy:  1.2403
	Path Entropy:  3.7210
		Step 1:  0.4047
		Step 2:  1.8793
		Step 3:  1.4370
Reasoning Diagnostics (Top-Rollout)
	Special Step Rate:  0.1200
	Restart Rate:  0.0000
	No-Op Rate:  0.1200
	Cycle Rate:  0.2048
	Backtrack Rate:  0.1861
	Unique Edges:  2.0829
	Redundancy:  0.1941
	Avg Segment Hops:  2.6399
Answer(s) Endpoint Coverage Metrics
	Recall:  0.9263
	Precision:  0.1864
	F1 Score:  0.2380

Score for iteration 1500
Answer Metrics
	Hits@1:  0.7388
	Hits@3:  0.9023
	Hits@5:  0.9305
	Hits@10:  0.9576
	Hits@20:  0.9751
	MRR:  0.8270
Per Hop Answer Metrics
	3-Hop
		Hits@1:  0.6544
		MRR:  0.7589
	1-Hop
		Hits@1:  0.8252
		MRR:  0.8884
	2-Hop
		Hits@1:  0.7618
		MRR:  0.8510
Valid Action Count at Each Step
	Overall Average: 29.1056
		Step 1:  8.5170
		Step 2: 40.8419
		Step 3: 37.9579
Entropy Metrics
	Question Entropy:  1.0955
	Path Entropy:  3.2866
		Step 1:  0.3197
		Step 2:  1.6544
		Step 3:  1.3125
Reasoning Diagnostics (Top-Rollout)
	Special Step Rate:  0.1205
	Restart Rate:  0.0000
	No-Op Rate:  0.1205
	Cycle Rate:  0.1970
	Backtrack Rate:  0.1652
	Unique Edges:  2.1373
	Redundancy:  0.1748
	Avg Segment Hops:  2.6385
Answer(s) Endpoint Coverage Metrics
	Recall:  0.9430
	Precision:  0.1807
	F1 Score:  0.2379

Score for iteration 2000
Answer Metrics
	Hits@1:  0.7659
	Hits@3:  0.9193
	Hits@5:  0.9450
	Hits@10:  0.9672
	Hits@20:  0.9814
	MRR:  0.8480
Per Hop Answer Metrics
	3-Hop
		Hits@1:  0.7011
		MRR:  0.7941
	1-Hop
		Hits@1:  0.8295
		MRR:  0.8909
	2-Hop
		Hits@1:  0.7853
		MRR:  0.8709
Valid Action Count at Each Step
	Overall Average: 29.3047
		Step 1:  8.5170
		Step 2: 40.9105
		Step 3: 38.4865
Entropy Metrics
	Question Entropy:  1.0224
	Path Entropy:  3.0671
		Step 1:  0.2854
		Step 2:  1.5235
		Step 3:  1.2583
Reasoning Diagnostics (Top-Rollout)
	Special Step Rate:  0.1216
	Restart Rate:  0.0000
	No-Op Rate:  0.1216
	Cycle Rate:  0.1898
	Backtrack Rate:  0.1670
	Unique Edges:  2.1361
	Redundancy:  0.1744
	Avg Segment Hops:  2.6353
Answer(s) Endpoint Coverage Metrics
	Recall:  0.9548
	Precision:  0.1831
	F1 Score:  0.2428

Score for iteration 2500
Answer Metrics
	Hits@1:  0.7887
	Hits@3:  0.9367
	Hits@5:  0.9572
	Hits@10:  0.9744
	Hits@20:  0.9850
	MRR:  0.8664
Per Hop Answer Metrics
	3-Hop
		Hits@1:  0.7195
		MRR:  0.8079
	2-Hop
		Hits@1:  0.8270
		MRR:  0.9058
	1-Hop
		Hits@1:  0.8306
		MRR:  0.8915
Valid Action Count at Each Step
	Overall Average: 29.6498
		Step 1:  8.5170
		Step 2: 40.9386
		Step 3: 39.4938
Entropy Metrics
	Question Entropy:  0.9848
	Path Entropy:  2.9543
		Step 1:  0.2512
		Step 2:  1.4405
		Step 3:  1.2626
Reasoning Diagnostics (Top-Rollout)
	Special Step Rate:  0.1273
	Restart Rate:  0.0000
	No-Op Rate:  0.1273
	Cycle Rate:  0.1825
	Backtrack Rate:  0.1579
	Unique Edges:  2.1409
	Redundancy:  0.1674
	Avg Segment Hops:  2.6180
Answer(s) Endpoint Coverage Metrics
	Recall:  0.9605
	Precision:  0.1838
	F1 Score:  0.2447

Score for iteration 3000
Answer Metrics
	Hits@1:  0.8046
	Hits@3:  0.9539
	Hits@5:  0.9743
	Hits@10:  0.9882
	Hits@20:  0.9942
	MRR:  0.8821
Per Hop Answer Metrics
	3-Hop
		Hits@1:  0.7574
		MRR:  0.8470
	2-Hop
		Hits@1:  0.8319
		MRR:  0.9091
	1-Hop
		Hits@1:  0.8316
		MRR:  0.8921
Valid Action Count at Each Step
	Overall Average: 29.9685
		Step 1:  8.5170
		Step 2: 41.1935
		Step 3: 40.1951
Entropy Metrics
	Question Entropy:  0.9507
	Path Entropy:  2.8522
		Step 1:  0.2454
		Step 2:  1.3678
		Step 3:  1.2391
Reasoning Diagnostics (Top-Rollout)
	Special Step Rate:  0.1280
	Restart Rate:  0.0000
	No-Op Rate:  0.1280
	Cycle Rate:  0.1730
	Backtrack Rate:  0.1499
	Unique Edges:  2.1676
	Redundancy:  0.1578
	Avg Segment Hops:  2.6160
Answer(s) Endpoint Coverage Metrics
	Recall:  0.9743
	Precision:  0.1898
	F1 Score:  0.2523

Score for iteration 3500
Answer Metrics
	Hits@1:  0.8291
	Hits@3:  0.9702
	Hits@5:  0.9847
	Hits@10:  0.9928
	Hits@20:  0.9961
	MRR:  0.9010
Per Hop Answer Metrics
	3-Hop
		Hits@1:  0.8121
		MRR:  0.8910
	2-Hop
		Hits@1:  0.8377
		MRR:  0.9123
	1-Hop
		Hits@1:  0.8404
		MRR:  0.8985
Valid Action Count at Each Step
	Overall Average: 29.8939
		Step 1:  8.5170
		Step 2: 41.0862
		Step 3: 40.0786
Entropy Metrics
	Question Entropy:  0.9333
	Path Entropy:  2.7998
		Step 1:  0.2296
		Step 2:  1.3443
		Step 3:  1.2259
Reasoning Diagnostics (Top-Rollout)
	Special Step Rate:  0.1264
	Restart Rate:  0.0000
	No-Op Rate:  0.1264
	Cycle Rate:  0.1663
	Backtrack Rate:  0.1447
	Unique Edges:  2.1873
	Redundancy:  0.1523
	Avg Segment Hops:  2.6207
Answer(s) Endpoint Coverage Metrics
	Recall:  0.9810
	Precision:  0.1994
	F1 Score:  0.2618

Score for iteration 4000
Answer Metrics
	Hits@1:  0.8379
	Hits@3:  0.9712
	Hits@5:  0.9853
	Hits@10:  0.9934
	Hits@20:  0.9964
	MRR:  0.9060
Per Hop Answer Metrics
	3-Hop
		Hits@1:  0.8279
		MRR:  0.9004
	1-Hop
		Hits@1:  0.8444
		MRR:  0.9000
	2-Hop
		Hits@1:  0.8431
		MRR:  0.9155
Valid Action Count at Each Step
	Overall Average: 30.4964
		Step 1:  8.5170
		Step 2: 41.9026
		Step 3: 41.0696
Entropy Metrics
	Question Entropy:  0.8859
	Path Entropy:  2.6577
		Step 1:  0.2045
		Step 2:  1.2710
		Step 3:  1.1822
Reasoning Diagnostics (Top-Rollout)
	Special Step Rate:  0.1270
	Restart Rate:  0.0000
	No-Op Rate:  0.1270
	Cycle Rate:  0.1631
	Backtrack Rate:  0.1424
	Unique Edges:  2.1941
	Redundancy:  0.1493
	Avg Segment Hops:  2.6191
Answer(s) Endpoint Coverage Metrics
	Recall:  0.9823
	Precision:  0.1998
	F1 Score:  0.2621

Score for iteration 4500
Answer Metrics
	Hits@1:  0.8470
	Hits@3:  0.9740
	Hits@5:  0.9864
	Hits@10:  0.9939
	Hits@20:  0.9967
	MRR:  0.9119
Per Hop Answer Metrics
	3-Hop
		Hits@1:  0.8403
		MRR:  0.9085
	1-Hop
		Hits@1:  0.8574
		MRR:  0.9093
	2-Hop
		Hits@1:  0.8464
		MRR:  0.9168
Valid Action Count at Each Step
	Overall Average: 31.3020
		Step 1:  8.5170
		Step 2: 43.2018
		Step 3: 42.1873
Entropy Metrics
	Question Entropy:  0.8863
	Path Entropy:  2.6590
		Step 1:  0.1897
		Step 2:  1.2719
		Step 3:  1.1974
Reasoning Diagnostics (Top-Rollout)
	Special Step Rate:  0.1260
	Restart Rate:  0.0000
	No-Op Rate:  0.1260
	Cycle Rate:  0.1635
	Backtrack Rate:  0.1428
	Unique Edges:  2.1947
	Redundancy:  0.1497
	Avg Segment Hops:  2.6221
Answer(s) Endpoint Coverage Metrics
	Recall:  0.9836
	Precision:  0.2054
	F1 Score:  0.2678

Score for iteration 5000
Answer Metrics
	Hits@1:  0.8494
	Hits@3:  0.9756
	Hits@5:  0.9876
	Hits@10:  0.9944
	Hits@20:  0.9969
	MRR:  0.9134
Per Hop Answer Metrics
	3-Hop
		Hits@1:  0.8466
		MRR:  0.9122
	1-Hop
		Hits@1:  0.8566
		MRR:  0.9109
	2-Hop
		Hits@1:  0.8471
		MRR:  0.9163
Valid Action Count at Each Step
	Overall Average: 30.5613
		Step 1:  8.5170
		Step 2: 42.0726
		Step 3: 41.0944
Entropy Metrics
	Question Entropy:  0.8333
	Path Entropy:  2.4998
		Step 1:  0.1753
		Step 2:  1.2019
		Step 3:  1.1225
Reasoning Diagnostics (Top-Rollout)
	Special Step Rate:  0.1252
	Restart Rate:  0.0000
	No-Op Rate:  0.1252
	Cycle Rate:  0.1621
	Backtrack Rate:  0.1411
	Unique Edges:  2.1997
	Redundancy:  0.1485
	Avg Segment Hops:  2.6244
Answer(s) Endpoint Coverage Metrics
	Recall:  0.9849
	Precision:  0.1988
	F1 Score:  0.2622

Score for iteration 5500
Answer Metrics
	Hits@1:  0.8541
	Hits@3:  0.9768
	Hits@5:  0.9883
	Hits@10:  0.9945
	Hits@20:  0.9967
	MRR:  0.9164
Per Hop Answer Metrics
	3-Hop
		Hits@1:  0.8508
		MRR:  0.9146
	1-Hop
		Hits@1:  0.8609
		MRR:  0.9132
	2-Hop
		Hits@1:  0.8525
		MRR:  0.9202
Valid Action Count at Each Step
	Overall Average: 30.8000
		Step 1:  8.5170
		Step 2: 41.8724
		Step 3: 42.0108
Entropy Metrics
	Question Entropy:  0.8195
	Path Entropy:  2.4585
		Step 1:  0.1659
		Step 2:  1.1656
		Step 3:  1.1270
Reasoning Diagnostics (Top-Rollout)
	Special Step Rate:  0.1257
	Restart Rate:  0.0000
	No-Op Rate:  0.1257
	Cycle Rate:  0.1603
	Backtrack Rate:  0.1402
	Unique Edges:  2.2045
	Redundancy:  0.1463
	Avg Segment Hops:  2.6230
Answer(s) Endpoint Coverage Metrics
	Recall:  0.9868
	Precision:  0.1989
	F1 Score:  0.2622

Score for iteration 6000
Answer Metrics
	Hits@1:  0.8610
	Hits@3:  0.9791
	Hits@5:  0.9899
	Hits@10:  0.9950
	Hits@20:  0.9970
	MRR:  0.9209
Per Hop Answer Metrics
	3-Hop
		Hits@1:  0.8577
		MRR:  0.9188
	1-Hop
		Hits@1:  0.8677
		MRR:  0.9182
	2-Hop
		Hits@1:  0.8596
		MRR:  0.9247
Valid Action Count at Each Step
	Overall Average: 31.0423
		Step 1:  8.5170
		Step 2: 42.1263
		Step 3: 42.4835
Entropy Metrics
	Question Entropy:  0.7881
	Path Entropy:  2.3642
		Step 1:  0.1534
		Step 2:  1.1174
		Step 3:  1.0934
Reasoning Diagnostics (Top-Rollout)
	Special Step Rate:  0.1264
	Restart Rate:  0.0000
	No-Op Rate:  0.1264
	Cycle Rate:  0.1596
	Backtrack Rate:  0.1405
	Unique Edges:  2.2021
	Redundancy:  0.1463
	Avg Segment Hops:  2.6209
Answer(s) Endpoint Coverage Metrics
	Recall:  0.9847
	Precision:  0.1996
	F1 Score:  0.2615

Score for iteration 6500
Answer Metrics
	Hits@1:  0.8632
	Hits@3:  0.9788
	Hits@5:  0.9892
	Hits@10:  0.9948
	Hits@20:  0.9968
	MRR:  0.9218
Per Hop Answer Metrics
	3-Hop
		Hits@1:  0.8583
		MRR:  0.9181
	1-Hop
		Hits@1:  0.8692
		MRR:  0.9196
	2-Hop
		Hits@1:  0.8639
		MRR:  0.9269
Valid Action Count at Each Step
	Overall Average: 31.4233
		Step 1:  8.5170
		Step 2: 42.0480
		Step 3: 43.7050
Entropy Metrics
	Question Entropy:  0.7727
	Path Entropy:  2.3180
		Step 1:  0.1481
		Step 2:  1.0766
		Step 3:  1.0933
Reasoning Diagnostics (Top-Rollout)
	Special Step Rate:  0.1271
	Restart Rate:  0.0000
	No-Op Rate:  0.1271
	Cycle Rate:  0.1581
	Backtrack Rate:  0.1415
	Unique Edges:  2.2002
	Redundancy:  0.1461
	Avg Segment Hops:  2.6187
Answer(s) Endpoint Coverage Metrics
	Recall:  0.9840
	Precision:  0.1964
	F1 Score:  0.2575

Score for iteration 7000
Answer Metrics
	Hits@1:  0.8644
	Hits@3:  0.9794
	Hits@5:  0.9901
	Hits@10:  0.9954
	Hits@20:  0.9972
	MRR:  0.9228
Per Hop Answer Metrics
	3-Hop
		Hits@1:  0.8581
		MRR:  0.9189
	1-Hop
		Hits@1:  0.8729
		MRR:  0.9219
	2-Hop
		Hits@1:  0.8646
		MRR:  0.9272
Valid Action Count at Each Step
	Overall Average: 30.7212
		Step 1:  8.5170
		Step 2: 41.4462
		Step 3: 42.2005
Entropy Metrics
	Question Entropy:  0.7498
	Path Entropy:  2.2495
		Step 1:  0.1451
		Step 2:  1.0638
		Step 3:  1.0406
Reasoning Diagnostics (Top-Rollout)
	Special Step Rate:  0.1261
	Restart Rate:  0.0000
	No-Op Rate:  0.1261
	Cycle Rate:  0.1592
	Backtrack Rate:  0.1416
	Unique Edges:  2.1993
	Redundancy:  0.1473
	Avg Segment Hops:  2.6216
Answer(s) Endpoint Coverage Metrics
	Recall:  0.9863
	Precision:  0.1969
	F1 Score:  0.2588

Score for iteration 7500
Answer Metrics
	Hits@1:  0.8698
	Hits@3:  0.9816
	Hits@5:  0.9906
	Hits@10:  0.9957
	Hits@20:  0.9974
	MRR:  0.9263
Per Hop Answer Metrics
	3-Hop
		Hits@1:  0.8672
		MRR:  0.9244
	1-Hop
		Hits@1:  0.8776
		MRR:  0.9251
	2-Hop
		Hits@1:  0.8670
		MRR:  0.9288
Valid Action Count at Each Step
	Overall Average: 31.4490
		Step 1:  8.5170
		Step 2: 42.5985
		Step 3: 43.2314
Entropy Metrics
	Question Entropy:  0.7465
	Path Entropy:  2.2396
		Step 1:  0.1364
		Step 2:  1.0570
		Step 3:  1.0462
Reasoning Diagnostics (Top-Rollout)
	Special Step Rate:  0.1262
	Restart Rate:  0.0000
	No-Op Rate:  0.1262
	Cycle Rate:  0.1594
	Backtrack Rate:  0.1424
	Unique Edges:  2.1993
	Redundancy:  0.1472
	Avg Segment Hops:  2.6215
Answer(s) Endpoint Coverage Metrics
	Recall:  0.9854
	Precision:  0.2002
	F1 Score:  0.2616

Score for iteration 8000
Answer Metrics
	Hits@1:  0.8724
	Hits@3:  0.9812
	Hits@5:  0.9903
	Hits@10:  0.9961
	Hits@20:  0.9975
	MRR:  0.9274
Per Hop Answer Metrics
	3-Hop
		Hits@1:  0.8740
		MRR:  0.9282
	1-Hop
		Hits@1:  0.8780
		MRR:  0.9254
	2-Hop
		Hits@1:  0.8671
		MRR:  0.9281
Valid Action Count at Each Step
	Overall Average: 31.1879
		Step 1:  8.5170
		Step 2: 42.0133
		Step 3: 43.0334
Entropy Metrics
	Question Entropy:  0.7111
	Path Entropy:  2.1334
		Step 1:  0.1290
		Step 2:  1.0087
		Step 3:  0.9957
Reasoning Diagnostics (Top-Rollout)
	Special Step Rate:  0.1260
	Restart Rate:  0.0000
	No-Op Rate:  0.1260
	Cycle Rate:  0.1571
	Backtrack Rate:  0.1401
	Unique Edges:  2.2056
	Redundancy:  0.1451
	Avg Segment Hops:  2.6220
Answer(s) Endpoint Coverage Metrics
	Recall:  0.9866
	Precision:  0.1950
	F1 Score:  0.2573

Score for iteration 8500
Answer Metrics
	Hits@1:  0.8755
	Hits@3:  0.9825
	Hits@5:  0.9913
	Hits@10:  0.9959
	Hits@20:  0.9975
	MRR:  0.9296
Per Hop Answer Metrics
	3-Hop
		Hits@1:  0.8745
		MRR:  0.9285
	1-Hop
		Hits@1:  0.8830
		MRR:  0.9291
	2-Hop
		Hits@1:  0.8714
		MRR:  0.9310
Valid Action Count at Each Step
	Overall Average: 32.4682
		Step 1:  8.5170
		Step 2: 44.2063
		Step 3: 44.6814
Entropy Metrics
	Question Entropy:  0.7440
	Path Entropy:  2.2319
		Step 1:  0.1309
		Step 2:  1.0583
		Step 3:  1.0427
Reasoning Diagnostics (Top-Rollout)
	Special Step Rate:  0.1261
	Restart Rate:  0.0000
	No-Op Rate:  0.1261
	Cycle Rate:  0.1572
	Backtrack Rate:  0.1401
	Unique Edges:  2.2047
	Redundancy:  0.1451
	Avg Segment Hops:  2.6216
Answer(s) Endpoint Coverage Metrics
	Recall:  0.9856
	Precision:  0.2014
	F1 Score:  0.2628

Score for iteration 9000
Answer Metrics
	Hits@1:  0.8762
	Hits@3:  0.9818
	Hits@5:  0.9911
	Hits@10:  0.9958
	Hits@20:  0.9976
	MRR:  0.9296
Per Hop Answer Metrics
	3-Hop
		Hits@1:  0.8764
		MRR:  0.9287
	1-Hop
		Hits@1:  0.8827
		MRR:  0.9284
	2-Hop
		Hits@1:  0.8716
		MRR:  0.9311
Valid Action Count at Each Step
	Overall Average: 31.9780
		Step 1:  8.5170
		Step 2: 42.8780
		Step 3: 44.5390
Entropy Metrics
	Question Entropy:  0.7112
	Path Entropy:  2.1337
		Step 1:  0.1208
		Step 2:  0.9956
		Step 3:  1.0174
Reasoning Diagnostics (Top-Rollout)
	Special Step Rate:  0.1269
	Restart Rate:  0.0000
	No-Op Rate:  0.1269
	Cycle Rate:  0.1561
	Backtrack Rate:  0.1395
	Unique Edges:  2.2042
	Redundancy:  0.1445
	Avg Segment Hops:  2.6192
Answer(s) Endpoint Coverage Metrics
	Recall:  0.9859
	Precision:  0.1940
	F1 Score:  0.2557

Score for iteration 9500
Answer Metrics
	Hits@1:  0.8777
	Hits@3:  0.9831
	Hits@5:  0.9922
	Hits@10:  0.9960
	Hits@20:  0.9978
	MRR:  0.9309
Per Hop Answer Metrics
	3-Hop
		Hits@1:  0.8741
		MRR:  0.9281
	1-Hop
		Hits@1:  0.8862
		MRR:  0.9311
	2-Hop
		Hits@1:  0.8754
		MRR:  0.9336
Valid Action Count at Each Step
	Overall Average: 31.5885
		Step 1:  8.5170
		Step 2: 42.2870
		Step 3: 43.9615
Entropy Metrics
	Question Entropy:  0.6941
	Path Entropy:  2.0823
		Step 1:  0.1188
		Step 2:  0.9782
		Step 3:  0.9853
Reasoning Diagnostics (Top-Rollout)
	Special Step Rate:  0.1267
	Restart Rate:  0.0000
	No-Op Rate:  0.1267
	Cycle Rate:  0.1565
	Backtrack Rate:  0.1406
	Unique Edges:  2.2025
	Redundancy:  0.1452
	Avg Segment Hops:  2.6199
Answer(s) Endpoint Coverage Metrics
	Recall:  0.9860
	Precision:  0.1973
	F1 Score:  0.2588

Score for iteration 10000
Answer Metrics
	Hits@1:  0.8792
	Hits@3:  0.9839
	Hits@5:  0.9924
	Hits@10:  0.9961
	Hits@20:  0.9978
	MRR:  0.9319
Per Hop Answer Metrics
	3-Hop
		Hits@1:  0.8766
		MRR:  0.9296
	1-Hop
		Hits@1:  0.8843
		MRR:  0.9307
	2-Hop
		Hits@1:  0.8783
		MRR:  0.9350
Valid Action Count at Each Step
	Overall Average: 31.4157
		Step 1:  8.5170
		Step 2: 42.0065
		Step 3: 43.7235
Entropy Metrics
	Question Entropy:  0.6729
	Path Entropy:  2.0186
		Step 1:  0.1150
		Step 2:  0.9462
		Step 3:  0.9574
Reasoning Diagnostics (Top-Rollout)
	Special Step Rate:  0.1269
	Restart Rate:  0.0000
	No-Op Rate:  0.1269
	Cycle Rate:  0.1559
	Backtrack Rate:  0.1409
	Unique Edges:  2.2035
	Redundancy:  0.1446
	Avg Segment Hops:  2.6193
Answer(s) Endpoint Coverage Metrics
	Recall:  0.9862
	Precision:  0.1932
	F1 Score:  0.2546

Score for iteration 10500
Answer Metrics
	Hits@1:  0.8819
	Hits@3:  0.9840
	Hits@5:  0.9920
	Hits@10:  0.9963
	Hits@20:  0.9980
	MRR:  0.9333
Per Hop Answer Metrics
	3-Hop
		Hits@1:  0.8783
		MRR:  0.9302
	1-Hop
		Hits@1:  0.8890
		MRR:  0.9334
	2-Hop
		Hits@1:  0.8805
		MRR:  0.9361
Valid Action Count at Each Step
	Overall Average: 31.5631
		Step 1:  8.5170
		Step 2: 41.8243
		Step 3: 44.3481
Entropy Metrics
	Question Entropy:  0.6768
	Path Entropy:  2.0303
		Step 1:  0.1143
		Step 2:  0.9458
		Step 3:  0.9703
Reasoning Diagnostics (Top-Rollout)
	Special Step Rate:  0.1270
	Restart Rate:  0.0000
	No-Op Rate:  0.1270
	Cycle Rate:  0.1557
	Backtrack Rate:  0.1400
	Unique Edges:  2.2028
	Redundancy:  0.1447
	Avg Segment Hops:  2.6191
Answer(s) Endpoint Coverage Metrics
	Recall:  0.9864
	Precision:  0.1909
	F1 Score:  0.2523

Score for iteration 11000
Answer Metrics
	Hits@1:  0.8851
	Hits@3:  0.9852
	Hits@5:  0.9929
	Hits@10:  0.9966
	Hits@20:  0.9980
	MRR:  0.9354
Per Hop Answer Metrics
	3-Hop
		Hits@1:  0.8842
		MRR:  0.9343
	1-Hop
		Hits@1:  0.8894
		MRR:  0.9337
	2-Hop
		Hits@1:  0.8831
		MRR:  0.9376
Valid Action Count at Each Step
	Overall Average: 31.3023
		Step 1:  8.5170
		Step 2: 41.7440
		Step 3: 43.6459
Entropy Metrics
	Question Entropy:  0.6677
	Path Entropy:  2.0030
		Step 1:  0.1104
		Step 2:  0.9419
		Step 3:  0.9507
Reasoning Diagnostics (Top-Rollout)
	Special Step Rate:  0.1266
	Restart Rate:  0.0000
	No-Op Rate:  0.1266
	Cycle Rate:  0.1551
	Backtrack Rate:  0.1385
	Unique Edges:  2.2071
	Redundancy:  0.1433
	Avg Segment Hops:  2.6201
Answer(s) Endpoint Coverage Metrics
	Recall:  0.9879
	Precision:  0.1915
	F1 Score:  0.2532

Score for iteration 11500
Answer Metrics
	Hits@1:  0.8890
	Hits@3:  0.9849
	Hits@5:  0.9929
	Hits@10:  0.9966
	Hits@20:  0.9981
	MRR:  0.9373
Per Hop Answer Metrics
	3-Hop
		Hits@1:  0.8895
		MRR:  0.9373
	1-Hop
		Hits@1:  0.8915
		MRR:  0.9353
	2-Hop
		Hits@1:  0.8868
		MRR:  0.9387
Valid Action Count at Each Step
	Overall Average: 31.5565
		Step 1:  8.5170
		Step 2: 42.4523
		Step 3: 43.7002
Entropy Metrics
	Question Entropy:  0.6545
	Path Entropy:  1.9634
		Step 1:  0.1066
		Step 2:  0.9362
		Step 3:  0.9205
Reasoning Diagnostics (Top-Rollout)
	Special Step Rate:  0.1262
	Restart Rate:  0.0000
	No-Op Rate:  0.1262
	Cycle Rate:  0.1534
	Backtrack Rate:  0.1368
	Unique Edges:  2.2107
	Redundancy:  0.1422
	Avg Segment Hops:  2.6213
Answer(s) Endpoint Coverage Metrics
	Recall:  0.9878
	Precision:  0.1933
	F1 Score:  0.2554

Score for iteration 12000
Answer Metrics
	Hits@1:  0.8902
	Hits@3:  0.9846
	Hits@5:  0.9923
	Hits@10:  0.9967
	Hits@20:  0.9979
	MRR:  0.9379
Per Hop Answer Metrics
	3-Hop
		Hits@1:  0.8903
		MRR:  0.9372
	1-Hop
		Hits@1:  0.8906
		MRR:  0.9340
	2-Hop
		Hits@1:  0.8899
		MRR:  0.9411
Valid Action Count at Each Step
	Overall Average: 31.5103
		Step 1:  8.5170
		Step 2: 41.6418
		Step 3: 44.3720
Entropy Metrics
	Question Entropy:  0.6613
	Path Entropy:  1.9840
		Step 1:  0.1055
		Step 2:  0.9263
		Step 3:  0.9523
Reasoning Diagnostics (Top-Rollout)
	Special Step Rate:  0.1267
	Restart Rate:  0.0000
	No-Op Rate:  0.1267
	Cycle Rate:  0.1511
	Backtrack Rate:  0.1347
	Unique Edges:  2.2159
	Redundancy:  0.1399
	Avg Segment Hops:  2.6200
Answer(s) Endpoint Coverage Metrics
	Recall:  0.9885
	Precision:  0.1891
	F1 Score:  0.2508

Score for iteration 12500
Answer Metrics
	Hits@1:  0.8931
	Hits@3:  0.9848
	Hits@5:  0.9929
	Hits@10:  0.9967
	Hits@20:  0.9978
	MRR:  0.9394
Per Hop Answer Metrics
	3-Hop
		Hits@1:  0.8944
		MRR:  0.9397
	1-Hop
		Hits@1:  0.8900
		MRR:  0.9339
	2-Hop
		Hits@1:  0.8938
		MRR:  0.9428
Valid Action Count at Each Step
	Overall Average: 32.1041
		Step 1:  8.5170
		Step 2: 42.6976
		Step 3: 45.0978
Entropy Metrics
	Question Entropy:  0.6511
	Path Entropy:  1.9533
		Step 1:  0.1029
		Step 2:  0.9191
		Step 3:  0.9313
Reasoning Diagnostics (Top-Rollout)
	Special Step Rate:  0.1265
	Restart Rate:  0.0000
	No-Op Rate:  0.1265
	Cycle Rate:  0.1508
	Backtrack Rate:  0.1359
	Unique Edges:  2.2156
	Redundancy:  0.1400
	Avg Segment Hops:  2.6204
Answer(s) Endpoint Coverage Metrics
	Recall:  0.9872
	Precision:  0.1916
	F1 Score:  0.2528

Score for iteration 13000
Answer Metrics
	Hits@1:  0.8968
	Hits@3:  0.9858
	Hits@5:  0.9932
	Hits@10:  0.9967
	Hits@20:  0.9979
	MRR:  0.9417
Per Hop Answer Metrics
	3-Hop
		Hits@1:  0.8999
		MRR:  0.9431
	1-Hop
		Hits@1:  0.8945
		MRR:  0.9368
	2-Hop
		Hits@1:  0.8953
		MRR:  0.9437
Valid Action Count at Each Step
	Overall Average: 30.9832
		Step 1:  8.5170
		Step 2: 41.0276
		Step 3: 43.4051
Entropy Metrics
	Question Entropy:  0.6299
	Path Entropy:  1.8898
		Step 1:  0.0996
		Step 2:  0.8995
		Step 3:  0.8907
Reasoning Diagnostics (Top-Rollout)
	Special Step Rate:  0.1261
	Restart Rate:  0.0000
	No-Op Rate:  0.1261
	Cycle Rate:  0.1504
	Backtrack Rate:  0.1349
	Unique Edges:  2.2181
	Redundancy:  0.1394
	Avg Segment Hops:  2.6216
Answer(s) Endpoint Coverage Metrics
	Recall:  0.9880
	Precision:  0.1895
	F1 Score:  0.2505

Score for iteration 13500
Answer Metrics
	Hits@1:  0.8992
	Hits@3:  0.9857
	Hits@5:  0.9935
	Hits@10:  0.9968
	Hits@20:  0.9980
	MRR:  0.9429
Per Hop Answer Metrics
	3-Hop
		Hits@1:  0.9031
		MRR:  0.9447
	1-Hop
		Hits@1:  0.8923
		MRR:  0.9351
	2-Hop
		Hits@1:  0.9000
		MRR:  0.9464
Valid Action Count at Each Step
	Overall Average: 31.0166
		Step 1:  8.5170
		Step 2: 39.8755
		Step 3: 44.6572
Entropy Metrics
	Question Entropy:  0.6224
	Path Entropy:  1.8671
		Step 1:  0.0976
		Step 2:  0.8687
		Step 3:  0.9008
Reasoning Diagnostics (Top-Rollout)
	Special Step Rate:  0.1266
	Restart Rate:  0.0000
	No-Op Rate:  0.1266
	Cycle Rate:  0.1476
	Backtrack Rate:  0.1330
	Unique Edges:  2.2241
	Redundancy:  0.1367
	Avg Segment Hops:  2.6202
Answer(s) Endpoint Coverage Metrics
	Recall:  0.9889
	Precision:  0.1864
	F1 Score:  0.2471

Score for iteration 14000
Answer Metrics
	Hits@1:  0.9016
	Hits@3:  0.9859
	Hits@5:  0.9933
	Hits@10:  0.9968
	Hits@20:  0.9979
	MRR:  0.9442
Per Hop Answer Metrics
	3-Hop
		Hits@1:  0.9052
		MRR:  0.9459
	1-Hop
		Hits@1:  0.8932
		MRR:  0.9356
	2-Hop
		Hits@1:  0.9036
		MRR:  0.9483
Valid Action Count at Each Step
	Overall Average: 31.6991
		Step 1:  8.5170
		Step 2: 41.5590
		Step 3: 45.0212
Entropy Metrics
	Question Entropy:  0.6376
	Path Entropy:  1.9128
		Step 1:  0.0979
		Step 2:  0.9021
		Step 3:  0.9129
Reasoning Diagnostics (Top-Rollout)
	Special Step Rate:  0.1263
	Restart Rate:  0.0000
	No-Op Rate:  0.1263
	Cycle Rate:  0.1470
	Backtrack Rate:  0.1331
	Unique Edges:  2.2252
	Redundancy:  0.1365
	Avg Segment Hops:  2.6210
Answer(s) Endpoint Coverage Metrics
	Recall:  0.9883
	Precision:  0.1897
	F1 Score:  0.2509

Score for iteration 14500
Answer Metrics
	Hits@1:  0.9027
	Hits@3:  0.9859
	Hits@5:  0.9936
	Hits@10:  0.9968
	Hits@20:  0.9979
	MRR:  0.9448
Per Hop Answer Metrics
	3-Hop
		Hits@1:  0.9091
		MRR:  0.9483
	1-Hop
		Hits@1:  0.8926
		MRR:  0.9348
	2-Hop
		Hits@1:  0.9034
		MRR:  0.9480
Valid Action Count at Each Step
	Overall Average: 31.1388
		Step 1:  8.5170
		Step 2: 40.9164
		Step 3: 43.9830
Entropy Metrics
	Question Entropy:  0.6073
	Path Entropy:  1.8220
		Step 1:  0.0920
		Step 2:  0.8694
		Step 3:  0.8605
Reasoning Diagnostics (Top-Rollout)
	Special Step Rate:  0.1263
	Restart Rate:  0.0000
	No-Op Rate:  0.1263
	Cycle Rate:  0.1458
	Backtrack Rate:  0.1312
	Unique Edges:  2.2287
	Redundancy:  0.1352
	Avg Segment Hops:  2.6212
Answer(s) Endpoint Coverage Metrics
	Recall:  0.9877
	Precision:  0.1879
	F1 Score:  0.2490

Score for iteration 15000
Answer Metrics
	Hits@1:  0.9058
	Hits@3:  0.9862
	Hits@5:  0.9933
	Hits@10:  0.9966
	Hits@20:  0.9979
	MRR:  0.9464
Per Hop Answer Metrics
	3-Hop
		Hits@1:  0.9107
		MRR:  0.9486
	1-Hop
		Hits@1:  0.8935
		MRR:  0.9353
	2-Hop
		Hits@1:  0.9094
		MRR:  0.9517
Valid Action Count at Each Step
	Overall Average: 30.9321
		Step 1:  8.5170
		Step 2: 40.2120
		Step 3: 44.0673
Entropy Metrics
	Question Entropy:  0.6032
	Path Entropy:  1.8096
		Step 1:  0.0945
		Step 2:  0.8535
		Step 3:  0.8616
Reasoning Diagnostics (Top-Rollout)
	Special Step Rate:  0.1269
	Restart Rate:  0.0000
	No-Op Rate:  0.1269
	Cycle Rate:  0.1449
	Backtrack Rate:  0.1308
	Unique Edges:  2.2288
	Redundancy:  0.1344
	Avg Segment Hops:  2.6192
Answer(s) Endpoint Coverage Metrics
	Recall:  0.9877
	Precision:  0.1888
	F1 Score:  0.2496

Test (beam) scores with best model from output/metaqa/qa_nhop_reason_3hop_seed100/model/model.ckpt
Answer Metrics
	Hits@1:  0.9094
	Hits@3:  0.9870
	Hits@5:  0.9937
	Hits@10:  0.9966
	Hits@20:  0.9982
	MRR:  0.9486
Per Hop Answer Metrics
	3-Hop
		Hits@1:  0.9155
		MRR:  0.9514
	2-Hop
		Hits@1:  0.9074
		MRR:  0.9506
	1-Hop
		Hits@1:  0.9038
		MRR:  0.9415
Valid Action Count at Each Step
	Overall Average: 31.0355
		Step 1:  8.5566
		Step 2: 40.1103
		Step 3: 44.4395
Entropy Metrics
	Question Entropy:  0.6058
	Path Entropy:  1.8173
		Step 1:  0.0941
		Step 2:  0.8537
		Step 3:  0.8694
Reasoning Diagnostics (Top-Rollout)
	Special Step Rate:  0.1271
	Restart Rate:  0.0000
	No-Op Rate:  0.1271
	Cycle Rate:  0.1461
	Backtrack Rate:  0.1315
	Unique Edges:  2.2268
	Redundancy:  0.1350
	Avg Segment Hops:  2.6187
Answer(s) Endpoint Coverage Metrics
	Recall:  0.9879
	Precision:  0.1909
	F1 Score:  0.2518

