Test (beam) scores with best model from output/mquake_st/sa_qa_nhop_reason_4hop_seed42/model/model.ckpt
Answer Metrics
	Hits@1:  0.8630
	Hits@3:  0.9457
	Hits@5:  0.9637
	Hits@10:  0.9798
	Hits@20:  0.9876
	MRR:  0.9081
Per Hop Answer Metrics
	4-Hop
		Hits@1:  0.7822
		MRR:  0.8429
	3-Hop
		Hits@1:  0.8627
		MRR:  0.9047
	2-Hop
		Hits@1:  0.8789
		MRR:  0.9224
Valid Action Count at Each Step
	Overall Average: 50.4072
		Step 1: 21.3743
		Step 2: 56.8307
		Step 3: 58.7629
		Step 4: 64.6611
Entropy Metrics
	Question Entropy:  0.0160
	Path Entropy:  0.0641
		Step 1:  0.0040
		Step 2:  0.0131
		Step 3:  0.0140
		Step 4:  0.0329
Reasoning Diagnostics (Top-Rollout)
	Special Step Rate:  0.4341
	Restart Rate:  0.0000
	No-Op Rate:  0.4341
	Cycle Rate:  0.0204
	Backtrack Rate:  0.0000
	Unique Edges:  2.2617
	Redundancy:  0.0022
	Avg Segment Hops:  4.0000
Answer(s) Endpoint Coverage Metrics
	Recall:  0.9938
	Precision:  0.0207
	F1 Score:  0.0405
GT-Edge Overlap Metrics
	Recall:  0.6817
	Precision:  0.7004
	F1 Score:  0.6870
Node-Set Overlap Metrics
	Recall:  0.8635
	Precision:  0.9332
	F1 Score:  0.8915
Path Edit Distance Metrics:
	Overall Average:  0.9424
		4-Hop:  2.4091
		3-Hop:  1.1857
		2-Hop:  0.5455
Relation-Set Overlap Metrics
	Recall:  0.7775
	Precision:  0.8475
	F1 Score:  0.8009
Relation Edit Distance Metrics:
	Overall Average:  0.6840
		4-Hop:  1.5966
		3-Hop:  0.8754
		2-Hop:  0.4185

