Test (beam) scores with best model from output/mquake_st/sa_qa_nhop_reason_4hop_seed42/model/model.ckpt
Answer Metrics
	Hits@1:  0.8863
	Hits@3:  0.9501
	Hits@5:  0.9668
	Hits@10:  0.9807
	Hits@20:  0.9887
	MRR:  0.9221
Per Hop Answer Metrics
	4-Hop
		Hits@1:  0.7841
		MRR:  0.8422
	3-Hop
		Hits@1:  0.8810
		MRR:  0.9162
	2-Hop
		Hits@1:  0.9086
		MRR:  0.9404
Valid Action Count at Each Step
	Overall Average: 50.7467
		Step 1: 21.3743
		Step 2: 57.5959
		Step 3: 58.6074
		Step 4: 65.4094
Entropy Metrics
	Question Entropy:  0.0144
	Path Entropy:  0.0578
		Step 1:  0.0028
		Step 2:  0.0115
		Step 3:  0.0127
		Step 4:  0.0308
Reasoning Diagnostics (Top-Rollout)
	Special Step Rate:  0.4318
	Restart Rate:  0.0000
	No-Op Rate:  0.4318
	Cycle Rate:  0.0198
	Backtrack Rate:  0.0000
	Unique Edges:  2.2699
	Redundancy:  0.0013
	Avg Segment Hops:  4.0000
Answer(s) Endpoint Coverage Metrics
	Recall:  0.9940
	Precision:  0.0207
	F1 Score:  0.0404
GT-Edge Overlap Metrics
	Recall:  0.6912
	Precision:  0.7080
	F1 Score:  0.6960
Node-Set Overlap Metrics
	Recall:  0.8695
	Precision:  0.9364
	F1 Score:  0.8964
Path Edit Distance Metrics:
	Overall Average:  0.9215
		4-Hop:  2.3977
		3-Hop:  1.1929
		2-Hop:  0.5099
Relation-Set Overlap Metrics
	Recall:  0.7868
	Precision:  0.8539
	F1 Score:  0.8091
Relation Edit Distance Metrics:
	Overall Average:  0.6602
		4-Hop:  1.6023
		3-Hop:  0.8714
		2-Hop:  0.3800

