Test (beam) scores with best model from output/mquake_st/sa_qa_nhop_reason_4hop_seed0/model/model.ckpt
Answer Metrics
	Hits@1:  0.8719
	Hits@3:  0.9501
	Hits@5:  0.9639
	Hits@10:  0.9772
	Hits@20:  0.9820
	MRR:  0.9134
Per Hop Answer Metrics
	4-Hop
		Hits@1:  0.8201
		MRR:  0.8656
	3-Hop
		Hits@1:  0.8762
		MRR:  0.9160
	2-Hop
		Hits@1:  0.8800
		MRR:  0.9215
Valid Action Count at Each Step
	Overall Average: 34.2813
		Step 1: 21.3743
		Step 2: 27.6109
		Step 3: 28.9715
		Step 4: 59.1684
Entropy Metrics
	Question Entropy:  0.0211
	Path Entropy:  0.0844
		Step 1:  0.0066
		Step 2:  0.0054
		Step 3:  0.0185
		Step 4:  0.0538
Reasoning Diagnostics (Top-Rollout)
	Special Step Rate:  0.4135
	Restart Rate:  0.0000
	No-Op Rate:  0.4135
	Cycle Rate:  0.0082
	Backtrack Rate:  0.0000
	Unique Edges:  2.3435
	Redundancy:  0.0008
	Avg Segment Hops:  4.0000
Answer(s) Endpoint Coverage Metrics
	Recall:  0.9867
	Precision:  0.0171
	F1 Score:  0.0335
GT-Edge Overlap Metrics
	Recall:  0.7203
	Precision:  0.7354
	F1 Score:  0.7252
Node-Set Overlap Metrics
	Recall:  0.8858
	Precision:  0.9326
	F1 Score:  0.9044
Path Edit Distance Metrics:
	Overall Average:  0.7934
		4-Hop:  1.7652
		3-Hop:  0.9619
		2-Hop:  0.5272
Relation-Set Overlap Metrics
	Recall:  0.8085
	Precision:  0.8696
	F1 Score:  0.8298
Relation Edit Distance Metrics:
	Overall Average:  0.5585
		4-Hop:  1.1742
		3-Hop:  0.6492
		2-Hop:  0.3972

