Test (beam) scores with best model from output/mquake_st/sa_qa_nhop_reason_4hop_seed0/model/model.ckpt
Answer Metrics
	Hits@1:  0.8916
	Hits@3:  0.9601
	Hits@5:  0.9668
	Hits@10:  0.9781
	Hits@20:  0.9820
	MRR:  0.9263
Per Hop Answer Metrics
	4-Hop
		Hits@1:  0.8239
		MRR:  0.8668
	3-Hop
		Hits@1:  0.8762
		MRR:  0.9164
	2-Hop
		Hits@1:  0.9119
		MRR:  0.9424
Valid Action Count at Each Step
	Overall Average: 34.3855
		Step 1: 21.3743
		Step 2: 27.6740
		Step 3: 29.1666
		Step 4: 59.3272
Entropy Metrics
	Question Entropy:  0.0227
	Path Entropy:  0.0908
		Step 1:  0.0084
		Step 2:  0.0074
		Step 3:  0.0202
		Step 4:  0.0548
Reasoning Diagnostics (Top-Rollout)
	Special Step Rate:  0.4147
	Restart Rate:  0.0000
	No-Op Rate:  0.4147
	Cycle Rate:  0.0066
	Backtrack Rate:  0.0000
	Unique Edges:  2.3384
	Redundancy:  0.0008
	Avg Segment Hops:  4.0000
Answer(s) Endpoint Coverage Metrics
	Recall:  0.9874
	Precision:  0.0171
	F1 Score:  0.0336
GT-Edge Overlap Metrics
	Recall:  0.7272
	Precision:  0.7442
	F1 Score:  0.7332
Node-Set Overlap Metrics
	Recall:  0.8914
	Precision:  0.9383
	F1 Score:  0.9101
Path Edit Distance Metrics:
	Overall Average:  0.7786
		4-Hop:  1.7898
		3-Hop:  0.9786
		2-Hop:  0.4901
Relation-Set Overlap Metrics
	Recall:  0.8173
	Precision:  0.8794
	F1 Score:  0.8393
Relation Edit Distance Metrics:
	Overall Average:  0.5372
		4-Hop:  1.1875
		3-Hop:  0.6619
		2-Hop:  0.3535

