Test (beam) scores with best model from output/mquake_st/sa_qa_nhop_reason_4hop_seed100/model/model.ckpt
Answer Metrics
	Hits@1:  0.8469
	Hits@3:  0.9289
	Hits@5:  0.9450
	Hits@10:  0.9601
	Hits@20:  0.9741
	MRR:  0.8918
Per Hop Answer Metrics
	4-Hop
		Hits@1:  0.8314
		MRR:  0.8620
	3-Hop
		Hits@1:  0.8460
		MRR:  0.8902
	2-Hop
		Hits@1:  0.8502
		MRR:  0.8983
Valid Action Count at Each Step
	Overall Average: 32.4953
		Step 1: 21.3743
		Step 2: 24.9711
		Step 3: 28.6404
		Step 4: 54.9953
Entropy Metrics
	Question Entropy:  0.0211
	Path Entropy:  0.0845
		Step 1:  0.0068
		Step 2:  0.0065
		Step 3:  0.0188
		Step 4:  0.0524
Reasoning Diagnostics (Top-Rollout)
	Special Step Rate:  0.4106
	Restart Rate:  0.0000
	No-Op Rate:  0.4106
	Cycle Rate:  0.0110
	Backtrack Rate:  0.0000
	Unique Edges:  2.3555
	Redundancy:  0.0008
	Avg Segment Hops:  4.0000
Answer(s) Endpoint Coverage Metrics
	Recall:  0.9849
	Precision:  0.0177
	F1 Score:  0.0347
GT-Edge Overlap Metrics
	Recall:  0.7154
	Precision:  0.7313
	F1 Score:  0.7206
Node-Set Overlap Metrics
	Recall:  0.8763
	Precision:  0.9224
	F1 Score:  0.8946
Path Edit Distance Metrics:
	Overall Average:  0.8025
		4-Hop:  1.8049
		3-Hop:  0.9143
		2-Hop:  0.5565
Relation-Set Overlap Metrics
	Recall:  0.8004
	Precision:  0.8592
	F1 Score:  0.8206
Relation Edit Distance Metrics:
	Overall Average:  0.5782
		4-Hop:  1.1856
		3-Hop:  0.6373
		2-Hop:  0.4332

