Run
arafacts_balanced
Input Claims
500
Pipeline Evaluated
361
Accuracy / Macro F1
Baseline Accuracy35.80%
Pipeline Accuracy36.84%
Accuracy Delta+1.04 pts
Baseline Macro F130.52%
Pipeline Macro F124.42%
Macro F1 Delta-6.10 pts
Evaluation Counts
Baseline Evaluated
500
Pipeline Evaluated
361
Coverage
72.20%
Retrieval Diagnostics
Generated Questions
2,075
Planned Queries
6,042
Search Result URLs
14,481
Page Records
1,805
Successful Extractions
1,465
Extraction Success Rate
81.16%
Selected Valid Passages
8,513
Question Answers
2,075
Answerable Questions
1,028
Passage Answerability
49.54%
Claims With Gold URLs
430
Exact Gold URL Hit Rate
0.23%
Domain Gold URL Hit Rate
18.84%