TREC RAGTIME

Last Updated: May 13 2026

TREC RAGTIME is a TREC shared task to study and benchmark report generation from news in multiple languages. This is our second edition. Please refer to the 2025 archived page for the details for the 2025 edition.

Key features of the track are its focus on multi-faceted reports (going beyond factoid QA), and a citation-based evaluation (providing supporting evidence of claims made in the report).

It also benchmarks Multilingual (MLIR) retrieval and Auto-nuggetization as supporting subtasks.

Languages: English, Spanish, Chinese, and Russian

Track Guidelines

Search Service is up! Please also register at TREC to gain access to the enpoint. Short API documentation for our search service.

---

Tasks

1. Multilingual Report Generation

Given a set of documents in multiple languages and a “report request” that describes the information need, generate a report in English that summarizes the information.

2. Multilingual Retrieval

Given a set of documents in multiple languages and a “report request” that describes the information need, retrieve documents that help satisfy this information need.

3. Auto-nuggetization (Request Decomposition) – New in 2026

Given the retrieval collection and a report request, generate a list of k single-sentence questions that should be answered in a report. This task allows participants to explore identification of main topics that should appear in the report.

Back to top

---

Timeline

• May 2026
  Evaluation document collection released: [HuggingFace]
  Track Guidelines Released
• Mid June 2026
  Topics Released [Link]
• August 14 2026
  Submissions Due
• October 2026
  Feedback on Final Submissions
• December 2026
  TREC 2026 Conference

Back to top

---

See Also: TREC NeuCLIR

TREC NeuCLIR (Neural CLIR) was the predecessor of TREC RAGTIME. In 2024, NeuCLIR included a pilot study of report generation. You can find more about NeuCLIR at the TREC NeuCLIR website.

Back to top

---

Other RAG-related Tracks at TREC 2026

Consider also participating in other RAG-related tracks at TREC 2026.

• TREC RAG Track
• TREC BioGen Track
• TREC DRAGUN Track
• TREC iKAT

---

Organizers

In alphabetical order:

• Dawn Lawrie, Johns Hopkins University, HLTCOE
• Sean MacAvaney, University of Glasgow
• James Mayfield, Johns Hopkins University, HLTCOE
• Luca Soldaini, Microsoft
• Eugene Yang, Johns Hopkins University, HLTCOE
• Andrew Yates, Johns Hopkins University, HLTCOE

Back to top

---

Contact

• Join the Mailing List for updates and to post general questions
• Twitter: @trec_ragtime
• Any questions: ragtime-organizers@googlegroups.com

Back to top