Skip to main content
U.S. flag

An official website of the United States government

Official websites use .gov
A .gov website belongs to an official government organization in the United States.

Secure .gov websites use HTTPS
A lock ( ) or https:// means you’ve safely connected to the .gov website. Share sensitive information only on official, secure websites.

Overview of the TREC 2005 Question Answering Track

Published

Author(s)

Ellen M. Voorhees, Hoa T. Dang

Abstract

The TREC 2005 Question Answering (QA) track contained three tasks: the main question answering task, the document ranking task, and the relationship task. In the main task, question series were used to define a set of targets. Each series was about a single target and contained factoid and list questions. The final question in the series was an ``Other'' question that asked for additional information about the target that was not covered by previous questions in the series. The main task was the same as the single TREC 2004 QA task, except that targets could also be events; the addition of events and dependencies between questions in a series made the task more difficult and resulted in lower evaluation scores than in 2004. The document ranking task was to return a ranked list of documents for each question from a subset of the questions in the main task, where the documents were thought to contain an answer to the question. In the relationship task, systems were given TREC-like topic statements that ended with a question asking for evidence for a particular relationship.
Citation
Special Publication (NIST SP) -

Keywords

evaluation, information/knowledge management, question answering

Citation

Voorhees, E. and Dang, H. (2006), Overview of the TREC 2005 Question Answering Track, Special Publication (NIST SP), National Institute of Standards and Technology, Gaithersburg, MD, [online], https://tsapps.nist.gov/publication/get_pdf.cfm?pub_id=50851 (Accessed August 8, 2024)

Issues

If you have any questions about this publication or are having problems accessing it, please contact reflib@nist.gov.

Created October 2, 2006, Updated February 17, 2017
https://www.nist.gov/publications/overview-trec-2005-question-answering-track
www.nist.gov
CC-MAIN-2024-33
85178
application/http; msgtype=response
sha1:LMZ6SISDX5T6DAKKJPTG7OWM4SFYWFHY
<urn:uuid:3db8ec56-b033-4e48-a4c1-186157aa4a92>
2024-08-08T10:57:18Z
54.174.12.241
text/html
sha1:EZ5JZMTWZALV2ONHX3ZYVZWGGN6Y2EI4
<urn:uuid:ea869e48-6391-4852-8124-43e085bb1f65>
https://www.nist.gov/publications/overview-trec-2005-question-answering-track
response
<urn:uuid:d3829181-ac61-4509-97d2-54a02306853d>
isPartOf: CC-MAIN-2024-33
publisher: Common Crawl
description: Wide crawl of the web for August 2024
operator: Common Crawl Admin (info@commoncrawl.org)
hostname: ip-10-67-67-208
software: Apache Nutch 1.20 (modified, https://github.com/commoncrawl/nutch/)
robots: checked via crawler-commons 1.5-SNAPSHOT (https://github.com/crawler-commons/crawler-commons)
format: WARC File Format 1.1
conformsTo: https://iipc.github.io/warc-specifications/specifications/warc-format/warc-1.1/