TREC Chemical IR Evaluation campaign

CALL FOR PARTICIPATION

The 3rd TREC-CHEM evaluation campaign continues the work done in the previous two years on assessment of IR tools for the chemical domain, with a special focus this year on bio-chemistry.

The organizers make available to participants a large collection of patent documents and scientific articles, including the attached non-text information (images, structure files)

Participants are invited to register and to submit results to one or more of three tasks:

  • Prior Art - Given a patent application, find all other patent documents which may be lead to the rejection of the application
  • Technology Survey - Given an information need (from the bio-chemistry domain) expressed in natural language, retrieve all patents and scientific articles which may satisfy this need
  • Image-to-Structure - Given a raster image file, determine the structure represented in this file and return it as a chemical structure information file (e.g. MOL, but exact format still to be decided).

Registration for the track MUST be done both on the NIST website at http://ir.nist.gov/trecsubmit.open/application.html
AND by sending the signed licence agreements available at https://download.ir-facility.org/trec/ to the organizer.

Registration does not bind you to sending in results, so please register as soon as possible if you have any intention to participate.

Tentative Timeline

  • Data Release: For TS and PA will use the same data collection as in 2010: [1]. For Image2Structure - April, 2011
  • PA topics release April, 2011
  • TS Topics Release: May, 2011
  • Image2Structure Topics: May, 2011
  • Submission of runs by participants (TS & Image2Structure topics): August, 2011
  • Submission of runs by participants (PA topics): September 1st, 2011
  • Release of Evaluation results: September 21st, 2011
  • Submission of Working Notes: Mid to End of October 2011
  • TREC in Gaithersburg, MD: November 2011

Track mailing list: trec-chem@ir-facility.org

Track wiki
https://wiki.ir-facility.org/index.php/TREC-CHEM_2011 

TREC-CHEM WIKI

You can find all information about the TREC Chemistry Track at the .