TREC Chemistry Track

Call for Papers for TREC-CHEM 2011 released! Click here.

Based on the important progresses made in information retrieval (IR) in terms of theoretical models and evaluations, more and more attention has recently been paid to research in domain specific IR, as evidenced by the organisation of Genomics and Legal tracks in TREC. Now is the right time to carry out large scale evaluations on chemistry datasets in order to promote the research in chemical IR in general and chemical patent IR in particular. Accordingly, we organize a chemical IR track in TREC in order to address the challenges in chemical and patent IR. We will provide a test collection consisting of full-text chemical patents from the IRF and research papers from several publishers (see below). The aim is to identify how current IR methods adapt to text containing chemical names and formulas. Without making it a prerequisite, we encourage participants to use entity identification methods to extract and index chemicals. The evaluation process will be a combination of the pooling/sampling/expert evaluation approach frequently used in TREC and an automatic evaluation method based on references in patent documents.

For most up-to-date information please also visit our wiki. If you are a participant, please remember to register to our mailing list trec-chem@ir-facility.org.