Grossman et al.: Overview of the TREC 2011 Legal Track

Maura R. Grossman, Esq., of Wachtell, Lipton, Rosen & Katz, and colleagues, have published Overview of the TREC 2011 Legal Track, in The Twentieth Text REtrieval Conference (TREC 2011) Proceedings.

Here is the abstract:

The TREC 2011 Legal Track consisted of a single task: the learning task, which captured elements of both the TREC 2010 learning and interactive tasks. Participants were required to rank the entire corpus of 685,592 documents by their estimate of the probability of responsiveness to each of three topics, and also to provide a quantitative estimate of that probability. Participants were permitted to request up to 1,000 responsiveness determinations from a Topic Authority for each topic. Participants elected either to use only these responsiveness determinations in preparing automatic submissions, or to augment these determinations with their own manual review in preparing technology-assisted submissions. We provide an overview of the task and a summary of the results. More detailed results are available in the Appendix to the TREC 2011 Proceedings.

HT Gordon V. Cormack.

Cormack et al., Overview of the TREC 2010 Legal Track

Professor Dr. Gordon V. Cormack of the University of Waterloo; Maura R. Grossman, Esq., of Wachtell, Lipton; Bruce Hedin of H5, and Professor Dr. Douglas W. Oard of the University of Maryland, have posted Overview of the TREC 2010 Legal Track. Here is the abstract:

TREC 2010 was the fifth year of the Legal Track, which focuses on evaluation of search technology for discovery of electronically stored information in litigation and regulatory settings. The TREC 2010 Legal Track consisted of two distinct tasks: the Learning task, in which participants were required to estimate the probability of relevance for each document in a large collection, given a seed set of documents, each coded as responsive or non-responsive; and the Interactive task, in which participants were required to identify all relevant documents using a human-in-the-loop process.