Nevelow Mart & Luftig on Curation of Legal Resources, and Digest and Citator Results in Wexis

Professor Susan Nevelow Mart of the University of Colorado Boulder School of Law, and Professor Dr. Jeffrey T. Luftig of the University of Colorado, Boulder, have posted the abstract of a new paper entitled The Case for Curation: The Relevance of Digest and Citator Results in Westlaw and Lexis.

Here is the abstract:

Humans and machines are both involved in the creation of legal research resources. For legal information retrieval systems, the human-curated finding aid is being overtaken by the computer algorithm. But human-curated finding aids still exist. One of them is the West Key Number system. The Key Number system’s headnote classification of case law, started back in the nineteenth century, was and is the creation of humans. The retrospective headnote classification of the cases in Lexis’s case databases, started in 1999, was created primarily although not exclusively with computer algorithms. So how do these two very different systems deal with a similar headnote from the same case, when they link the headnote to the digesting and citator functions in their respective databases? This paper continues an investigation into this question, looking at the relevance of results from digest and citator search run on matching headnotes in ninety important federal and state cases, to see how each performs. For digests, where the results are curated – where a human has made a judgment about the meaning of a case and placed it in a classification system – humans still have an advantage. For citators, where algorithm is battling algorithm to find relevant results, it is a matter of the better algorithm winning. But no one algorithm is doing a very good job of finding all the relevant results; the overlap between the two citator systems is not that large. The lesson for researchers: know how your legal research system was created, what involvement, if any, humans had in the curation of the system, and what a researcher can and cannot expect from the system you are using.

This paper was presented at AALL 2012: American Association of Law Libraries’ Annual Meeting, held 21-24 July 2012, in Boston Massachusetts, USA.

This entry was posted in Articles and papers, Research findings and tagged , , , , , , , , , , , , , , , , , , , , , , . Bookmark the permalink.

3 Responses to Nevelow Mart & Luftig on Curation of Legal Resources, and Digest and Citator Results in Wexis

  1. legalinformatics says:

    The full text of the paper has now been posted: http://ssrn.com/abstract=2112574

  2. Pingback: DIGEST: How KeyCite and Shepard’s Affect Results in Wexis.

  3. Pingback: DIGEST: How KeyCite and Shepard's Affect Results in Wexis. | Annotations

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s