SENSEVAL Home Page

Evaluating Word Sense Disambiguation Systems

There are now many computer programs for automatically determining which sense a word is being used in. One would like to be able to say which were better, which worse, and also which words, or varieties of language, presented particular problems to which programs. SENSEVAL is designed to meet this need.

The first SENSEVAL took place in the summer of 1998, for English, French and Italian, culminating in a workshop held at Herstmonceux Castle, Sussex, England on September 2-4. The SENSEVAL-2 workshop will be held in conjunction with ACL/EACL 2001, in Toulouse, France, probably July 5--6 2001.

Pointers

SENSEVAL 2 NEW: home page here.

Notes from SENSEVAL-2 planning meeting, Hong Kong, Oct 2000 here
Schedule, SENSEVAL-2 here.
Task design for SENSEVAL-2

SENSEVAL 1

Home page for SENSEVAL-1.
English SENSEVAL-1 resources now in the public domain.
For the 1998 French and Italian tasks see the ROMANSEVAL site.
For the full account of SENSEVAL-1 see the Special Issue of the Journal Computers and the Humanities (34(1-2)), guest editors Kilgarriff and Palmer, May 2000.
SENSEVAL: An Exercise in Evaluating Word Sense Disambiguation Programs A. Kilgarriff. In Proc. LREC, Granada, May 1998. Pp 581--588. Postscript, 6 pages.
English SENSEVAL: Report and Results A. Kilgarriff and J. Rosenzweig. In Proc. LREC, Athens, May-June 2000.
Summaries of the EPSRC-funded component of the work can be found here: 1 page, in html or 5 pages, in postscript.

This page is maintained by the SENSEVAL coordinator and was last updated on 7 Nov 2000 .