List of NLP evaluations

I had to quickly compile a list of existing NLP evaluations. Each of
these includes a standardized task description, a corpus, and
evaluation software.

NP bracketing http://www.cnts.ua.ac.be/conll99/npb/

Chunking http://www.cnts.ua.ac.be/conll2000/chunking/

Clause ident. http://www.cnts.ua.ac.be/conll2001/clauses/

NER http://www.cnts.ua.ac.be/conll2002/ner/

semantic roles http://www.lsi.upc.edu/~srlconll/st04/st04.html

dep. parsing http://nextens.uvt.nl/~conll/

summarization http://duc.nist.gov

pp attachment

parsing

MT http://www.nist.gov/speech/tests/mt/

WSD http://nextens.uvt.nl/~conll/

IE in biology http://biocreative.sourceforge.net/

entailment http://www.pascal-network.org/Challenges/RTE2/

QA http://trec.nist.gov

There are many other tasks, e.g., the KDD cup.

Comments are closed.