List of NLP evaluations

I had to quickly compile a list of existing NLP evaluations. Each of
these includes a standardized task description, a corpus, and
evaluation software.

NP bracketing http://www.cnts.ua.ac.be/conll99/npb/

Chunking http://www.cnts.ua.ac.be/conll2000/chunking/

Clause ident. http://www.cnts.ua.ac.be/conll2001/clauses/

NER http://www.cnts.ua.ac.be/conll2002/ner/

semantic roles http://www.lsi.upc.edu/~srlconll/st04/st04.html

dep. parsing http://nextens.uvt.nl/~conll/

summarization http://duc.nist.gov

pp attachment

parsing

MT http://www.nist.gov/speech/tests/mt/

WSD http://nextens.uvt.nl/~conll/

IE in biology http://biocreative.sourceforge.net/

entailment http://www.pascal-network.org/Challenges/RTE2/

QA http://trec.nist.gov

There are many other tasks, e.g., the KDD cup.

Google to open lab in Ann Arbor

Google has decided to open a lab in Ann Arbor. Two of the main directions of work will be targeted ads and library scanning.

http://www.nytimes.com/2006/07/11/technology/11google.html
http://www.mlive.com/newsflash/michigan/index.ssf?/base/news-35/115259956475940.xml&storylist=newsmichigan
http://www.mlive.com/newsflash/michigan/index.ssf?/base/business-9/1152621861309560.xml&storylist=newsmichigan
http://www.freep.com/apps/pbcs.dll/article?AID=/20060710/NEWS99/307100004/1122
http://www.mlive.com/news/aanews/index.ssf?/base/news-18/11527152409090.xml&coll=2
http://www.freep.com/apps/pbcs.dll/article?AID=2006607120342
http://www.mlive.com/news/aanews/index.ssf?/base/news-18/115444325633730.xml&coll=2