nlptext-parsingtext-mininginformation-extraction

What is CoNLL data format?


I am using a open source jar (Mate Parser) which outputs in the CoNLL 2009 format after dependency parsing. I want to use the dependency parsing results for Information Extraction, however, I only understand part of the output in the CoNLL data format.

Can someone explain the CoNLL data format?


Solution

  • There are many different CoNLL formats since CoNLL is a different shared task each year. The format for CoNLL 2009 is described here. Each line represents a single word with a series of tab-separated fields. _s indicate empty values. Mate-Parser's manual says that it uses the first 12 columns of CoNLL 2009:

    ID FORM LEMMA PLEMMA POS PPOS FEAT PFEAT HEAD PHEAD DEPREL PDEPREL
    

    The definition of some of these columns come from earlier shared tasks (the CoNLL-X format used in 2006 and 2007):

    There are variants of those columns (e.g., PPOS but not POS) that start with P indicate that the value was automatically predicted rather a gold standard value.

    Update: There is now a CoNLL-U data format as well which extends the CoNLL-X format.