edu.stanford.nlp.trees.international.negra
Class NegraPennTokenizer

java.lang.Object
  edu.stanford.nlp.process.AbstractTokenizer
      edu.stanford.nlp.process.LexerTokenizer
          edu.stanford.nlp.trees.international.negra.NegraPennTokenizer

All Implemented Interfaces:

Tokenizer, Iterator

public class NegraPennTokenizer
extends LexerTokenizer

Produces a tokenizer for the NEGRA corpus in context-free Penn Treebank format.

Author:

Roger Levy

Field Summary

Fields inherited from class edu.stanford.nlp.process.AbstractTokenizer

nextToken

Constructor Summary

NegraPennTokenizer(Reader r)

Method Summary

static void

main(String[] args)

Methods inherited from class edu.stanford.nlp.process.LexerTokenizer

getNext

Methods inherited from class edu.stanford.nlp.process.AbstractTokenizer

hasNext, next, peek, remove, tokenize

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

NegraPennTokenizer

public NegraPennTokenizer(Reader r)

Method Detail

main

public static void main(String[] args)
                 throws IOException

Throws:

IOException