edu.stanford.nlp.objectbank
Interface TokenizerFactory<T>

All Superinterfaces:

IteratorFromReaderFactory<T>

All Known Implementing Classes:

PTBTokenizer.PTBTokenizerFactory, TreeTokenizerFactory

public interface TokenizerFactory<T>
extends IteratorFromReaderFactory<T>

A TokenizerFactory is used to convert a java.io.Reader into a Tokenizer (or an Iterator) over the Objects represented by the text in the java.io.Reader. It's mainly a convenience, since you could cast down anyway.

Author:

Christopher Manning

Method Summary

Tokenizer<T>

getTokenizer(Reader r)

Methods inherited from interface edu.stanford.nlp.objectbank.IteratorFromReaderFactory

getIterator

Method Detail

getTokenizer

Tokenizer<T> getTokenizer(Reader r)