edu.northwestern.at.utils.corpuslinguistics
Interface Pretokenizer

All Known Implementing Classes:

DefaultPretokenizer

public interface Pretokenizer

Prepares a string for tokenization.

Method Summary

java.lang.String

pretokenize(java.lang.String s) Prepares a string for tokenization.

Method Detail

pretokenize

java.lang.String pretokenize(java.lang.String s)

Prepares a string for tokenization.

Parameters:

s - The string to prepare for tokenization.

Returns:

The modified string ready for tokenization.