it.cnr.isti.hpc.text

Class TokenSegmenter

java.lang.Object

it.cnr.isti.hpc.text.TokenSegmenter

public class TokenSegmenter
extends Object

Author:

Diego Ceccarelli, diego.ceccarelli@isti.cnr.it created on 08/giu/2012

Method Summary

Methods

Modifier and Type	Method and Description
static TokenSegmenter	getInstance()
String[]	tokenize(String sentence)
List<Token>	tokenizePos(String sentence)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Method Detail

getInstance

public static TokenSegmenter getInstance()

tokenize

public String[] tokenize(String sentence)

tokenizePos

public List<Token> tokenizePos(String sentence)