it.cnr.isti.hpc.dexter.shingle

Class ShingleExtractor

java.lang.Object

it.cnr.isti.hpc.dexter.shingle.ShingleExtractor

All Implemented Interfaces:

Iterable<Shingle>

public class ShingleExtractor
extends Object
implements Iterable<Shingle>

ShingleExtractor extracts all the ngrams (of fixed length) from the text of an article. Please observe that the ShingleExtractor perform a cleaning step over each shingle using the standard spot cleaner. Each shingle produced could be different but the 'original' fragment, but it contains the original start/end position in the original test.

Author:

Salvatore Trani, salvatore.trani@isti.cnr.it created on 02/aug/2012

See Also:

Shingle, SpotManager

Constructor Summary

Constructors

Constructor and Description
ShingleExtractor(it.cnr.isti.hpc.wikipedia.article.Article a)
ShingleExtractor(String text)

Method Summary

Methods

Modifier and Type	Method and Description
int	getMaxShingleSize()
Iterator<Shingle>	iterator()
void	setMaxShingleSize(int maxShingleSize)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

ShingleExtractor

public ShingleExtractor(it.cnr.isti.hpc.wikipedia.article.Article a)

ShingleExtractor

public ShingleExtractor(String text)

Method Detail

getMaxShingleSize

public int getMaxShingleSize()

iterator

public Iterator<Shingle> iterator()

Specified by:

iterator in interface Iterable<Shingle>

setMaxShingleSize

public void setMaxShingleSize(int maxShingleSize)