it.cnr.isti.hpc.dexter.spot.clean

Class SpotManager

java.lang.Object

it.cnr.isti.hpc.dexter.spot.clean.SpotManager

public class SpotManager
extends Object

A SpotManager takes care of cleaning the anchor texts extracted from the Wikipedia articles in order to produce a dictionary of spots. Each anchor text is processed over a pipeline of functions that could filter out it, clean it, or generate several different variations of the text.

Author:

Diego Ceccarelli, diego.ceccarelli@isti.cnr.it created on 20/lug/2012

Constructor Summary

Constructors

Constructor and Description
SpotManager() Generates a new pipeline
SpotManager(Pipe<String> pipe) Creates a spot manager performing the cleaning described in the given pipe.

Method Summary

Methods

Modifier and Type	Method and Description
void	add(Function<String> fun) Adds a new function to the pipeline
String	clean(String spot) Cleans an anchor, i.e., performs over the text only the cleaners previously added to the pipe.
static String	cleanText(String text) Uses the standard cleaner to clean a given text
Set<String>	getAllSpots(it.cnr.isti.hpc.wikipedia.article.Article a) Given a Wikipedia article returns a set containing all the processed anchors in the article.
static SpotManager	getStandardSpotCleaner() Returns a StandardSpotCleaner used by Dexter to clean the anchors.
static SpotManager	getStandardSpotManager() Returns a StandardSpotManager used by Dexter to process the anchors.
protected boolean	isFilter(String s)
Set<String>	process(String spot)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

SpotManager

public SpotManager()

Generates a new pipeline

SpotManager

public SpotManager(Pipe<String> pipe)

Creates a spot manager performing the cleaning described in the given pipe.

Parameters:

pipe - - a pipe containing all the cleaning functions to apply to an anchor.

Method Detail

cleanText

public static String cleanText(String text)

Uses the standard cleaner to clean a given text

add

public void add(Function<String> fun)

Adds a new function to the pipeline

getStandardSpotManager

public static SpotManager getStandardSpotManager()

Returns a StandardSpotManager used by Dexter to process the anchors.

getStandardSpotCleaner

public static SpotManager getStandardSpotCleaner()

Returns a StandardSpotCleaner used by Dexter to clean the anchors.

clean

public String clean(String spot)

Cleans an anchor, i.e., performs over the text only the cleaners previously added to the pipe.

isFilter

protected boolean isFilter(String s)

getAllSpots

public Set<String> getAllSpots(it.cnr.isti.hpc.wikipedia.article.Article a)

Given a Wikipedia article returns a set containing all the processed anchors in the article.

process

public Set<String> process(String spot)