public class WebScraper
extends java.lang.Object
Constructor and Description |
---|
WebScraper(java.lang.String url,
java.lang.String terms,
long depth,
ScraperMode mode)
Constructor that configures the scraper
|
Modifier and Type | Method and Description |
---|---|
void |
addStatusListener(ScraperStatusListener listener)
Adds a status listener that will receive the events generated by the scraper
|
long |
getDepth() |
ScraperMode |
getMode() |
java.util.LinkedList<ScraperLink> |
getPendingLinks() |
ScraperReport |
getReport()
Generates a report object that contains the relevant information of the scan.
|
java.util.List<Occurrence> |
getResults() |
java.lang.String |
getTerms() |
java.lang.String |
getUrl() |
void |
setDepth(long depth) |
void |
setMode(ScraperMode mode) |
void |
setTerms(java.lang.String terms) |
void |
setUrl(java.lang.String url) |
void |
startScraper()
Starts the scraper
|
public WebScraper(java.lang.String url, java.lang.String terms, long depth, ScraperMode mode) throws java.net.MalformedURLException
url
- URL to startScraperterms
- Terms to search in that sitedepth
- Link depth to scanmode
- Aggressiveness of the scanjava.net.MalformedURLException
public void startScraper()
public void addStatusListener(ScraperStatusListener listener)
listener
- Object that will receive the eventspublic java.lang.String getUrl()
public void setUrl(java.lang.String url)
public java.lang.String getTerms()
public void setTerms(java.lang.String terms)
public long getDepth()
public void setDepth(long depth)
public ScraperMode getMode()
public void setMode(ScraperMode mode)
public java.util.List<Occurrence> getResults()
public java.util.LinkedList<ScraperLink> getPendingLinks()
public ScraperReport getReport()