public interface Protocol extends FieldPluggable, Configurable
Modifier and Type | Field and Description |
---|---|
static java.lang.String |
CHECK_BLOCKING
Property name.
|
static java.lang.String |
CHECK_ROBOTS
Property name.
|
static java.lang.String |
X_POINT_ID
The name of the extension point.
|
Modifier and Type | Method and Description |
---|---|
ProtocolOutput |
getProtocolOutput(java.lang.String url,
WebPage page) |
crawlercommons.robots.BaseRobotRules |
getRobotRules(java.lang.String url,
WebPage page)
Retrieve robot rules applicable for this url.
|
getFields
getConf, setConf
static final java.lang.String X_POINT_ID
static final java.lang.String CHECK_BLOCKING
static final java.lang.String CHECK_ROBOTS
ProtocolOutput getProtocolOutput(java.lang.String url, WebPage page)
crawlercommons.robots.BaseRobotRules getRobotRules(java.lang.String url, WebPage page)
url
- url to checkpage
- Copyright © 2019 The Apache Software Foundation