public static class FetcherJob.FetcherMapper extends org.apache.gora.mapreduce.GoraMapper<java.lang.String,WebPage,IntWritable,FetchEntry>
Mapper class for Fetcher.
This class reads the random integer written by GeneratorJob
as its
key while outputting the actual key and value arguments through a
FetchEntry
instance.
one host has a huge number of URLs in your table while other hosts have
not, FetcherReducer
will not be stuck on one host but process URLs
from other hosts as well.
Mapper.Context
Constructor and Description |
---|
FetcherMapper() |
Modifier and Type | Method and Description |
---|---|
protected void |
map(java.lang.String key,
WebPage page,
Mapper.Context context) |
protected void |
setup(Mapper.Context context) |
protected void setup(Mapper.Context context)
setup
in class Mapper<java.lang.String,WebPage,IntWritable,FetchEntry>
protected void map(java.lang.String key, WebPage page, Mapper.Context context) throws java.io.IOException, java.lang.InterruptedException
map
in class Mapper<java.lang.String,WebPage,IntWritable,FetchEntry>
java.io.IOException
java.lang.InterruptedException
Copyright © 2019 The Apache Software Foundation