org.kepler.hadoop.io.input

Class DuplicatedTextRecordReader

java.lang.Object

org.apache.hadoop.mapreduce.RecordReader<org.apache.hadoop.io.IntWritable,org.apache.hadoop.io.Text>

org.kepler.hadoop.io.input.DuplicatedTextRecordReader

All Implemented Interfaces:

java.io.Closeable, java.lang.AutoCloseable

public class DuplicatedTextRecordReader
extends org.apache.hadoop.mapreduce.RecordReader<org.apache.hadoop.io.IntWritable,org.apache.hadoop.io.Text>

This class provides Reader to read file(s) repeatedly. Key is the current index value, value is the whole content of the file. The whole content of the file will be sent to value repeatedly unless key number reaches parallel number.

Author:

Jianwu Wang (jianwu@sdsc.edu)

Constructor Summary

Constructors

Constructor and Description
DuplicatedTextRecordReader()

Method Summary

Modifier and Type	Method and Description
void	close()
org.apache.hadoop.io.IntWritable	getCurrentKey()
org.apache.hadoop.io.Text	getCurrentValue()
float	getProgress()
void	initialize(org.apache.hadoop.mapreduce.InputSplit split, org.apache.hadoop.mapreduce.TaskAttemptContext context)
boolean	nextKeyValue()
void	setParaNum(int paraNum)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

DuplicatedTextRecordReader

public DuplicatedTextRecordReader()

Method Detail

initialize

public void initialize(org.apache.hadoop.mapreduce.InputSplit split,
                       org.apache.hadoop.mapreduce.TaskAttemptContext context)
                throws java.io.IOException,
                       java.lang.InterruptedException

Specified by:

initialize in class org.apache.hadoop.mapreduce.RecordReader<org.apache.hadoop.io.IntWritable,org.apache.hadoop.io.Text>

Throws:

java.io.IOException

java.lang.InterruptedException

getProgress

public float getProgress()
                  throws java.io.IOException

Specified by:

getProgress in class org.apache.hadoop.mapreduce.RecordReader<org.apache.hadoop.io.IntWritable,org.apache.hadoop.io.Text>

Throws:

java.io.IOException

getCurrentKey

public org.apache.hadoop.io.IntWritable getCurrentKey()
                                               throws java.io.IOException,
                                                      java.lang.InterruptedException

Specified by:

getCurrentKey in class org.apache.hadoop.mapreduce.RecordReader<org.apache.hadoop.io.IntWritable,org.apache.hadoop.io.Text>

Throws:

java.io.IOException

java.lang.InterruptedException

getCurrentValue

public org.apache.hadoop.io.Text getCurrentValue()
                                          throws java.io.IOException,
                                                 java.lang.InterruptedException

Specified by:

getCurrentValue in class org.apache.hadoop.mapreduce.RecordReader<org.apache.hadoop.io.IntWritable,org.apache.hadoop.io.Text>

Throws:

java.io.IOException

java.lang.InterruptedException

nextKeyValue

public boolean nextKeyValue()
                     throws java.io.IOException,
                            java.lang.InterruptedException

Specified by:

nextKeyValue in class org.apache.hadoop.mapreduce.RecordReader<org.apache.hadoop.io.IntWritable,org.apache.hadoop.io.Text>

Throws:

java.io.IOException

java.lang.InterruptedException

close

public void close()
           throws java.io.IOException

Specified by:

close in interface java.io.Closeable

Specified by:

close in interface java.lang.AutoCloseable

Specified by:

close in class org.apache.hadoop.mapreduce.RecordReader<org.apache.hadoop.io.IntWritable,org.apache.hadoop.io.Text>

Throws:

java.io.IOException

setParaNum

public void setParaNum(int paraNum)
                throws java.io.IOException

Throws:

java.io.IOException