org.kepler.hadoop.io.input

Class FilePathRecordReader

java.lang.Object

org.apache.hadoop.mapreduce.RecordReader<org.apache.hadoop.io.Text,org.apache.hadoop.io.Text>

org.kepler.hadoop.io.input.FilePathRecordReader

All Implemented Interfaces:

java.io.Closeable, java.lang.AutoCloseable

public class FilePathRecordReader
extends org.apache.hadoop.mapreduce.RecordReader<org.apache.hadoop.io.Text,org.apache.hadoop.io.Text>

This class provides RecordReader to read file paths. Key is file name (no path info), value is file path. This record only list each file once, even for large files that are automatically partitioned on HDFS.

Author:

Jianwu Wang (jianwu@sdsc.edu)

Constructor Summary

Constructors

Constructor and Description
FilePathRecordReader()

Method Summary

Modifier and Type	Method and Description
void	close()
org.apache.hadoop.io.Text	getCurrentKey()
org.apache.hadoop.io.Text	getCurrentValue()
float	getProgress()
void	initialize(org.apache.hadoop.mapreduce.InputSplit split, org.apache.hadoop.mapreduce.TaskAttemptContext context)
boolean	nextKeyValue()

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

FilePathRecordReader

public FilePathRecordReader()

Method Detail

initialize

public void initialize(org.apache.hadoop.mapreduce.InputSplit split,
                       org.apache.hadoop.mapreduce.TaskAttemptContext context)
                throws java.io.IOException,
                       java.lang.InterruptedException

Specified by:

initialize in class org.apache.hadoop.mapreduce.RecordReader<org.apache.hadoop.io.Text,org.apache.hadoop.io.Text>

Throws:

java.io.IOException

java.lang.InterruptedException

getProgress

public float getProgress()
                  throws java.io.IOException

Specified by:

getProgress in class org.apache.hadoop.mapreduce.RecordReader<org.apache.hadoop.io.Text,org.apache.hadoop.io.Text>

Throws:

java.io.IOException

getCurrentKey

public org.apache.hadoop.io.Text getCurrentKey()
                                        throws java.io.IOException,
                                               java.lang.InterruptedException

Specified by:

getCurrentKey in class org.apache.hadoop.mapreduce.RecordReader<org.apache.hadoop.io.Text,org.apache.hadoop.io.Text>

Throws:

java.io.IOException

java.lang.InterruptedException

getCurrentValue

public org.apache.hadoop.io.Text getCurrentValue()
                                          throws java.io.IOException,
                                                 java.lang.InterruptedException

Specified by:

getCurrentValue in class org.apache.hadoop.mapreduce.RecordReader<org.apache.hadoop.io.Text,org.apache.hadoop.io.Text>

Throws:

java.io.IOException

java.lang.InterruptedException

nextKeyValue

public boolean nextKeyValue()
                     throws java.io.IOException,
                            java.lang.InterruptedException

Specified by:

nextKeyValue in class org.apache.hadoop.mapreduce.RecordReader<org.apache.hadoop.io.Text,org.apache.hadoop.io.Text>

Throws:

java.io.IOException

java.lang.InterruptedException

close

public void close()
           throws java.io.IOException

Specified by:

close in interface java.io.Closeable

Specified by:

close in interface java.lang.AutoCloseable

Specified by:

close in class org.apache.hadoop.mapreduce.RecordReader<org.apache.hadoop.io.Text,org.apache.hadoop.io.Text>

Throws:

java.io.IOException