org.kepler.stratosphere.io.input

Class DataFileInputFormat

java.lang.Object

eu.stratosphere.api.common.io.FileInputFormat<eu.stratosphere.types.Record>

eu.stratosphere.api.java.record.io.FileInputFormat

org.kepler.stratosphere.io.input.DataFileInputFormat

All Implemented Interfaces:

eu.stratosphere.api.common.io.InputFormat<eu.stratosphere.types.Record,eu.stratosphere.core.fs.FileInputSplit>, java.io.Serializable

public class DataFileInputFormat
extends eu.stratosphere.api.java.record.io.FileInputFormat

Read the whole file as one pair. key is the file name, value is file content. Built based on eu.stratosphere.pact.common.io.TextInputFormat class by changing readRecord() and createInputSplits().

Author:

Jianwu Wang

See Also:

Serialized Form

Nested Class Summary

Nested classes/interfaces inherited from class eu.stratosphere.api.common.io.FileInputFormat

eu.stratosphere.api.common.io.FileInputFormat.AbstractConfigBuilder<T>, eu.stratosphere.api.common.io.FileInputFormat.ConfigBuilder, eu.stratosphere.api.common.io.FileInputFormat.FileBaseStatistics, eu.stratosphere.api.common.io.FileInputFormat.InputSplitOpenThread

Field Summary

Fields inherited from class eu.stratosphere.api.common.io.FileInputFormat

filePath, minSplitSize, numSplits, openTimeout, splitLength, splitStart, stream

Constructor Summary

Constructors

Constructor and Description
DataFileInputFormat()

Method Summary

Modifier and Type	Method and Description
eu.stratosphere.core.fs.FileInputSplit[]	createInputSplits(int minNumSplits)
eu.stratosphere.api.common.io.FileInputFormat.FileBaseStatistics	getStatistics(eu.stratosphere.api.common.io.statistics.BaseStatistics cachedStatistics)
boolean	nextRecord(eu.stratosphere.types.Record record)
void	open(eu.stratosphere.core.fs.FileInputSplit split)
boolean	reachedEnd() Checks whether the current split is at its end.

Methods inherited from class eu.stratosphere.api.common.io.FileInputFormat

close, configure, configureFileFormat, getFilePath, getFileStats, getInputSplitType, getMinSplitSize, getNumSplits, getOpenTimeout, getSplitLength, getSplitStart, setFilePath, setFilePath, setMinSplitSize, setNumSplits, setOpenTimeout, toString

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Constructor Detail

DataFileInputFormat

public DataFileInputFormat()

Method Detail

getStatistics

public eu.stratosphere.api.common.io.FileInputFormat.FileBaseStatistics getStatistics(eu.stratosphere.api.common.io.statistics.BaseStatistics cachedStatistics)

Specified by:

getStatistics in interface eu.stratosphere.api.common.io.InputFormat<eu.stratosphere.types.Record,eu.stratosphere.core.fs.FileInputSplit>

Overrides:

getStatistics in class eu.stratosphere.api.common.io.FileInputFormat<eu.stratosphere.types.Record>

open

public void open(eu.stratosphere.core.fs.FileInputSplit split)
          throws java.io.IOException

Specified by:

open in interface eu.stratosphere.api.common.io.InputFormat<eu.stratosphere.types.Record,eu.stratosphere.core.fs.FileInputSplit>

Overrides:

open in class eu.stratosphere.api.common.io.FileInputFormat<eu.stratosphere.types.Record>

Throws:

java.io.IOException

createInputSplits

public eu.stratosphere.core.fs.FileInputSplit[] createInputSplits(int minNumSplits)
                                                           throws java.io.IOException

Specified by:

createInputSplits in interface eu.stratosphere.api.common.io.InputFormat<eu.stratosphere.types.Record,eu.stratosphere.core.fs.FileInputSplit>

Overrides:

createInputSplits in class eu.stratosphere.api.common.io.FileInputFormat<eu.stratosphere.types.Record>

Throws:

java.io.IOException

reachedEnd

public boolean reachedEnd()

Checks whether the current split is at its end.

Returns:

True, if the split is at its end, false otherwise.

nextRecord

public boolean nextRecord(eu.stratosphere.types.Record record)
                   throws java.io.IOException

Throws:

java.io.IOException