org.kepler.spark.operator

Class FileDataSink

java.lang.Object

org.kepler.spark.operator.Operator

org.kepler.spark.operator.DataSink

org.kepler.spark.operator.FileDataSink

public class FileDataSink
extends DataSink

A data sink that writes to files.

Author:

Daniel Crawl

Field Summary

Fields inherited from class org.kepler.spark.operator.Operator

_configuration, _inputData, _numInstances, _stub

Constructor Summary

Constructors

Constructor and Description
FileDataSink(java.lang.Class<? extends org.apache.hadoop.mapreduce.lib.output.FileOutputFormat<?,?>> outputFormatClass, java.net.URI path, java.lang.String name) Create a new FileDataSink.

Method Summary

Modifier and Type	Method and Description
org.apache.spark.api.java.JavaPairRDD<java.lang.Object,?>	execute() Execute the operator.

Methods inherited from class org.kepler.spark.operator.DataSink

writeOutput

Methods inherited from class org.kepler.spark.operator.Operator

_getOutput, getParameters, numInputs, setDegreeOfParallelism, setInput, setInput

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

FileDataSink

public FileDataSink(java.lang.Class<? extends org.apache.hadoop.mapreduce.lib.output.FileOutputFormat<?,?>> outputFormatClass,
                    java.net.URI path,
                    java.lang.String name)

Create a new FileDataSink.

Parameters:

outputFormatClass - the format class to write the file

path - the output file path

name - the name of the operator

Method Detail

execute

public org.apache.spark.api.java.JavaPairRDD<java.lang.Object,?> execute()

Execute the operator.

Specified by:

execute in class Operator