org.kepler.spark.operator

Class ReduceOperator

java.lang.Object

org.kepler.spark.operator.Operator

org.kepler.spark.operator.ReduceOperator

public class ReduceOperator
extends Operator

An operator for reduce.

Author:

Daniel Crawl

Field Summary

Fields inherited from class org.kepler.spark.operator.Operator

_configuration, _inputData, _numInstances, _stub

Constructor Summary

Constructors

Constructor and Description
ReduceOperator(org.apache.spark.api.java.function.Function2<?,?,?> stub, java.lang.String name) Create a new ReduceOperator that will not generate new keys.
ReduceOperator(org.apache.spark.api.java.function.PairFlatMapFunction<java.util.Iterator<scala.Tuple2<java.lang.Object,java.lang.Iterable<java.lang.Object>>>,java.lang.Object,java.lang.Object> stub, java.lang.String name) Create a new ReduceOperator that can generate new keys.

Method Summary

Modifier and Type	Method and Description
org.apache.spark.api.java.JavaPairRDD<java.lang.Object,?>	execute() Execute the operator.

Methods inherited from class org.kepler.spark.operator.Operator

_getOutput, getParameters, numInputs, setDegreeOfParallelism, setInput, setInput

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

ReduceOperator

public ReduceOperator(org.apache.spark.api.java.function.Function2<?,?,?> stub,
                      java.lang.String name)

Create a new ReduceOperator that will not generate new keys.

Parameters:

stub - the stub class to run in the reduce operator

name - the operator name

ReduceOperator

public ReduceOperator(org.apache.spark.api.java.function.PairFlatMapFunction<java.util.Iterator<scala.Tuple2<java.lang.Object,java.lang.Iterable<java.lang.Object>>>,java.lang.Object,java.lang.Object> stub,
                      java.lang.String name)

Create a new ReduceOperator that can generate new keys.

Parameters:

stub - the stub class to run in the reduce operator

name - the operator name

Method Detail

execute

public org.apache.spark.api.java.JavaPairRDD<java.lang.Object,?> execute()

Execute the operator.

Specified by:

execute in class Operator