org.kepler.spark.operator

Class CoGroupOperator

java.lang.Object

org.kepler.spark.operator.Operator

org.kepler.spark.operator.CoGroupOperator

public class CoGroupOperator
extends Operator

An operator for cogroup.

Author:

Daniel Crawl

Field Summary

Fields inherited from class org.kepler.spark.operator.Operator

_configuration, _inputData, _numInstances, _stub

Constructor Summary

Constructors

Constructor and Description
CoGroupOperator(org.apache.spark.api.java.function.PairFlatMapFunction<java.util.Iterator<scala.Tuple2<?,scala.Tuple2<java.lang.Iterable<?>,java.lang.Iterable<?>>>>,?,?> stub, java.lang.String name) Create a new CoGroupOperator.

Method Summary

Modifier and Type	Method and Description
org.apache.spark.api.java.JavaPairRDD<java.lang.Object,?>	execute() Execute the operator.

Methods inherited from class org.kepler.spark.operator.Operator

_getOutput, getParameters, numInputs, setDegreeOfParallelism, setInput, setInput

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

CoGroupOperator

public CoGroupOperator(org.apache.spark.api.java.function.PairFlatMapFunction<java.util.Iterator<scala.Tuple2<?,scala.Tuple2<java.lang.Iterable<?>,java.lang.Iterable<?>>>>,?,?> stub,
                       java.lang.String name)

Create a new CoGroupOperator.

Parameters:

stub - the stub class to run in the cogroup operator

name - the operator name

Method Detail

execute

public org.apache.spark.api.java.JavaPairRDD<java.lang.Object,?> execute()

Execute the operator.

Specified by:

execute in class Operator