org.kepler.spark.stub

Class KeplerCoGroupStub

java.lang.Object

org.kepler.spark.stub.PairFlatMapFunctionBase<T,K,V>

org.kepler.spark.stub.KeplerPairFlatMapFunction<java.util.Iterator<scala.Tuple2<java.lang.Object,scala.Tuple2<java.lang.Iterable<java.lang.Object>,java.lang.Iterable<java.lang.Object>>>>,java.lang.Object,java.lang.Object>

org.kepler.spark.stub.KeplerCoGroupStub

All Implemented Interfaces:

java.io.Externalizable, java.io.Serializable, org.apache.spark.api.java.function.PairFlatMapFunction<java.util.Iterator<scala.Tuple2<java.lang.Object,scala.Tuple2<java.lang.Iterable<java.lang.Object>,java.lang.Iterable<java.lang.Object>>>>,java.lang.Object,java.lang.Object>, ExecutionListener

public class KeplerCoGroupStub
extends KeplerPairFlatMapFunction<java.util.Iterator<scala.Tuple2<java.lang.Object,scala.Tuple2<java.lang.Iterable<java.lang.Object>,java.lang.Iterable<java.lang.Object>>>>,java.lang.Object,java.lang.Object>

A Spark stub to run a Kepler workflow in a map after the cogroup operator.

Author:

Daniel Crawl

See Also:

Serialized Form

Field Summary

Fields inherited from class org.kepler.spark.stub.KeplerPairFlatMapFunction

_keplerManagerException, _manager, _runWorkflowLifecyclePerInput, _sinkActor, _sourceActor

Fields inherited from class org.kepler.spark.stub.PairFlatMapFunctionBase

_parameters

Constructor Summary

Constructors

Constructor and Description
KeplerCoGroupStub()

Method Summary

Modifier and Type	Method and Description
java.util.Iterator<scala.Tuple2<java.lang.Object,java.lang.Object>>	call(java.util.Iterator<scala.Tuple2<java.lang.Object,scala.Tuple2<java.lang.Iterable<java.lang.Object>,java.lang.Iterable<java.lang.Object>>>> iterator)

Methods inherited from class org.kepler.spark.stub.KeplerPairFlatMapFunction

_cleanup, _initialize, executionError, executionFinished, managerStateChanged

Methods inherited from class org.kepler.spark.stub.PairFlatMapFunctionBase

readExternal, setConfiguration, writeExternal

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

KeplerCoGroupStub

public KeplerCoGroupStub()

Method Detail

call

public java.util.Iterator<scala.Tuple2<java.lang.Object,java.lang.Object>> call(java.util.Iterator<scala.Tuple2<java.lang.Object,scala.Tuple2<java.lang.Iterable<java.lang.Object>,java.lang.Iterable<java.lang.Object>>>> iterator)
                                                                         throws java.lang.Exception

Throws:

java.lang.Exception