org.kepler.spark.stub

Class ScriptEngineReduceStub

java.lang.Object

org.kepler.spark.stub.PairFlatMapFunctionBase<T,K,V>

org.kepler.spark.stub.ScriptEnginePairFlatMapFunction<java.util.Iterator<scala.Tuple2<java.lang.Object,java.util.List<java.lang.Object>>>,java.lang.Object,java.lang.Object>

org.kepler.spark.stub.ScriptEngineReduceStub

All Implemented Interfaces:

java.io.Externalizable, java.io.Serializable, org.apache.spark.api.java.function.PairFlatMapFunction<java.util.Iterator<scala.Tuple2<java.lang.Object,java.util.List<java.lang.Object>>>,java.lang.Object,java.lang.Object>

public class ScriptEngineReduceStub
extends ScriptEnginePairFlatMapFunction<java.util.Iterator<scala.Tuple2<java.lang.Object,java.util.List<java.lang.Object>>>,java.lang.Object,java.lang.Object>

A Spark Reduce stub that executes a ScriptEngine.

Author:

Daniel Crawl

See Also:

Serialized Form

Field Summary

Fields inherited from class org.kepler.spark.stub.ScriptEnginePairFlatMapFunction

_invocable, _resultKeys, _resultValues

Fields inherited from class org.kepler.spark.stub.PairFlatMapFunctionBase

_parameters

Constructor Summary

Constructors

Constructor and Description
ScriptEngineReduceStub()

Method Summary

Modifier and Type	Method and Description
java.util.Iterator<scala.Tuple2<java.lang.Object,java.lang.Object>>	call(java.util.Iterator<scala.Tuple2<java.lang.Object,java.util.List<java.lang.Object>>> iterator) Transfer the data from Spark to Kepler, execute the workflow, and then transfer the data from Kepler to Spark.

Methods inherited from class org.kepler.spark.stub.ScriptEnginePairFlatMapFunction

_cleanup, _initialize

Methods inherited from class org.kepler.spark.stub.PairFlatMapFunctionBase

readExternal, setConfiguration, writeExternal

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

ScriptEngineReduceStub

public ScriptEngineReduceStub()

Method Detail

call

public java.util.Iterator<scala.Tuple2<java.lang.Object,java.lang.Object>> call(java.util.Iterator<scala.Tuple2<java.lang.Object,java.util.List<java.lang.Object>>> iterator)
                                                                         throws java.lang.Exception

Transfer the data from Spark to Kepler, execute the workflow, and then transfer the data from Kepler to Spark.

Throws:

java.lang.Exception