org.kepler.spark.stub

Class ScriptEngineMapStub

java.lang.Object

org.kepler.spark.stub.PairFlatMapFunctionBase<T,K,V>

org.kepler.spark.stub.ScriptEnginePairFlatMapFunction<java.util.Iterator<scala.Tuple2<java.lang.Object,java.lang.Object>>,java.lang.Object,java.lang.Object>

org.kepler.spark.stub.ScriptEngineMapStub

All Implemented Interfaces:

java.io.Externalizable, java.io.Serializable, org.apache.spark.api.java.function.PairFlatMapFunction<java.util.Iterator<scala.Tuple2<java.lang.Object,java.lang.Object>>,java.lang.Object,java.lang.Object>

public class ScriptEngineMapStub
extends ScriptEnginePairFlatMapFunction<java.util.Iterator<scala.Tuple2<java.lang.Object,java.lang.Object>>,java.lang.Object,java.lang.Object>

A Spark Map stub that executes a ScriptEngine.

Author:

Daniel Crawl

See Also:

Serialized Form

Field Summary

Fields inherited from class org.kepler.spark.stub.ScriptEnginePairFlatMapFunction

_invocable, _resultKeys, _resultValues

Fields inherited from class org.kepler.spark.stub.PairFlatMapFunctionBase

_parameters

Constructor Summary

Constructors

Constructor and Description
ScriptEngineMapStub()

Method Summary

Modifier and Type	Method and Description
java.util.Iterator<scala.Tuple2<java.lang.Object,java.lang.Object>>	call(java.util.Iterator<scala.Tuple2<java.lang.Object,java.lang.Object>> iterator) Transfer the data from Spark to Kepler, execute the workflow, and then transfer the data from Kepler to Spark.

Methods inherited from class org.kepler.spark.stub.ScriptEnginePairFlatMapFunction

_cleanup, _initialize

Methods inherited from class org.kepler.spark.stub.PairFlatMapFunctionBase

readExternal, setConfiguration, writeExternal

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

ScriptEngineMapStub

public ScriptEngineMapStub()

Method Detail

call

public java.util.Iterator<scala.Tuple2<java.lang.Object,java.lang.Object>> call(java.util.Iterator<scala.Tuple2<java.lang.Object,java.lang.Object>> iterator)
                                                                         throws java.lang.Exception

Transfer the data from Spark to Kepler, execute the workflow, and then transfer the data from Kepler to Spark.

Throws:

java.lang.Exception