org.kepler.stratosphere.stub

Class KeplerReduceStub

java.lang.Object

eu.stratosphere.api.common.functions.AbstractFunction

eu.stratosphere.api.java.record.functions.ReduceFunction

org.kepler.stratosphere.stub.KeplerReduceStub

All Implemented Interfaces:

eu.stratosphere.api.common.functions.Function, eu.stratosphere.api.common.functions.GenericReducer<eu.stratosphere.types.Record,eu.stratosphere.types.Record>, ExecutionListener

Direct Known Subclasses:

KeplerCombineAndReduceStub

public class KeplerReduceStub
extends eu.stratosphere.api.java.record.functions.ReduceFunction
implements ExecutionListener

A PACT Reduce stub that runs a Kepler workflow. The workflow is loaded in configure(), and executed each time reduce() is called.

Author:

Daniel Crawl

Constructor Summary

Constructors

Constructor and Description
KeplerReduceStub()

Method Summary

Modifier and Type	Method and Description
void	close() Free resources.
void	executionError(Manager manager, java.lang.Throwable throwable) Report workflow execution errors to the log.
void	executionFinished(Manager manager) Do nothing.
void	managerStateChanged(Manager manager) Do nothing.
void	open(eu.stratosphere.configuration.Configuration parameters) Configure the stub by loading the workflow and setting the PACT data types from the workflow stub actors.
void	reduce(java.util.Iterator<eu.stratosphere.types.Record> records, eu.stratosphere.util.Collector<eu.stratosphere.types.Record> out) Transfer the data from Stratosphere to Kepler, execute the workflow, and then transfer the data from Kepler to Stratosphere.

Methods inherited from class eu.stratosphere.api.java.record.functions.ReduceFunction

combine

Methods inherited from class eu.stratosphere.api.common.functions.AbstractFunction

getIterationRuntimeContext, getRuntimeContext, setRuntimeContext

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface eu.stratosphere.api.common.functions.Function

getRuntimeContext, setRuntimeContext

Constructor Detail

KeplerReduceStub

public KeplerReduceStub()

Method Detail

close

public void close()
           throws java.lang.Exception

Free resources.

Specified by:

close in interface eu.stratosphere.api.common.functions.Function

Overrides:

close in class eu.stratosphere.api.common.functions.AbstractFunction

Throws:

java.lang.Exception

open

public void open(eu.stratosphere.configuration.Configuration parameters)
          throws java.lang.Exception

Configure the stub by loading the workflow and setting the PACT data types from the workflow stub actors.

Specified by:

open in interface eu.stratosphere.api.common.functions.Function

Overrides:

open in class eu.stratosphere.api.common.functions.AbstractFunction

Throws:

java.lang.Exception

reduce

public void reduce(java.util.Iterator<eu.stratosphere.types.Record> records,
                   eu.stratosphere.util.Collector<eu.stratosphere.types.Record> out)
            throws java.lang.Exception

Transfer the data from Stratosphere to Kepler, execute the workflow, and then transfer the data from Kepler to Stratosphere.

Specified by:

reduce in interface eu.stratosphere.api.common.functions.GenericReducer<eu.stratosphere.types.Record,eu.stratosphere.types.Record>

Specified by:

reduce in class eu.stratosphere.api.java.record.functions.ReduceFunction

Throws:

java.lang.Exception

executionError

public void executionError(Manager manager,
                           java.lang.Throwable throwable)

Report workflow execution errors to the log.

Specified by:

executionError in interface ExecutionListener

Parameters:

manager - The manager controlling the execution.

throwable - The throwable to report.

executionFinished

public void executionFinished(Manager manager)

Do nothing.

Specified by:

executionFinished in interface ExecutionListener

Parameters:

manager - The manager controlling the execution.

managerStateChanged

public void managerStateChanged(Manager manager)

Do nothing.

Specified by:

managerStateChanged in interface ExecutionListener

Parameters:

manager - The manager controlling the execution.

See Also:

Manager.getState()