org.kepler.stratosphere.director

Class StratosphereEngine

java.lang.Object

org.kepler.ddp.director.DDPEngine

org.kepler.stratosphere.director.StratosphereEngine

All Implemented Interfaces:

java.lang.Cloneable

public class StratosphereEngine
extends DDPEngine

An engine than runs workflows in Stratosphere. This engine converts DDP pattern actors (Map, Reduce, Cross, CoGroup, and Match) and I/O actors (DDPDataSink and DDPDataSource) into a Stratosphere job and runs it on the server.

NOTE: Only DDP pattern and I/O actors may be present in the workflow. Other actors must placed inside the composite pattern actors or in a different sub-workflow.

Author:

Daniel Crawl

Field Summary

Fields inherited from class org.kepler.ddp.director.DDPEngine

_additionalJars, _classLoader, _configDirStr, _CONNECT_TIMEOUT, _container, _degreeOfParallelism, _director, _displayRedirectDir, _engineName, _jobArgumentsMap, _jobDir, _jobLock, _sameJVM, _serverStartStopLock, _subWorkflows, _writeSubWorkflowsToFiles

Constructor Summary

Constructors

Constructor and Description
StratosphereEngine(DDPDirector director) Create a new StratosphereEngine.

Method Summary

Modifier and Type	Method and Description
protected void	_addSubModelToContract(SingleInputPatternActor pactor, eu.stratosphere.api.common.operators.Operator contract) Write the sub-workflow of a SingleInputPatternActor either to a parameter in the PACT plan configuration or to a file.
protected void	_executeDDPJob() Execute the engine.
protected eu.stratosphere.api.common.Plan	_getModelPlan() Constructs a PACT Plan from the model.
java.lang.Object	clone(Workspace workspace) Clone the StratosphereEngine into the specified workspace.
void	preinitialize() Initialize the engine.
static void	shutdownServer() Shutdown the Stratosphere server if one was started.
void	stop() Stop any running Stratosphere jobs.
void	wrapup() Free resources.

Methods inherited from class org.kepler.ddp.director.DDPEngine

_addParameters, _checkConfigDir, _checkFilesBeforeStartingServer, _checkModel, _checkModelForNonDDPActors, _checkServer, _copyParameters, _createJobDirectory, _getJarList, _getParametersInHierarchy, _parseOutputFromStartingServer, _removeParameters, _setPortTypes, attributeChanged, clone, closeAllEffigies, createEffigy, fire, getDisplayRedirectDir, getModel, getName, getServerTypes, postfire

Methods inherited from class java.lang.Object

equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

StratosphereEngine

public StratosphereEngine(DDPDirector director)
                   throws IllegalActionException,
                          NameDuplicationException

Create a new StratosphereEngine.

Parameters:

director - The director containing this engine.

Throws:

IllegalActionException

NameDuplicationException

Method Detail

clone

public java.lang.Object clone(Workspace workspace)
                       throws java.lang.CloneNotSupportedException

Clone the StratosphereEngine into the specified workspace.

Overrides:

clone in class DDPEngine

Parameters:

workspace - The workspace for the cloned object.

Returns:

The new StratosphereDirector.

Throws:

java.lang.CloneNotSupportedException - Not thrown in this base class

_executeDDPJob

protected void _executeDDPJob()
                       throws IllegalActionException

Execute the engine.

Specified by:

_executeDDPJob in class DDPEngine

Throws:

IllegalActionException

preinitialize

public void preinitialize()
                   throws IllegalActionException

Initialize the engine.

Overrides:

preinitialize in class DDPEngine

Throws:

IllegalActionException

stop

public void stop()
          throws IllegalActionException

Stop any running Stratosphere jobs.

Overrides:

stop in class DDPEngine

Throws:

IllegalActionException

shutdownServer

public static void shutdownServer()
                           throws IllegalActionException

Shutdown the Stratosphere server if one was started.

Throws:

IllegalActionException

wrapup

public void wrapup()
            throws IllegalActionException

Free resources.

Overrides:

wrapup in class DDPEngine

Throws:

IllegalActionException

_addSubModelToContract

protected void _addSubModelToContract(SingleInputPatternActor pactor,
                                      eu.stratosphere.api.common.operators.Operator contract)
                               throws IllegalActionException

Write the sub-workflow of a SingleInputPatternActor either to a parameter in the PACT plan configuration or to a file.

Throws:

IllegalActionException

_getModelPlan

protected eu.stratosphere.api.common.Plan _getModelPlan()
                                                 throws IllegalActionException

Constructs a PACT Plan from the model.

Throws:

IllegalActionException