org.kepler.hadoop.util

Class StubUtilities

java.lang.Object

org.kepler.hadoop.util.StubUtilities

public class StubUtilities
extends java.lang.Object

A collection of utilities used by Kepler hadoop module. It is built based on org.kepler.stratosphere.stub.StubUtilities.

Author:

Jianwu Wang

Constructor Summary

Constructors

Constructor and Description
StubUtilities()

Method Summary

Modifier and Type	Method and Description
static byte[]	arrayTokenToByteArray(ArrayToken arrayToken) Convert ArrayToken to an array of byte.
static java.lang.Class<?>	convertRecordArrayToHadoopType(ArrayType type, java.lang.String name) Convert a token record array type to hadoop data type.
static java.lang.Class<?>	convertRecordToHadoopType(RecordType type, java.lang.String name) Convert a token record type to hadoop data type.
static Token	convertToArrayToken(java.util.Iterator<org.apache.hadoop.io.Writable> values) Convert data to a token.
static java.lang.Object	convertToHadoopData(Token token) Convert a token to hadoop data.
static java.lang.Class<?>	convertToHadoopType(java.lang.String typeString) Convert a token type (string type) to hadoop data type.
static java.lang.Class<?>	convertToHadoopType(Type type) Convert a token type to hadoop data type.
static void	convertTokenToList(java.util.List<Token> tokenList, java.util.List<KeyValuePair> outputList) Convert a token to hadoop data and add to a Collector.
static java.lang.Class<?>	convertToTaggedType(Type type) Convert a token type to hadoop data type.
static Token	convertToToken(java.lang.Object value) Convert hadoop data to a token.
static Token	convertToToken(java.lang.Object value, java.lang.Class<?> clazz) Convert hadoop data to a token.
static void	initializeKepler(org.apache.hadoop.conf.Configuration conf) Initialize the parts of Kepler required to run the sub-workflow in the stub.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

StubUtilities

public StubUtilities()

Method Detail

convertTokenToList

public static void convertTokenToList(java.util.List<Token> tokenList,
                                      java.util.List<KeyValuePair> outputList)
                               throws IllegalActionException

Convert a token to hadoop data and add to a Collector.

Throws:

IllegalActionException

convertToHadoopData

public static java.lang.Object convertToHadoopData(Token token)
                                            throws IllegalActionException

Convert a token to hadoop data.

Throws:

IllegalActionException

convertToHadoopType

public static java.lang.Class<?> convertToHadoopType(Type type)
                                              throws IllegalActionException

Convert a token type to hadoop data type.

Throws:

IllegalActionException

convertToHadoopType

public static java.lang.Class<?> convertToHadoopType(java.lang.String typeString)
                                              throws IllegalActionException

Convert a token type (string type) to hadoop data type.

Throws:

IllegalActionException

convertToTaggedType

public static java.lang.Class<?> convertToTaggedType(Type type)
                                              throws IllegalActionException

Convert a token type to hadoop data type.

Throws:

IllegalActionException

convertRecordArrayToHadoopType

public static java.lang.Class<?> convertRecordArrayToHadoopType(ArrayType type,
                                                                java.lang.String name)
                                                         throws IllegalActionException

Convert a token record array type to hadoop data type.

Throws:

IllegalActionException

convertRecordToHadoopType

public static java.lang.Class<?> convertRecordToHadoopType(RecordType type,
                                                           java.lang.String name)
                                                    throws IllegalActionException

Convert a token record type to hadoop data type.

Throws:

IllegalActionException

convertToToken

public static Token convertToToken(java.lang.Object value)
                            throws IllegalActionException

Convert hadoop data to a token.

Throws:

IllegalActionException

convertToToken

public static Token convertToToken(java.lang.Object value,
                                   java.lang.Class<?> clazz)

Convert hadoop data to a token.

convertToArrayToken

public static Token convertToArrayToken(java.util.Iterator<org.apache.hadoop.io.Writable> values)

Convert data to a token.

arrayTokenToByteArray

public static byte[] arrayTokenToByteArray(ArrayToken arrayToken)
                                    throws IllegalActionException

Convert ArrayToken to an array of byte.

Throws:

IllegalActionException

initializeKepler

public static void initializeKepler(org.apache.hadoop.conf.Configuration conf)

Initialize the parts of Kepler required to run the sub-workflow in the stub.