org.kepler.spark.util

Class SparkUtilities

java.lang.Object

org.kepler.spark.util.SparkUtilities

public class SparkUtilities
extends java.lang.Object

Utilities for Spark.

Author:

Daniel Crawl

Method Summary

Modifier and Type	Method and Description
static void	deleteDirectoryOutput(java.net.URI path, org.apache.hadoop.conf.Configuration configuration) Delete an output directory.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Method Detail

deleteDirectoryOutput

public static void deleteDirectoryOutput(java.net.URI path,
                                         org.apache.hadoop.conf.Configuration configuration)

Delete an output directory. This method removes files like "SUCCESS", "part-r-0000", etc., that are created as output from a Spark job.