water.persist

Class PersistS3

java.lang.Object

water.persist.Persist

water.persist.PersistS3

public final class PersistS3
extends Persist

Persistence backend for S3

Nested Class Summary

Nested classes/interfaces inherited from class water.persist.Persist

Persist.PersistEntry

Constructor Summary

Constructors

Constructor and Description
PersistS3()

Method Summary

Methods

Modifier and Type	Method and Description
java.util.ArrayList<java.lang.String>	calcTypeaheadMatches(java.lang.String src, int limit) Calculate typeahead matches for src
void	cleanUp() Delete persistent storage on startup and shutdown
void	delete(Value v) Reclaim space from a previously stored Value
static water.persist.PersistS3.AmazonS3	getClient() Initialize the AWS S3 client
void	importFiles(java.lang.String path, java.util.ArrayList<java.lang.String> files, java.util.ArrayList<java.lang.String> keys, java.util.ArrayList<java.lang.String> fails, java.util.ArrayList<java.lang.String> dels)
byte[]	load(Value v) Load a previously stored Value
static java.io.InputStream	openStream(Key k, Job pmon) InputStream from a S3-based Key
void	store(Value v) Store a Value into persistent storage, consuming some storage space.
Key	uriToKey(java.net.URI uri) Transform given uri into file vector holding file name.

Methods inherited from class water.persist.Persist

create, delete, exists, getHomeDirectory, getTotalSpace, getUsableSpace, length, list, mkdirs, open, rename

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

PersistS3

public PersistS3()

Method Detail

getClient

public static water.persist.PersistS3.AmazonS3 getClient()

Initialize the AWS S3 client

cleanUp

public void cleanUp()

Description copied from class: Persist

Delete persistent storage on startup and shutdown

Specified by:

cleanUp in class Persist

openStream

public static java.io.InputStream openStream(Key k,
                             Job pmon)
                                      throws java.io.IOException

InputStream from a S3-based Key

Throws:

java.io.IOException

load

public byte[] load(Value v)

Description copied from class: Persist

Load a previously stored Value

Specified by:

load in class Persist

store

public void store(Value v)

Description copied from class: Persist

Store a Value into persistent storage, consuming some storage space.

Specified by:

store in class Persist

delete

public void delete(Value v)

Description copied from class: Persist

Reclaim space from a previously stored Value

Specified by:

delete in class Persist

uriToKey

public Key uriToKey(java.net.URI uri)
             throws java.io.IOException

Description copied from class: Persist

Transform given uri into file vector holding file name.

Specified by:

uriToKey in class Persist

Throws:

java.io.IOException

calcTypeaheadMatches

public java.util.ArrayList<java.lang.String> calcTypeaheadMatches(java.lang.String src,
                                                         int limit)

Description copied from class: Persist

Calculate typeahead matches for src

Specified by:

calcTypeaheadMatches in class Persist

Parameters:

src - Source string to match for typeahead

limit - Max number of entries to return

Returns:

List of matches

importFiles

public void importFiles(java.lang.String path,
               java.util.ArrayList<java.lang.String> files,
               java.util.ArrayList<java.lang.String> keys,
               java.util.ArrayList<java.lang.String> fails,
               java.util.ArrayList<java.lang.String> dels)

Specified by:

importFiles in class Persist