water.fvec

Class RebalanceDataSet

java.lang.Object

jsr166y.ForkJoinTask<java.lang.Void>

jsr166y.CountedCompleter

water.H2O.H2OCountedCompleter

water.fvec.RebalanceDataSet

All Implemented Interfaces:

java.io.Serializable, java.lang.Cloneable, java.util.concurrent.Future<java.lang.Void>, Freezable

public class RebalanceDataSet
extends H2O.H2OCountedCompleter

Created by tomasnykodym on 3/28/14. Utility to rebalance dataset so that it has requested number of chunks and each chunk has the same number of rows +/-1. It *does not* guarantee even chunk-node placement. (This can not currently be done in H2O, since the placement of chunks is governed only by key-hash /vector group/ for Vecs)

See Also:

Serialized Form

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	RebalanceDataSet.RebalanceTask

Constructor Summary

Constructors

Constructor and Description
RebalanceDataSet(Frame modelFrame, Frame srcFrame, Key dstKey) Constructor for make-compatible task.
RebalanceDataSet(Frame modelFrame, Frame srcFrame, Key dstKey, H2O.H2OCountedCompleter cmp, Key jobKey)
RebalanceDataSet(Frame srcFrame, Key dstKey, int nchunks)
RebalanceDataSet(Frame srcFrame, Key dstKey, int nchunks, H2O.H2OCountedCompleter cmp, Key jobKey)

Method Summary

Methods

Modifier and Type	Method and Description
void	compute2() Override to specify actual work to do
Frame	getResult()
void	onCompletion(CountedCompleter caller) Performs an action when method CountedCompleter.tryComplete() is invoked and there are no pending counts, or when the unconditional method CountedCompleter.complete(java.lang.Void) is invoked.
boolean	onExceptionalCompletion(java.lang.Throwable t, CountedCompleter caller) Exceptional completion path; mostly does printing if the exception was not handled earlier in the stack.

Methods inherited from class water.H2O.H2OCountedCompleter

clone, compute, frozenType, icer, nextThrPriority, priority, read_impl, read, readJSON_impl, readJSON, write_impl, write, writeHTML_impl, writeHTML, writeJSON_impl, writeJSON

Methods inherited from class jsr166y.CountedCompleter

addToPendingCount, compareAndSetPendingCount, complete, exec, getCompleter, getPendingCount, getRawResult, setCompleter, setPendingCount, setRawResult, tryComplete

Methods inherited from class jsr166y.ForkJoinTask

adapt, adapt, adapt, cancel, compareAndSetForkJoinTaskTag, completeExceptionally, fork, get, get, getException, getForkJoinTaskTag, getPool, getQueuedTaskCount, getSurplusQueuedTaskCount, helpQuiesce, inForkJoinPool, invoke, invokeAll, invokeAll, invokeAll, isCancelled, isCompletedAbnormally, isCompletedNormally, isDone, join, peekNextLocalTask, pollNextLocalTask, pollTask, quietlyComplete, quietlyInvoke, quietlyJoin, reinitialize, setForkJoinTaskTag, tryUnfork

Methods inherited from class java.lang.Object

equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

RebalanceDataSet

public RebalanceDataSet(Frame modelFrame,
                Frame srcFrame,
                Key dstKey)

Constructor for make-compatible task. To be used to make frame compatible with other frame (i.e. make all vecs compatible with other vector group and rows-per-chunk).

RebalanceDataSet

public RebalanceDataSet(Frame modelFrame,
                Frame srcFrame,
                Key dstKey,
                H2O.H2OCountedCompleter cmp,
                Key jobKey)

RebalanceDataSet

public RebalanceDataSet(Frame srcFrame,
                Key dstKey,
                int nchunks)

RebalanceDataSet

public RebalanceDataSet(Frame srcFrame,
                Key dstKey,
                int nchunks,
                H2O.H2OCountedCompleter cmp,
                Key jobKey)

Method Detail

getResult

public Frame getResult()

compute2

public void compute2()

Description copied from class: H2O.H2OCountedCompleter

Override to specify actual work to do

Specified by:

compute2 in class H2O.H2OCountedCompleter

onCompletion

public void onCompletion(CountedCompleter caller)

Description copied from class: CountedCompleter

Performs an action when method CountedCompleter.tryComplete() is invoked and there are no pending counts, or when the unconditional method CountedCompleter.complete(java.lang.Void) is invoked. By default, this method does nothing.

Overrides:

onCompletion in class CountedCompleter

Parameters:

caller - the task invoking this method (which may be this task itself).

onExceptionalCompletion

public boolean onExceptionalCompletion(java.lang.Throwable t,
                              CountedCompleter caller)

Description copied from class: H2O.H2OCountedCompleter

Exceptional completion path; mostly does printing if the exception was not handled earlier in the stack.

Overrides:

onExceptionalCompletion in class H2O.H2OCountedCompleter

Parameters:

t - the exception

caller - the task invoking this method (which may be this task itself).

Returns:

true if this exception should be propagated to this tasks completer, if one exists.