water

Class LocalMR<T extends MrFun<T>>

java.lang.Object

jsr166y.ForkJoinTask<java.lang.Void>

jsr166y.CountedCompleter

water.H2O.H2OCountedCompleter<LocalMR>

water.LocalMR<T>

All Implemented Interfaces:

java.io.Serializable, java.lang.Cloneable, java.util.concurrent.Future<java.lang.Void>, Freezable<LocalMR>

public class LocalMR<T extends MrFun<T>>
extends H2O.H2OCountedCompleter<LocalMR>

Created by tomas on 11/5/16. Generic lightewight Local MRTask utility. Will launch requested number of tasks (on local node!), organized in a binary tree fashion, similar to MRTask. Will attempt to share local results (MrFun instances) if the previous task has completed before launching current task. User expected to pass in MrFun implementing map(id), reduce(MrFun) and makeCopy() functions. At the end of the task, MrFun holds the result.

See Also:

Serialized Form

Constructor Summary

Constructors

Constructor and Description
LocalMR(MrFun mrt, H2O.H2OCountedCompleter cc)
LocalMR(MrFun mrt, int nthreads)
LocalMR(MrFun mrt, int nthreads, H2O.H2OCountedCompleter cc)

Method Summary

Modifier and Type	Method and Description
void	compute2() Override compute3() with actual work without having to worry about tryComplete()
boolean	isCancelRequested()
void	onCompletion(CountedCompleter cc) Performs an action when method CountedCompleter.tryComplete() is invoked and there are no pending counts, or when the unconditional method CountedCompleter.complete(java.lang.Void) is invoked.

Methods inherited from class water.H2O.H2OCountedCompleter

asBytes, clone, compute, compute1, currThrPriority, frozenType, icer, priority, read, readJSON, reloadFromBytes, write, writeJSON

Methods inherited from class jsr166y.CountedCompleter

__tryComplete, addToPendingCount, compareAndSetPendingCount, complete, exec, getCompleter, getPendingCount, getRawResult, onExceptionalCompletion, setCompleter, setPendingCount, setRawResult, tryComplete

Methods inherited from class jsr166y.ForkJoinTask

adapt, adapt, adapt, cancel, compareAndSetForkJoinTaskTag, completeExceptionally, fork, get, get, getException, getForkJoinTaskTag, getPool, getQueuedTaskCount, getSurplusQueuedTaskCount, helpQuiesce, inForkJoinPool, invoke, invokeAll, invokeAll, invokeAll, isCancelled, isCompletedAbnormally, isCompletedNormally, isDone, join, peekNextLocalTask, pollNextLocalTask, pollTask, quietlyComplete, quietlyInvoke, quietlyJoin, reinitialize, setForkJoinTaskTag, tryUnfork

Methods inherited from class java.lang.Object

equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

LocalMR

public LocalMR(MrFun mrt,
               int nthreads)

LocalMR

public LocalMR(MrFun mrt,
               H2O.H2OCountedCompleter cc)

LocalMR

public LocalMR(MrFun mrt,
               int nthreads,
               H2O.H2OCountedCompleter cc)

Method Detail

isCancelRequested

public boolean isCancelRequested()

compute2

public final void compute2()

Description copied from class: H2O.H2OCountedCompleter

Override compute3() with actual work without having to worry about tryComplete()

Overrides:

compute2 in class H2O.H2OCountedCompleter<LocalMR>

onCompletion

public final void onCompletion(CountedCompleter cc)

Description copied from class: CountedCompleter

Performs an action when method CountedCompleter.tryComplete() is invoked and there are no pending counts, or when the unconditional method CountedCompleter.complete(java.lang.Void) is invoked. By default, this method does nothing.

Overrides:

onCompletion in class CountedCompleter

Parameters:

cc - the task invoking this method (which may be this task itself).