hex.grid

Class Grid<MP extends Model.Parameters>

java.lang.Object

water.Iced<T>

water.Keyed<T>

water.Lockable<Grid<MP>>

hex.grid.Grid<MP>

Type Parameters:

MP - type of model build parameters

All Implemented Interfaces:

java.io.Externalizable, java.io.Serializable, java.lang.Cloneable, Freezable<Grid<MP>>

public class Grid<MP extends Model.Parameters>
extends Lockable<Grid<MP>>

A Grid of Models representing result of hyper-parameter space exploration. Lazily filled in, this object represents the potentially infinite variety of hyperparameters of a given model & dataset.

See Also:

Serialized Form

Field Summary

Fields

Modifier and Type	Field and Description
static Grid	GRID_PROTO Publicly available Grid prototype - used by REST API.

Fields inherited from class water.Lockable

_lockers

Fields inherited from class water.Keyed

_key

Constructor Summary

Constructors

Modifier	Constructor and Description
protected	Grid(Key key, MP params, java.lang.String[] hyperNames, PojoUtils.FieldNaming fieldNaming) Construct a new grid object to store results of grid search.

Method Summary

Methods

Modifier and Type	Method and Description
protected long	checksum_impl() High-quality 64-bit checksum of the content of the object.
TwoDimTable	createScoringHistoryTable()
TwoDimTable	createSummaryTable(Key<Model>[] model_ids, java.lang.String sort_by, boolean decreasing)
Model.Parameters[]	getFailedParameters() Returns an array of model parameters which caused model build failure.
java.lang.String[][]	getFailedRawParameters() Returns list of raw model parameters causing model building failure.
int	getFailureCount() Returns number of unsuccessful attempts to build a model.
java.lang.String[]	getFailureDetails() Returns detailed messages about model build failures.
java.lang.String[]	getFailureStackTraces() Returns string representation of model build failures' stack traces.
java.lang.String[]	getHyperNames() Returns an array of used hyper parameters names.
java.lang.Object[]	getHyperValues(MP parms) Return value of hyper parameters used for this grid search.
Model	getModel(MP params) Returns model for given combination of model parameters or null if the model does not exist.
int	getModelCount() Returns number of models in this grid.
Key<Model>	getModelKey(MP params)
Key<Model>[]	getModelKeys() Returns keys of all models included in this object.
java.lang.String	getModelName() Returns name of model included in this object.
Model[]	getModels() Return all models included in this grid object.
ScoringInfo[]	getScoringInfos()
Frame	getTrainingFrame() Returns the data frame used to train all these models.
java.lang.Class<KeyV3.GridKeyV3>	makeSchema()
protected Keyed	readAll_impl(AutoBuffer ab, Futures fs)
protected Futures	remove_impl(Futures fs) Override to remove subparts, but not self, of composite Keyed objects.
void	setScoringInfos(ScoringInfo[] scoring_infos)
protected AutoBuffer	writeAll_impl(AutoBuffer ab) Write out K/V pairs

Methods inherited from class water.Lockable

delete_and_lock, delete_and_lock, delete_and_lock, delete, delete, delete, read_lock, read_lock, read_lock, unlock_all, unlock, unlock, unlock, unlock, update, update, update, write_lock, write_lock, write_lock

Methods inherited from class water.Keyed

checksum, readAll, remove, remove, remove, remove, writeAll

Methods inherited from class water.Iced

asBytes, clone, copyOver, frozenType, read, readExternal, readJSON, reloadFromBytes, toJsonString, write, writeExternal, writeJSON

Methods inherited from class java.lang.Object

equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

GRID_PROTO

public static final Grid GRID_PROTO

Publicly available Grid prototype - used by REST API.

See Also:

GridSchemaV99

Constructor Detail

Grid

protected Grid(Key key,
    MP params,
    java.lang.String[] hyperNames,
    PojoUtils.FieldNaming fieldNaming)

Construct a new grid object to store results of grid search.

Parameters:

key - reference to this object

params - initial parameters used by grid search

hyperNames - names of used hyper parameters

Method Detail

getModelName

public java.lang.String getModelName()

Returns name of model included in this object. Note: only sensible for Grids which search over a single class of Models.

Returns:

name of model (for example, "DRF", "GBM")

getScoringInfos

public ScoringInfo[] getScoringInfos()

setScoringInfos

public void setScoringInfos(ScoringInfo[] scoring_infos)

getTrainingFrame

public Frame getTrainingFrame()

Returns the data frame used to train all these models.

All models are trained on the same data frame, but might be validated on multiple different frames.

Returns:

training frame shared among all models

getModel

public Model getModel(MP params)

Returns model for given combination of model parameters or null if the model does not exist.

Parameters:

params - parameters of the model

Returns:

A model run with these parameters, or null if the model does not exist.

getModelKey

public Key<Model> getModelKey(MP params)

getModelKeys

public Key<Model>[] getModelKeys()

Returns keys of all models included in this object.

Returns:

list of model keys

getModels

public Model[] getModels()

Return all models included in this grid object.

Returns:

all models in this grid

getModelCount

public int getModelCount()

Returns number of models in this grid.

getFailureCount

public int getFailureCount()

Returns number of unsuccessful attempts to build a model.

getFailedParameters

public Model.Parameters[] getFailedParameters()

Returns an array of model parameters which caused model build failure.

The null-element in the array means, that model parameters cannot be constructed, and the client should use getFailedParameters() to obtain "raw" model parameters.

Note: cannot return MP[] because of PUBDEV-1863 See: https://0xdata.atlassian.net/browse/PUBDEV-1863

getFailureDetails

public java.lang.String[] getFailureDetails()

Returns detailed messages about model build failures.

getFailureStackTraces

public java.lang.String[] getFailureStackTraces()

Returns string representation of model build failures' stack traces.

getFailedRawParameters

public java.lang.String[][] getFailedRawParameters()

Returns list of raw model parameters causing model building failure.

getHyperValues

public java.lang.Object[] getHyperValues(MP parms)

Return value of hyper parameters used for this grid search.

Parameters:

parms - model parameters

Returns:

values of hyper parameters used by grid search producing this grid object.

getHyperNames

public java.lang.String[] getHyperNames()

Returns an array of used hyper parameters names.

Returns:

names of hyper parameters used in this hyper search

remove_impl

protected Futures remove_impl(Futures fs)

Description copied from class: Keyed

Override to remove subparts, but not self, of composite Keyed objects. Examples include Vec (removing associated Chunk keys) and Frame (removing associated Vec keys.)

Overrides:

remove_impl in class Keyed<Grid<MP extends Model.Parameters>>

writeAll_impl

protected AutoBuffer writeAll_impl(AutoBuffer ab)

Write out K/V pairs

Overrides:

writeAll_impl in class Keyed<Grid<MP extends Model.Parameters>>

readAll_impl

protected Keyed readAll_impl(AutoBuffer ab,
                 Futures fs)

Overrides:

readAll_impl in class Keyed<Grid<MP extends Model.Parameters>>

checksum_impl

protected long checksum_impl()

Description copied from class: Keyed

High-quality 64-bit checksum of the content of the object. Similar to hashcode(), but a long to reduce the chance of hash clashes. For composite objects this should be defined using the subcomponents' checksums (or hashcodes if not available). If two Keyed objects have the same checksum() there should be a 1 - 1/2^64 chance that they are the same object by value.

Overrides:

checksum_impl in class Keyed<Grid<MP extends Model.Parameters>>

makeSchema

public java.lang.Class<KeyV3.GridKeyV3> makeSchema()

Overrides:

makeSchema in class Keyed<Grid<MP extends Model.Parameters>>

createSummaryTable

public TwoDimTable createSummaryTable(Key<Model>[] model_ids,
                             java.lang.String sort_by,
                             boolean decreasing)

createScoringHistoryTable

public TwoDimTable createScoringHistoryTable()