hex.glm

Class GLM

java.lang.Object

water.Iced

hex.ModelBuilder<GLMModel,GLMModel.GLMParameters,GLMModel.GLMOutput>

hex.glm.GLM

All Implemented Interfaces:

java.io.Externalizable, java.io.Serializable, java.lang.Cloneable, water.Freezable

public class GLM
extends hex.ModelBuilder<GLMModel,GLMModel.GLMParameters,GLMModel.GLMOutput>

Created by tomasnykodym on 8/27/14. Generalized linear model implementation.

See Also:

Serialized Form

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
class	GLM.BetaConstraint
class	GLM.GLMDriver Main loop of the glm algo.
static class	GLM.GLMGradientInfo
static class	GLM.GLMGradientSolver Gradient and line search computation for L_BFGS and also L_BFGS solver wrapper (for ADMM)
static class	GLM.GramSolver Created by tomasnykodym on 3/30/15.
static class	GLM.ProximalGradientInfo
static class	GLM.ProximalGradientSolver Simple wrapper around ginfo computation, adding proximal penalty

Nested classes/interfaces inherited from class hex.ModelBuilder

hex.ModelBuilder.BuilderVisibility, hex.ModelBuilder.Driver, hex.ModelBuilder.FilterCols, hex.ModelBuilder.ValidationMessage

Field Summary

Fields

Modifier and Type	Field and Description
protected boolean	_cv
java.lang.String	_generatedWeights
static int	SCORING_INTERVAL_MSEC
protected static long	WORK_TOTAL

Fields inherited from class hex.ModelBuilder

_fold, _job, _messages, _nclass, _offset, _origDomains, _origNames, _parms, _priorClassDist, _removedCols, _response, _result, _train, _valid, _vresponse, _weights

Constructor Summary

Constructors

Constructor and Description
GLM(boolean startup_once)
GLM(GLMModel.GLMParameters parms)
GLM(GLMModel.GLMParameters parms, water.Key dest)

Method Summary

Methods

Modifier and Type	Method and Description
hex.ModelCategory[]	can_build()
protected void	checkMemoryFootPrint(DataInfo activeData)
double[]	COD_solve(GLMTask.GLMIterationTask gt, double alpha, double lambda)
void	computeCrossValidation() GLM implementation of N-fold cross-validation.
protected boolean	computePriorClassDistribution()
void	cv_computeAndSetOptimalParameters(hex.ModelBuilder[] cvModelBuilders) If run with lambda search, we need to take extra action performed after cross-val models are built.
boolean	haveMojo()
boolean	havePojo()
void	init(boolean expensive)
boolean	isSupervised()
int	nclasses()
protected static double	sparseOffset(double[] beta, DataInfo dinfo)
protected GLM.GLMDriver	trainModelImpl()

Methods inherited from class hex.ModelBuilder

algoName, algos, builderVisibility, checkDistributions, checkMemoryFootPrint, clearInitState, clearValidationErrors, cv_AssignFold, cv_buildModels, cv_mainModelScores, cv_makeFramesAndBuilders, cv_makeWeights, cv_scoreCVModels, defaultKey, desiredChunks, dest, error_count, error, get, getToEigenVec, hasFoldCol, hasOffsetCol, hasWeightCol, hide, ignoreBadColumns, ignoreConstColumns, ignoreInvalidColumns, ignoreStringColumns, info, init_adaptFrameToTrain, isClassifier, isStopped, javaName, logMe, make, message, nFoldCV, nFoldWork, nModelsInParallel, numSpecialCols, paramName, rebalance, response, schemaDirectory, separateFeatureVecs, setTrain, shouldReorder, specialColNames, stop_requested, timeout, train, trainModel, trainModelNested, valid, validationErrors, vresponse, warn

Methods inherited from class water.Iced

asBytes, clone, copyOver, frozenType, read, readExternal, readJSON, reloadFromBytes, toJsonString, write, writeExternal, writeJSON

Methods inherited from class java.lang.Object

equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

_cv

protected boolean _cv

SCORING_INTERVAL_MSEC

public static final int SCORING_INTERVAL_MSEC

See Also:

Constant Field Values

_generatedWeights

public java.lang.String _generatedWeights

WORK_TOTAL

protected static final long WORK_TOTAL

See Also:

Constant Field Values

Constructor Detail

GLM

public GLM(boolean startup_once)

GLM

public GLM(GLMModel.GLMParameters parms)

GLM

public GLM(GLMModel.GLMParameters parms,
   water.Key dest)

Method Detail

isSupervised

public boolean isSupervised()

Specified by:

isSupervised in class hex.ModelBuilder<GLMModel,GLMModel.GLMParameters,GLMModel.GLMOutput>

can_build

public hex.ModelCategory[] can_build()

Specified by:

can_build in class hex.ModelBuilder<GLMModel,GLMModel.GLMParameters,GLMModel.GLMOutput>

havePojo

public boolean havePojo()

Overrides:

havePojo in class hex.ModelBuilder<GLMModel,GLMModel.GLMParameters,GLMModel.GLMOutput>

haveMojo

public boolean haveMojo()

Overrides:

haveMojo in class hex.ModelBuilder<GLMModel,GLMModel.GLMParameters,GLMModel.GLMOutput>

computeCrossValidation

public void computeCrossValidation()

GLM implementation of N-fold cross-validation. We need to compute the sequence of lambdas for the main model so the folds share the same lambdas. We also want to set the _cv flag so that the dependent jobs know they're being run withing CV (so e.g. they do not unlock the models in the end)

Overrides:

computeCrossValidation in class hex.ModelBuilder<GLMModel,GLMModel.GLMParameters,GLMModel.GLMOutput>

cv_computeAndSetOptimalParameters

public void cv_computeAndSetOptimalParameters(hex.ModelBuilder[] cvModelBuilders)

If run with lambda search, we need to take extra action performed after cross-val models are built. Each of the folds have been computed with ots own private validation datasetd and it performed early stopping based on it. => We need to: 1. compute cross-validated lambda estimate 2. set the lambda estimate too all n-folds models (might require extra model fitting if the particular model stopped too early!) 3. compute cross-validated scoring history (cross-validated deviance standard error per lambda) 4. unlock the n-folds models (they are changed here, so the unlocking happens here)

Overrides:

cv_computeAndSetOptimalParameters in class hex.ModelBuilder<GLMModel,GLMModel.GLMParameters,GLMModel.GLMOutput>

checkMemoryFootPrint

protected void checkMemoryFootPrint(DataInfo activeData)

nclasses

public int nclasses()

Overrides:

nclasses in class hex.ModelBuilder<GLMModel,GLMModel.GLMParameters,GLMModel.GLMOutput>

computePriorClassDistribution

protected boolean computePriorClassDistribution()

Overrides:

computePriorClassDistribution in class hex.ModelBuilder<GLMModel,GLMModel.GLMParameters,GLMModel.GLMOutput>

init

public void init(boolean expensive)

Overrides:

init in class hex.ModelBuilder<GLMModel,GLMModel.GLMParameters,GLMModel.GLMOutput>

trainModelImpl

protected GLM.GLMDriver trainModelImpl()

Specified by:

trainModelImpl in class hex.ModelBuilder<GLMModel,GLMModel.GLMParameters,GLMModel.GLMOutput>

COD_solve

public double[] COD_solve(GLMTask.GLMIterationTask gt,
                 double alpha,
                 double lambda)

sparseOffset

protected static double sparseOffset(double[] beta,
                  DataInfo dinfo)