Object/Trait

org.apache.spark.h2o.backends.external

ExternalBackendConf

Related Docs: trait ExternalBackendConf | package external

Permalink

object ExternalBackendConf

Linear Supertypes
AnyRef, Any
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. ExternalBackendConf
  2. AnyRef
  3. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. All

Value Members

  1. final def !=(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any
  2. final def ##(): Int

    Permalink
    Definition Classes
    AnyRef → Any
  3. final def ==(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any
  4. val EXTERNAL_BACKEND_AUTO_MODE: String

    Permalink
  5. val EXTERNAL_BACKEND_MANUAL_MODE: String

    Permalink
  6. val PROP_EXTERNAL_BACKEND_STOP_TIMEOUT: (String, Int)

    Permalink

    Timeout for confirmation from worker nodes when stopping the external backend.

    Timeout for confirmation from worker nodes when stopping the external backend. It is also possible to pass -1 to ensure the indefinite timeout. The unit is milliseconds.

  7. val PROP_EXTERNAL_CLIENT_CONNECTION_TIMEOUT: (String, Int)

    Permalink

    Timeout in milliseconds for watchdog client connection.

    Timeout in milliseconds for watchdog client connection. If client is not connected to the external cluster in the given time, the cluster is killed

  8. val PROP_EXTERNAL_CLUSTER_DRIVER_IF: (String, None.type)

    Permalink

    Driver IP address in case of auto mode in external cluster backend

  9. val PROP_EXTERNAL_CLUSTER_DRIVER_PATH: (String, None.type)

    Permalink

    Path to h2o driver

  10. val PROP_EXTERNAL_CLUSTER_HDFS_DIR: (String, None.type)

    Permalink

    HDFS dir for external h2o nodes when starting in auto mode

  11. val PROP_EXTERNAL_CLUSTER_HEALTH_CHECK_INTERVAL: (String, Int)

    Permalink

    Health check interval for external H2O nodes

  12. val PROP_EXTERNAL_CLUSTER_INFO_FILE: (String, None.type)

    Permalink

    Path to a file used as cluster notification file

  13. val PROP_EXTERNAL_CLUSTER_KILL_ON_UNHEALTHY: (String, Boolean)

    Permalink

    If true, the client will try to kill the cluster and then itself in case some nodes in the cluster report unhealthy status

  14. val PROP_EXTERNAL_CLUSTER_KILL_ON_UNHEALTHY_INTERVAL: (String, Int)

    Permalink

    How often check the healthy status for the decision whether to kill the cloud or not.

  15. val PROP_EXTERNAL_CLUSTER_REPRESENTATIVE: (String, None.type)

    Permalink

    ip:port of arbitrary h2o node to identify external h2o cluster

  16. val PROP_EXTERNAL_CLUSTER_SIZE: (String, None.type)

    Permalink

    Number of nodes to wait for when connecting to external H2O cluster in manual mode.

    Number of nodes to wait for when connecting to external H2O cluster in manual mode. In auto mode, number of nodes to be started.

  17. val PROP_EXTERNAL_CLUSTER_START_MODE: (String, String)

    Permalink

    If this option is set to "auto" then h2o external cluster will be automatically started using the provided h2o driver on yarn, otherwise it is expected that the cluster will be started by the user

  18. val PROP_EXTERNAL_CLUSTER_START_TIMEOUT: (String, Int)

    Permalink

    Timeout in seconds for starting h2o external cluster

  19. val PROP_EXTERNAL_CLUSTER_YARN_QUEUE: (String, None.type)

    Permalink

    Yarn queue on which external cluster should be started

  20. val PROP_EXTERNAL_COMMUNICATION_BLOCK_SIZE: (String, String)

    Permalink

    The size of blocks representing data traffic from Spark nodes to H2O-3 nodes.

  21. val PROP_EXTERNAL_DRIVER_IF: (String, None.type)

    Permalink
  22. val PROP_EXTERNAL_DRIVER_PORT: (String, None.type)

    Permalink
  23. val PROP_EXTERNAL_DRIVER_PORT_RANGE: (String, None.type)

    Permalink
  24. val PROP_EXTERNAL_EXTRA_MEMORY_PERCENT: (String, Int)

    Permalink
  25. val PROP_EXTERNAL_FLATFILE_NAME: (String, None.type)

    Permalink

    Name of file where flatfile is stored in case of automatic mode of external backend

  26. val PROP_EXTERNAL_H2O_MEMORY: (String, String)

    Permalink

    Number of memory assigned to each external h2o node when starting in auto mode

  27. val PROP_EXTERNAL_KERBEROS_KEYTAB: (String, None.type)

    Permalink

    Path to Kerberos key tab

  28. val PROP_EXTERNAL_KERBEROS_PRINCIPAL: (String, None.type)

    Permalink

    Kerberos principal

  29. val PROP_EXTERNAL_READ_TIMEOUT: (String, Int)

    Permalink

    Timeout in seconds for confirmation of read operation ( h2o frame => spark frame) on external cluster.

  30. val PROP_EXTERNAL_RUN_AS_USER: (String, None.type)

    Permalink

    Impersonated Hadoop user

  31. val PROP_EXTERNAL_WRITE_TIMEOUT: (String, Int)

    Permalink

    Timeout in seconds for confirmation of write operation ( spark frame => h2o frame) on external cluster.

  32. final def asInstanceOf[T0]: T0

    Permalink
    Definition Classes
    Any
  33. def clone(): AnyRef

    Permalink
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  34. final def eq(arg0: AnyRef): Boolean

    Permalink
    Definition Classes
    AnyRef
  35. def equals(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any
  36. def finalize(): Unit

    Permalink
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] )
  37. final def getClass(): Class[_]

    Permalink
    Definition Classes
    AnyRef → Any
  38. def hashCode(): Int

    Permalink
    Definition Classes
    AnyRef → Any
  39. final def isInstanceOf[T0]: Boolean

    Permalink
    Definition Classes
    Any
  40. final def ne(arg0: AnyRef): Boolean

    Permalink
    Definition Classes
    AnyRef
  41. final def notify(): Unit

    Permalink
    Definition Classes
    AnyRef
  42. final def notifyAll(): Unit

    Permalink
    Definition Classes
    AnyRef
  43. final def synchronized[T0](arg0: ⇒ T0): T0

    Permalink
    Definition Classes
    AnyRef
  44. def toString(): String

    Permalink
    Definition Classes
    AnyRef → Any
  45. final def wait(): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  46. final def wait(arg0: Long, arg1: Int): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  47. final def wait(arg0: Long): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

Inherited from AnyRef

Inherited from Any

Ungrouped