Parser (h2o-core 3.42.0 API)

java.lang.Object
- water.Iced
- - water.parser.Parser

All Implemented Interfaces:

java.io.Externalizable, java.io.Serializable, java.lang.Cloneable, Freezable

Direct Known Subclasses:

CsvParser
```
public abstract class Parser
extends Iced
```
A collection of utility classes for parsing. Interfaces: DataIn - Manage bulk streaming input data to the parser. Sometimes the data comes from parallel raw byte file reads, with speculative line starts. Sometimes the data comes from an InputStream - probably a GZIP stream. DataOut- Interface for writing results of parsing, accumulating numbers and strings or handling invalid lines & parse errors. static classes: StreamData - Class implementing DataIn from a Stream (probably a GZIP stream) InspectDataOut - Class implementing DataOut, on behalf of the GUI, for parsing & previewing the first few lines & columns of a file.

See Also:

Serialized Form

Field Summary

Fields
Modifier and Type	Field and Description
`protected Key<Job>`	`_jobKey`
`boolean[]`	`_keepColumns`
`protected ParseSetup`	`_setup`
`protected byte`	`CHAR_DECIMAL_SEP`
`protected byte`	`CHAR_ESCAPE`
`protected byte`	`CHAR_SEPARATOR`
`protected static byte`	`COND_QUOTE`
`protected static byte`	`COND_QUOTED_NUMBER_END`
`protected static byte`	`COND_QUOTED_TOKEN`
`protected static byte`	`EOL`
`protected static byte`	`EXPECT_COND_LF`
`protected static byte`	`HASHTAG`
`protected static long`	`LARGEST_DIGIT_NUMBER`
`protected static byte`	`NUMBER`
`protected static byte`	`NUMBER_END`
`protected static byte`	`NUMBER_EXP`
`protected static byte`	`NUMBER_EXP_START`
`protected static byte`	`NUMBER_FRACTION`
`protected static byte`	`NUMBER_SKIP`
`protected static byte`	`NUMBER_SKIP_NO_DOT`
`protected static byte`	`POSSIBLE_CURRENCY`
`protected static byte`	`POSSIBLE_EMPTY_LINE`
`protected static byte`	`POSSIBLE_ESCAPED_QUOTE`
`protected static byte`	`SEPARATOR_OR_EOL`
`protected static byte`	`SKIP_LINE`
`protected static byte`	`STRING`
`protected static byte`	`STRING_END`
`protected static byte`	`TOKEN`
`protected static byte`	`WHITESPACE_BEFORE_TOKEN`

Constructor Summary

Constructors
Modifier Constructor and Description

protected Parser(ParseSetup setup, Key<Job> jobKey)

Constructors
Modifier	Constructor and Description
`protected`	`Parser(ParseSetup setup, Key<Job> jobKey)`

Method Summary

All Methods Static Methods Instance Methods Abstract Methods Concrete Methods
Modifier and Type	Method and Description
`protected int`	`fileHasHeader(byte[] bits, ParseSetup ps)`
`protected static boolean`	`isEOL(byte c)`
`protected abstract ParseWriter`	`parseChunk(int cidx, ParseReader din, ParseWriter dout)`
`protected StreamParseWriter`	`sequentialParse(Vec vec, StreamParseWriter dout)`
`protected ParseWriter`	`streamParse(java.io.InputStream is, StreamParseWriter dout)`
`protected ParseWriter`	`streamParseZip(java.io.InputStream is, StreamParseWriter dout, java.io.InputStream bvs)`

Methods inherited from class water.Iced
asBytes, clone, copyOver, frozenType, read, readExternal, readJSON, reloadFromBytes, toJsonBytes, toJsonString, write, writeExternal, writeJSON

Methods inherited from class java.lang.Object
equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

SKIP_LINE
```
protected static final byte SKIP_LINE
```
See Also:

Constant Field Values

EXPECT_COND_LF
```
protected static final byte EXPECT_COND_LF
```
See Also:

Constant Field Values

EOL
```
protected static final byte EOL
```
See Also:

Constant Field Values

TOKEN
```
protected static final byte TOKEN
```
See Also:

Constant Field Values

COND_QUOTED_TOKEN
```
protected static final byte COND_QUOTED_TOKEN
```
See Also:

Constant Field Values

NUMBER
```
protected static final byte NUMBER
```
See Also:

Constant Field Values

NUMBER_SKIP
```
protected static final byte NUMBER_SKIP
```
See Also:

Constant Field Values

NUMBER_SKIP_NO_DOT
```
protected static final byte NUMBER_SKIP_NO_DOT
```
See Also:

Constant Field Values

NUMBER_FRACTION
```
protected static final byte NUMBER_FRACTION
```
See Also:

Constant Field Values

NUMBER_EXP
```
protected static final byte NUMBER_EXP
```
See Also:

Constant Field Values

NUMBER_EXP_START
```
protected static final byte NUMBER_EXP_START
```
See Also:

Constant Field Values

NUMBER_END
```
protected static final byte NUMBER_END
```
See Also:

Constant Field Values

STRING
```
protected static final byte STRING
```
See Also:

Constant Field Values

COND_QUOTE
```
protected static final byte COND_QUOTE
```
See Also:

Constant Field Values

SEPARATOR_OR_EOL
```
protected static final byte SEPARATOR_OR_EOL
```
See Also:

Constant Field Values

WHITESPACE_BEFORE_TOKEN
```
protected static final byte WHITESPACE_BEFORE_TOKEN
```
See Also:

Constant Field Values

STRING_END
```
protected static final byte STRING_END
```
See Also:

Constant Field Values

COND_QUOTED_NUMBER_END
```
protected static final byte COND_QUOTED_NUMBER_END
```
See Also:

Constant Field Values

POSSIBLE_EMPTY_LINE
```
protected static final byte POSSIBLE_EMPTY_LINE
```
See Also:

Constant Field Values

POSSIBLE_CURRENCY
```
protected static final byte POSSIBLE_CURRENCY
```
See Also:

Constant Field Values

HASHTAG
```
protected static final byte HASHTAG
```
See Also:

Constant Field Values

POSSIBLE_ESCAPED_QUOTE
```
protected static final byte POSSIBLE_ESCAPED_QUOTE
```
See Also:

Constant Field Values

CHAR_DECIMAL_SEP
```
protected final byte CHAR_DECIMAL_SEP
```
See Also:

Constant Field Values

CHAR_SEPARATOR
```
protected final byte CHAR_SEPARATOR
```

CHAR_ESCAPE
```
protected final byte CHAR_ESCAPE
```

LARGEST_DIGIT_NUMBER
```
protected static final long LARGEST_DIGIT_NUMBER
```
See Also:

Constant Field Values

_keepColumns
```
public boolean[] _keepColumns
```

_setup
```
protected final ParseSetup _setup
```

_jobKey
```
protected final Key<Job> _jobKey
```

Constructor Detail

Parser

protected Parser(ParseSetup setup,
                 Key<Job> jobKey)

Method Detail

isEOL

protected static boolean isEOL(byte c)

fileHasHeader

protected int fileHasHeader(byte[] bits,
                            ParseSetup ps)

parseChunk

protected abstract ParseWriter parseChunk(int cidx,
                                          ParseReader din,
                                          ParseWriter dout)

sequentialParse

protected StreamParseWriter sequentialParse(Vec vec,
                                            StreamParseWriter dout)

streamParse

protected ParseWriter streamParse(java.io.InputStream is,
                                  StreamParseWriter dout)
                           throws java.io.IOException

Throws:: java.io.IOException

streamParseZip

protected ParseWriter streamParseZip(java.io.InputStream is,
                                     StreamParseWriter dout,
                                     java.io.InputStream bvs)
                              throws java.io.IOException

Throws:: java.io.IOException

Class Parser

Field Summary

Constructor Summary

Method Summary

Methods inherited from class water.Iced

Methods inherited from class java.lang.Object

Field Detail

SKIP_LINE

EXPECT_COND_LF

EOL

TOKEN

COND_QUOTED_TOKEN

NUMBER

NUMBER_SKIP

NUMBER_SKIP_NO_DOT

NUMBER_FRACTION

NUMBER_EXP

NUMBER_EXP_START

NUMBER_END

STRING

COND_QUOTE

SEPARATOR_OR_EOL

WHITESPACE_BEFORE_TOKEN

STRING_END

COND_QUOTED_NUMBER_END

POSSIBLE_EMPTY_LINE

POSSIBLE_CURRENCY

HASHTAG

POSSIBLE_ESCAPED_QUOTE

CHAR_DECIMAL_SEP

CHAR_SEPARATOR

CHAR_ESCAPE

LARGEST_DIGIT_NUMBER

_keepColumns

_setup

_jobKey

Constructor Detail

Parser

Method Detail

isEOL

fileHasHeader

parseChunk

sequentialParse

streamParse

streamParseZip