water

Class MemoryManager

java.lang.Object

water.MemoryManager

public abstract class MemoryManager
extends java.lang.Object

Manages memory assigned to key/value pairs. All byte arrays used in keys/values should be allocated through this class - otherwise we risking running out of java memory, and throw unexpected OutOfMemory errors. The theory here is that *most* allocated bytes are allocated in large chunks by allocating new Values - with large backing arrays. If we intercept these allocation points, we cover most Java allocations. If such an allocation might trigger an OOM error we first free up some other memory. MemoryManager monitors memory used by the K/V store (by walking through the store (see Cleaner) and overall heap usage by hooking into gc. Memory is freed if either the cached memory is above the limit or if the overall heap usage is too high (in which case we want to use less mem for cache). There is also a lower limit on the amount of cache so that we never delete all the cache and therefore some computation should always be able to progress. The amount of memory to be freed is determined as the max of cached mem above the limit and heap usage above the limit. One of the primary control inputs is FullGC cycles: we check heap usage and set guidance for cache levels. We assume after a FullGC that the heap only has POJOs (Plain Old Java Objects, unknown size) and K/V Cached stuff (counted by us). We compute the free heap as MEM_MAX-heapUsage (after GC), and we compute POJO size as (heapUsage - K/V cache usage).

Field Summary

Fields

Modifier and Type	Field and Description
static long	MEM_MAX

Constructor Summary

Constructors

Constructor and Description
MemoryManager()

Method Summary

Methods

Modifier and Type	Method and Description
static byte[]	arrayCopyOf(byte[] orig, int sz)
static double[]	arrayCopyOf(double[] orig, int sz)
static int[]	arrayCopyOf(int[] orig, int sz)
static long[]	arrayCopyOf(long[] orig, int sz)
static byte[]	arrayCopyOfRange(byte[] orig, int from, int sz)
static double[]	arrayCopyOfRange(double[] orig, int from, int sz)
static int[]	arrayCopyOfRange(int[] orig, int from, int sz)
static long[]	arrayCopyOfRange(long[] orig, int from, int sz)
static byte[]	malloc1(int size)
static byte[]	malloc1(int size, boolean force)
static short[]	malloc2(int size)
static int[]	malloc4(int size)
static float[]	malloc4f(int size)
static long[]	malloc8(int size)
static double[]	malloc8d(int size)
static double[][]	malloc8d(int m, int n)
static java.lang.Object[]	mallocObj(int size)
static boolean[]	mallocZ(int size)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

MEM_MAX

public static final long MEM_MAX

Constructor Detail

MemoryManager

public MemoryManager()

Method Detail

malloc1

public static byte[] malloc1(int size)

malloc1

public static byte[] malloc1(int size,
             boolean force)

malloc2

public static short[] malloc2(int size)

malloc4

public static int[] malloc4(int size)

malloc8

public static long[] malloc8(int size)

malloc4f

public static float[] malloc4f(int size)

malloc8d

public static double[] malloc8d(int size)

malloc8d

public static double[][] malloc8d(int m,
                  int n)

mallocZ

public static boolean[] mallocZ(int size)

mallocObj

public static java.lang.Object[] mallocObj(int size)

arrayCopyOfRange

public static byte[] arrayCopyOfRange(byte[] orig,
                      int from,
                      int sz)

arrayCopyOfRange

public static int[] arrayCopyOfRange(int[] orig,
                     int from,
                     int sz)

arrayCopyOfRange

public static long[] arrayCopyOfRange(long[] orig,
                      int from,
                      int sz)

arrayCopyOfRange

public static double[] arrayCopyOfRange(double[] orig,
                        int from,
                        int sz)

arrayCopyOf

public static byte[] arrayCopyOf(byte[] orig,
                 int sz)

arrayCopyOf

public static int[] arrayCopyOf(int[] orig,
                int sz)

arrayCopyOf

public static long[] arrayCopyOf(long[] orig,
                 int sz)

arrayCopyOf

public static double[] arrayCopyOf(double[] orig,
                   int sz)