alluxio.job.transform.compact

Class HeapCompactor

java.lang.Object

alluxio.job.transform.compact.HeapCompactor

All Implemented Interfaces:

Compactor

public class HeapCompactor
extends Object
implements Compactor

Each file is viewed as a vector of sorted rows, then do a merge-sort of these vectors and write the output rows to the compacted files, complete a compacted file when the file reaches the expected size.

Constructor Summary

Constructors

Constructor and Description
HeapCompactor(Comparator<TableRow> comparator)

Method Summary

Modifier and Type	Method and Description
void	compact(List<TableReader> inputs, TableWriter output) Compacts a list of inputs to the output.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

HeapCompactor

public HeapCompactor(Comparator<TableRow> comparator)

Parameters:

comparator - the comparator to compare rows' orders

Method Detail

compact

public void compact(List<TableReader> inputs,
                    TableWriter output)
             throws IOException

Description copied from interface: Compactor

Compacts a list of inputs to the output. Closing the readers and writer is the responsibility of the caller.

Specified by:

compact in interface Compactor

Parameters:

inputs - a list of table readers

output - a table writer, can be a TablesWriter

Throws:

IOException - when compaction fails