alluxio.master.lineage.meta

Class LineageStore

java.lang.Object

alluxio.master.lineage.meta.LineageStore

All Implemented Interfaces:

JournalEntryIterable

@ThreadSafe
public final class LineageStore
extends Object
implements JournalEntryIterable

A store of lineages. This class is thread-safe. TODO(yupeng): relax locking

Constructor Summary

Constructors

Constructor and Description
LineageStore(LineageIdGenerator lineageIdGenerator) Constructs the lineage store.

Method Summary

Modifier and Type	Method and Description
void	addLineageFromJournal(Lineage.LineageEntry entry) Constructs the lineage store from the journal.
long	createLineage(List<Long> inputFiles, List<Long> outputFiles, Job job) Creates a lineage.
void	deleteLineage(long lineageId) Deletes a lineage.
List<Lineage>	getAllInTopologicalOrder()
List<Lineage>	getChildren(Lineage lineage) Gets all the children of a given lineage.
Iterator<Journal.JournalEntry>	getJournalEntryIterator() Note that this method is not threadsafe.
Lineage	getLineage(long lineageId) Gets the lineage.
Lineage	getLineageOfOutputFile(long fileId) Gets the lineage that has the given output file.
List<Lineage>	getParents(Lineage lineage) Gets all the parents of a given lineage.
List<Lineage>	getRootLineages()
boolean	hasOutputFile(long fileId) Checks if there's an output file with given file id.
List<Lineage>	sortLineageTopologically(Set<Lineage> lineages) Sorts a given set of lineages topologically.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

LineageStore

public LineageStore(LineageIdGenerator lineageIdGenerator)

Constructs the lineage store.

Parameters:

lineageIdGenerator - the lineage id generator

Method Detail

addLineageFromJournal

public void addLineageFromJournal(Lineage.LineageEntry entry)

Constructs the lineage store from the journal.

Parameters:

entry - the journal entry

createLineage

public long createLineage(List<Long> inputFiles,
                          List<Long> outputFiles,
                          Job job)

Creates a lineage.

Parameters:

inputFiles - the input files

outputFiles - the output files

job - the job

Returns:

the id of the created lineage

deleteLineage

public void deleteLineage(long lineageId)
                   throws LineageDoesNotExistException

Deletes a lineage.

Parameters:

lineageId - the lineage id

Throws:

LineageDoesNotExistException - if the lineage does not exist

getLineage

public Lineage getLineage(long lineageId)

Gets the lineage.

Parameters:

lineageId - the lineage id

Returns:

the lineage

getChildren

public List<Lineage> getChildren(Lineage lineage)
                          throws LineageDoesNotExistException

Gets all the children of a given lineage.

Parameters:

lineage - the lineage

Returns:

the lineage's children

Throws:

LineageDoesNotExistException - if the lineage does not exist

getLineageOfOutputFile

public Lineage getLineageOfOutputFile(long fileId)
                               throws LineageDoesNotExistException

Gets the lineage that has the given output file.

Parameters:

fileId - the file id

Returns:

the lineage containing the output file

Throws:

LineageDoesNotExistException - if the lineage does not exist

getParents

public List<Lineage> getParents(Lineage lineage)
                         throws LineageDoesNotExistException

Gets all the parents of a given lineage.

Parameters:

lineage - the lineage

Returns:

the lineage's parents

Throws:

LineageDoesNotExistException - if the lineage does not exist

getRootLineages

public List<Lineage> getRootLineages()

Returns:

the list of all root lineages

sortLineageTopologically

public List<Lineage> sortLineageTopologically(Set<Lineage> lineages)

Sorts a given set of lineages topologically.

Parameters:

lineages - lineages to sort

Returns:

the lineages after sort

getAllInTopologicalOrder

public List<Lineage> getAllInTopologicalOrder()

Returns:

all the lineages in topological order

getJournalEntryIterator

public Iterator<Journal.JournalEntry> getJournalEntryIterator()

Note that this method is not threadsafe. But we should never checkpoint while the lineage master is serving.

Specified by:

getJournalEntryIterator in interface JournalEntryIterable

Returns:

the iterator

hasOutputFile

public boolean hasOutputFile(long fileId)

Checks if there's an output file with given file id.

Parameters:

fileId - the file id

Returns:

true if there's a lineage in the store that has the output file of the given id, false otherwise