alluxio.underfs.obs

Class OBSLowLevelOutputStream

java.lang.Object

java.io.OutputStream

alluxio.underfs.ObjectLowLevelOutputStream

alluxio.underfs.obs.OBSLowLevelOutputStream

All Implemented Interfaces:

ContentHashable, Closeable, Flushable, AutoCloseable

public class OBSLowLevelOutputStream
extends ObjectLowLevelOutputStream

ObjectLowLevelOutputStream implement for OBS.

Field Summary

Fields

Modifier and Type	Field and Description
protected String	mUploadId The upload id of this multipart upload.

Fields inherited from class alluxio.underfs.ObjectLowLevelOutputStream

mBucketName, mClosed, mFile, mHash, mKey, mLocalOutputStream, mPartitionOffset, mPartitionSize, mRetryPolicy, mSingleCharWrite, mTmpDirs, UPLOAD_THRESHOLD

Constructor Summary

Constructors

Constructor and Description
OBSLowLevelOutputStream(String bucketName, String key, com.obs.services.IObsClient obsClient, com.google.common.util.concurrent.ListeningExecutorService executor, AlluxioConfiguration ufsConf) Constructs a new stream for writing a file.

Method Summary

Modifier and Type	Method and Description
protected void	abortMultiPartUploadInternal()
protected void	completeMultiPartUploadInternal()
protected void	createEmptyObject(String key)
protected com.obs.services.IObsClient	getClient()
Optional<String>	getContentHash()
protected void	initMultiPartUploadInternal()
protected void	putObject(String key, File file, String md5)
protected void	uploadPartInternal(File file, int partNumber, boolean isLastPart, String md5)

Methods inherited from class alluxio.underfs.ObjectLowLevelOutputStream

abortMultiPartUpload, close, flush, getPartNumber, uploadPart, uploadPart, waitForAllPartsUpload, write, write, write

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

mUploadId

protected volatile String mUploadId

The upload id of this multipart upload.

Constructor Detail

OBSLowLevelOutputStream

public OBSLowLevelOutputStream(String bucketName,
                               String key,
                               com.obs.services.IObsClient obsClient,
                               com.google.common.util.concurrent.ListeningExecutorService executor,
                               AlluxioConfiguration ufsConf)

Constructs a new stream for writing a file.

Parameters:

bucketName - the name of the bucket

key - the key of the file

obsClient - the OBS client to upload the file with

executor - a thread pool executor

ufsConf - the object store under file system configuration

Method Detail

uploadPartInternal

protected void uploadPartInternal(File file,
                                  int partNumber,
                                  boolean isLastPart,
                                  String md5)
                           throws IOException

Specified by:

uploadPartInternal in class ObjectLowLevelOutputStream

Throws:

IOException

initMultiPartUploadInternal

protected void initMultiPartUploadInternal()
                                    throws IOException

Specified by:

initMultiPartUploadInternal in class ObjectLowLevelOutputStream

Throws:

IOException

completeMultiPartUploadInternal

protected void completeMultiPartUploadInternal()
                                        throws IOException

Specified by:

completeMultiPartUploadInternal in class ObjectLowLevelOutputStream

Throws:

IOException

abortMultiPartUploadInternal

protected void abortMultiPartUploadInternal()
                                     throws IOException

Specified by:

abortMultiPartUploadInternal in class ObjectLowLevelOutputStream

Throws:

IOException

createEmptyObject

protected void createEmptyObject(String key)
                          throws IOException

Specified by:

createEmptyObject in class ObjectLowLevelOutputStream

Throws:

IOException

putObject

protected void putObject(String key,
                         File file,
                         String md5)
                  throws IOException

Specified by:

putObject in class ObjectLowLevelOutputStream

Throws:

IOException

getClient

protected com.obs.services.IObsClient getClient()

getContentHash

public Optional<String> getContentHash()

Returns:

the content hash of the file written to the UFS if available after the stream has been closed