alluxio.underfs.oss

Class OSSLowLevelOutputStream

java.lang.Object

java.io.OutputStream

alluxio.underfs.ObjectLowLevelOutputStream

alluxio.underfs.oss.OSSLowLevelOutputStream

All Implemented Interfaces:

ContentHashable, Closeable, Flushable, AutoCloseable

public class OSSLowLevelOutputStream
extends ObjectLowLevelOutputStream

ObjectLowLevelOutputStream implement for OSS.

Field Summary

Fields

Modifier and Type	Field and Description
protected String	mUploadId The upload id of this multipart upload.

Fields inherited from class alluxio.underfs.ObjectLowLevelOutputStream

LOG, mBucketName, mClosed, mFile, mHash, mKey, mLocalOutputStream, mPartitionOffset, mPartitionSize, mRetryPolicy, mSingleCharWrite, mTmpDirs, UPLOAD_THRESHOLD

Constructor Summary

Constructors

Constructor and Description
OSSLowLevelOutputStream(String bucketName, String key, com.aliyun.oss.OSS oss, com.google.common.util.concurrent.ListeningExecutorService executor, AlluxioConfiguration ufsConf) Constructs a new stream for writing a file.

Method Summary

Modifier and Type	Method and Description
protected void	abortMultiPartUploadInternal()
protected void	completeMultiPartUploadInternal()
protected void	createEmptyObject(String key)
protected com.aliyun.oss.OSS	getClient()
Optional<String>	getContentHash()
protected void	initMultiPartUploadInternal()
protected void	putObject(String key, File file, String md5)
protected void	uploadPartInternal(File file, int partNumber, boolean isLastPart, String md5)

Methods inherited from class alluxio.underfs.ObjectLowLevelOutputStream

abortMultiPartUpload, close, flush, getPartNumber, uploadPart, uploadPart, waitForAllPartsUpload, write, write, write

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

mUploadId

protected volatile String mUploadId

The upload id of this multipart upload.

Constructor Detail

OSSLowLevelOutputStream

public OSSLowLevelOutputStream(String bucketName,
                               String key,
                               com.aliyun.oss.OSS oss,
                               com.google.common.util.concurrent.ListeningExecutorService executor,
                               AlluxioConfiguration ufsConf)

Constructs a new stream for writing a file.

Parameters:

bucketName - the name of the bucket

key - the key of the file

oss - the OSS client to upload the file with

executor - a thread pool executor

ufsConf - the object store under file system configuration

Method Detail

abortMultiPartUploadInternal

protected void abortMultiPartUploadInternal()
                                     throws IOException

Specified by:

abortMultiPartUploadInternal in class ObjectLowLevelOutputStream

Throws:

IOException

uploadPartInternal

protected void uploadPartInternal(File file,
                                  int partNumber,
                                  boolean isLastPart,
                                  @Nullable
                                  String md5)
                           throws IOException

Specified by:

uploadPartInternal in class ObjectLowLevelOutputStream

Throws:

IOException

initMultiPartUploadInternal

protected void initMultiPartUploadInternal()
                                    throws IOException

Specified by:

initMultiPartUploadInternal in class ObjectLowLevelOutputStream

Throws:

IOException

completeMultiPartUploadInternal

protected void completeMultiPartUploadInternal()
                                        throws IOException

Specified by:

completeMultiPartUploadInternal in class ObjectLowLevelOutputStream

Throws:

IOException

createEmptyObject

protected void createEmptyObject(String key)
                          throws IOException

Specified by:

createEmptyObject in class ObjectLowLevelOutputStream

Throws:

IOException

putObject

protected void putObject(String key,
                         File file,
                         @Nullable
                         String md5)
                  throws IOException

Specified by:

putObject in class ObjectLowLevelOutputStream

Throws:

IOException

getContentHash

public Optional<String> getContentHash()

Returns:

the content hash of the file written to the UFS if available after the stream has been closed

getClient

protected com.aliyun.oss.OSS getClient()