@ThreadSafe public class WasbUnderFileSystem extends HdfsUnderFileSystem
UnderFileSystem
uses the Microsoft Azure Blob Storage.UnderFileSystem.Factory, UnderFileSystem.SpaceType
Modifier and Type | Field and Description |
---|---|
static String |
SCHEME_INSECURE
Constant for the wasb URI scheme.
|
static String |
SCHEME_SECURE
Constant for the wasbs URI scheme.
|
mUfsConf, mUri
Constructor and Description |
---|
WasbUnderFileSystem(AlluxioURI ufsUri,
UnderFileSystemConfiguration conf,
org.apache.hadoop.conf.Configuration wasbConf)
Constructs a new Wasb
UnderFileSystem . |
Modifier and Type | Method and Description |
---|---|
static org.apache.hadoop.conf.Configuration |
createConfiguration(UnderFileSystemConfiguration conf,
Boolean isSecure)
Prepares the configuration for this Wasb as an HDFS configuration.
|
static WasbUnderFileSystem |
createInstance(AlluxioURI uri,
UnderFileSystemConfiguration conf)
Factory method to construct a new Wasb
UnderFileSystem . |
long |
getBlockSizeByte(String path)
Gets the block size of a file in under file system, in bytes.
|
List<String> |
getFileLocations(String path)
Gets the list of locations of the indicated path.
|
List<String> |
getFileLocations(String path,
FileLocationOptions options)
Gets the list of locations of the indicated path given options.
|
UfsStatus |
getStatus(String path)
Gets the file or directory status.
|
String |
getUnderFSType()
Returns the name of the under filesystem implementation.
|
cleanup, close, connectFromMaster, connectFromWorker, create, createConfiguration, createDirect, deleteDirectory, deleteFile, exists, getAclPair, getActiveSyncInfo, getDirectoryStatus, getFileStatus, getSpace, isDirectory, isFile, isSeekable, listStatus, mkdirs, open, renameDirectory, renameFile, setAclEntries, setMode, setOwner, startActiveSyncPolling, startSync, stopActiveSyncPolling, stopSync, supportsActiveSync, supportsFlush
createNonexistingFile, createNonexistingFile, deleteExistingDirectory, deleteExistingDirectory, deleteExistingFile, getExistingDirectoryStatus, getExistingFileStatus, getExistingStatus, isExistingDirectory, openExistingFile, openExistingFile, renameRenamableDirectory, renameRenamableFile
create, deleteDirectory, getConfiguration, getFingerprint, getOperationMode, getPhysicalStores, isObjectStorage, listStatus, mkdirs, open, resolveUri, validatePath
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait
create, createNonexistingFile, createNonexistingFile, deleteDirectory, deleteExistingDirectory, deleteExistingDirectory, deleteExistingFile, getConfiguration, getExistingDirectoryStatus, getExistingFileStatus, getExistingStatus, getFingerprint, getOperationMode, getPhysicalStores, isExistingDirectory, isObjectStorage, listStatus, mkdirs, open, openExistingFile, openExistingFile, renameRenamableDirectory, renameRenamableFile, resolveUri
public static final String SCHEME_INSECURE
public static final String SCHEME_SECURE
public WasbUnderFileSystem(AlluxioURI ufsUri, UnderFileSystemConfiguration conf, org.apache.hadoop.conf.Configuration wasbConf)
UnderFileSystem
.ufsUri
- the AlluxioURI
for this UFSconf
- the configuration for this UFSwasbConf
- the configuration for this Wasb UFSpublic static org.apache.hadoop.conf.Configuration createConfiguration(UnderFileSystemConfiguration conf, Boolean isSecure)
conf
- the configuration for this UFSisSecure
- whether blob storage is using httpspublic static WasbUnderFileSystem createInstance(AlluxioURI uri, UnderFileSystemConfiguration conf)
UnderFileSystem
.uri
- the AlluxioURI
for this UFSconf
- the configuration for this UFSUnderFileSystem
instancepublic String getUnderFSType()
UnderFileSystem
getUnderFSType
in interface UnderFileSystem
getUnderFSType
in class HdfsUnderFileSystem
public long getBlockSizeByte(String path) throws IOException
UnderFileSystem
getBlockSizeByte
in interface UnderFileSystem
getBlockSizeByte
in class HdfsUnderFileSystem
path
- the file nameIOException
public UfsStatus getStatus(String path) throws IOException
UnderFileSystem
getStatus
in interface UnderFileSystem
getStatus
in class HdfsUnderFileSystem
path
- the path to get the statusFileNotFoundException
- when the path does not existIOException
public List<String> getFileLocations(String path) throws IOException
UnderFileSystem
getFileLocations
in interface UnderFileSystem
getFileLocations
in class HdfsUnderFileSystem
path
- the file nameIOException
public List<String> getFileLocations(String path, FileLocationOptions options) throws IOException
UnderFileSystem
getFileLocations
in interface UnderFileSystem
getFileLocations
in class HdfsUnderFileSystem
path
- the file nameoptions
- method optionsIOException
Copyright © 2023. All Rights Reserved.