|
||||||||||
PREV NEXT | FRAMES NO FRAMES |
Packages that use Path | |
---|---|
org.apache.hadoop.conf | Configuration of system parameters. |
org.apache.hadoop.fs | An abstract file system API. |
org.apache.hadoop.fs.ftp | |
org.apache.hadoop.fs.kfs | A client for the Kosmos filesystem (KFS) |
org.apache.hadoop.fs.s3 | A distributed, block-based implementation of FileSystem that uses Amazon S3
as a backing store. |
org.apache.hadoop.fs.s3native |
A distributed implementation of FileSystem for reading and writing files on
Amazon S3. |
org.apache.hadoop.fs.shell | |
org.apache.hadoop.io | Generic i/o code for use when reading and writing data to the network, to databases, and to files. |
org.apache.hadoop.io.compress |
Uses of Path in org.apache.hadoop.conf |
---|
Methods in org.apache.hadoop.conf that return Path | |
---|---|
Path |
Configuration.getLocalPath(String dirsProp,
String path)
Get a local file under a directory named by dirsProp with the given path. |
Methods in org.apache.hadoop.conf with parameters of type Path | |
---|---|
void |
Configuration.addResource(Path file)
Add a configuration resource. |
Uses of Path in org.apache.hadoop.fs |
---|
Methods in org.apache.hadoop.fs that return Path | |
---|---|
Path |
ChecksumFileSystem.getChecksumFile(Path file)
Return the name of the checksum file associated with a file. |
Path |
RawLocalFileSystem.getHomeDirectory()
|
Path |
FilterFileSystem.getHomeDirectory()
|
Path |
FileSystem.getHomeDirectory()
Return the current user's home directory in this filesystem. |
protected Path |
AbstractFileSystem.getHomeDirectory()
Return the current user's home directory in this file system. |
protected Path |
RawLocalFileSystem.getInitialWorkingDirectory()
|
protected Path |
FilterFileSystem.getInitialWorkingDirectory()
|
protected Path |
FileSystem.getInitialWorkingDirectory()
Note: with the new FilesContext class, getWorkingDirectory() will be removed. |
protected Path |
AbstractFileSystem.getInitialWorkingDirectory()
Some file systems like LocalFileSystem have an initial workingDir that is used as the starting workingDir. |
Path |
FileContext.getLinkTarget(Path f)
Returns the un-interpreted target of the given symbolic link. |
protected Path |
AbstractFileSystem.getLinkTarget(Path f)
The specification of this method matches that of FileContext.getLinkTarget(Path) ; |
Path |
Path.getParent()
Returns the parent of a path or null if at root. |
Path |
FileStatus.getPath()
|
Path |
FileStatus.getSymlink()
|
Path |
RawLocalFileSystem.getWorkingDirectory()
|
Path |
FileContext.getWorkingDirectory()
Gets the working directory for wd-relative names (such a "foo/bar"). |
Path |
FilterFileSystem.getWorkingDirectory()
Get the current working directory for the given file system |
abstract Path |
FileSystem.getWorkingDirectory()
Get the current working directory for the given file system |
Path |
Path.makeQualified(FileSystem fs)
Deprecated. |
Path |
FileContext.makeQualified(Path path)
Make the path fully qualified if it is isn't. |
Path |
FilterFileSystem.makeQualified(Path path)
Make sure that a path specifies a FileSystem. |
Path |
FileSystem.makeQualified(Path path)
Make sure that a path specifies a FileSystem. |
Path |
Path.makeQualified(URI defaultUri,
Path workingDir)
Returns a qualified path object. |
protected Path |
FileContext.resolve(Path f)
Resolves all symbolic links in the specified path. |
protected Path |
FileContext.resolveIntermediate(Path f)
Resolves all symbolic links in the specified path leading up to, but not including the final path component. |
Path |
RawLocalFileSystem.startLocalOutput(Path fsOutputFile,
Path tmpLocalFile)
|
Path |
ChecksumFileSystem.startLocalOutput(Path fsOutputFile,
Path tmpLocalFile)
|
Path |
FilterFileSystem.startLocalOutput(Path fsOutputFile,
Path tmpLocalFile)
Returns a local File that the user can write output to. |
Path |
FileSystem.startLocalOutput(Path fsOutputFile,
Path tmpLocalFile)
Returns a local File that the user can write output to. |
static Path[] |
FileUtil.stat2Paths(FileStatus[] stats)
convert an array of FileStatus to an array of Path |
static Path[] |
FileUtil.stat2Paths(FileStatus[] stats,
Path path)
convert an array of FileStatus to an array of Path. |
Path |
Path.suffix(String suffix)
Adds a suffix to the final name in the path. |
Methods in org.apache.hadoop.fs with parameters of type Path | |
---|---|
boolean |
PathFilter.accept(Path path)
Tests whether or not the specified abstract pathname should be included in a pathname list. |
FSDataOutputStream |
FileSystem.append(Path f)
Append to an existing file (optional operation). |
FSDataOutputStream |
FileSystem.append(Path f,
int bufferSize)
Append to an existing file (optional operation). |
FSDataOutputStream |
RawLocalFileSystem.append(Path f,
int bufferSize,
Progressable progress)
Append to an existing file (optional operation). |
FSDataOutputStream |
ChecksumFileSystem.append(Path f,
int bufferSize,
Progressable progress)
Append to an existing file (optional operation). |
FSDataOutputStream |
FilterFileSystem.append(Path f,
int bufferSize,
Progressable progress)
Append to an existing file (optional operation). |
abstract FSDataOutputStream |
FileSystem.append(Path f,
int bufferSize,
Progressable progress)
Append to an existing file (optional operation). |
protected void |
FilterFileSystem.checkPath(Path path)
Check that a Path belongs to this FileSystem. |
protected void |
FileSystem.checkPath(Path path)
Check that a Path belongs to this FileSystem. |
protected void |
AbstractFileSystem.checkPath(Path path)
Check that a Path belongs to this FileSystem. |
void |
RawLocalFileSystem.completeLocalOutput(Path fsWorkingFile,
Path tmpLocalFile)
|
void |
ChecksumFileSystem.completeLocalOutput(Path fsOutputFile,
Path tmpLocalFile)
|
void |
FilterFileSystem.completeLocalOutput(Path fsOutputFile,
Path tmpLocalFile)
Called when we're all done writing to the target. |
void |
FileSystem.completeLocalOutput(Path fsOutputFile,
Path tmpLocalFile)
Called when we're all done writing to the target. |
static boolean |
FileUtil.copy(File src,
FileSystem dstFS,
Path dst,
boolean deleteSource,
Configuration conf)
Copy local files to a FileSystem. |
static boolean |
FileUtil.copy(FileSystem srcFS,
Path[] srcs,
FileSystem dstFS,
Path dst,
boolean deleteSource,
boolean overwrite,
Configuration conf)
|
static boolean |
FileUtil.copy(FileSystem srcFS,
Path[] srcs,
FileSystem dstFS,
Path dst,
boolean deleteSource,
boolean overwrite,
Configuration conf)
|
static boolean |
FileUtil.copy(FileSystem srcFS,
Path src,
File dst,
boolean deleteSource,
Configuration conf)
Copy FileSystem files to local files. |
static boolean |
FileUtil.copy(FileSystem srcFS,
Path src,
FileSystem dstFS,
Path dst,
boolean deleteSource,
boolean overwrite,
Configuration conf)
Copy files between FileSystems. |
static boolean |
FileUtil.copy(FileSystem srcFS,
Path src,
FileSystem dstFS,
Path dst,
boolean deleteSource,
Configuration conf)
Copy files between FileSystems. |
boolean |
FileContext.Util.copy(Path src,
Path dst)
Copy file from src to dest. |
boolean |
FileContext.Util.copy(Path src,
Path dst,
boolean deleteSource,
boolean overwrite)
Copy from src to dst, optionally deleting src and overwriting dst. |
void |
FilterFileSystem.copyFromLocalFile(boolean delSrc,
boolean overwrite,
Path[] srcs,
Path dst)
The src files are on the local disk. |
void |
FilterFileSystem.copyFromLocalFile(boolean delSrc,
boolean overwrite,
Path[] srcs,
Path dst)
The src files are on the local disk. |
void |
FileSystem.copyFromLocalFile(boolean delSrc,
boolean overwrite,
Path[] srcs,
Path dst)
The src files are on the local disk. |
void |
FileSystem.copyFromLocalFile(boolean delSrc,
boolean overwrite,
Path[] srcs,
Path dst)
The src files are on the local disk. |
void |
FilterFileSystem.copyFromLocalFile(boolean delSrc,
boolean overwrite,
Path src,
Path dst)
The src file is on the local disk. |
void |
FileSystem.copyFromLocalFile(boolean delSrc,
boolean overwrite,
Path src,
Path dst)
The src file is on the local disk. |
void |
ChecksumFileSystem.copyFromLocalFile(boolean delSrc,
Path src,
Path dst)
|
void |
FilterFileSystem.copyFromLocalFile(boolean delSrc,
Path src,
Path dst)
The src file is on the local disk. |
void |
FileSystem.copyFromLocalFile(boolean delSrc,
Path src,
Path dst)
The src file is on the local disk. |
void |
LocalFileSystem.copyFromLocalFile(boolean delSrc,
Path src,
Path dst)
|
void |
FileSystem.copyFromLocalFile(Path src,
Path dst)
The src file is on the local disk. |
static boolean |
FileUtil.copyMerge(FileSystem srcFS,
Path srcDir,
FileSystem dstFS,
Path dstFile,
boolean deleteSource,
Configuration conf,
String addString)
Copy all files in a directory to one output file (merge). |
void |
ChecksumFileSystem.copyToLocalFile(boolean delSrc,
Path src,
Path dst)
The src file is under FS, and the dst is on the local disk. |
void |
FilterFileSystem.copyToLocalFile(boolean delSrc,
Path src,
Path dst)
The src file is under FS, and the dst is on the local disk. |
void |
FileSystem.copyToLocalFile(boolean delSrc,
Path src,
Path dst)
The src file is under FS, and the dst is on the local disk. |
void |
LocalFileSystem.copyToLocalFile(boolean delSrc,
Path src,
Path dst)
|
void |
FileSystem.copyToLocalFile(Path src,
Path dst)
The src file is under FS, and the dst is on the local disk. |
void |
ChecksumFileSystem.copyToLocalFile(Path src,
Path dst,
boolean copyCrc)
The src file is under FS, and the dst is on the local disk. |
static FSDataOutputStream |
FileSystem.create(FileSystem fs,
Path file,
FsPermission permission)
create a file with the provided permission The permission of the file is set to be the provided permission as in setPermission, not permission&~umask It is implemented using two RPCs. |
FSDataOutputStream |
FileSystem.create(Path f)
Opens an FSDataOutputStream at the indicated Path. |
FSDataOutputStream |
FileSystem.create(Path f,
boolean overwrite)
Opens an FSDataOutputStream at the indicated Path. |
FSDataOutputStream |
FileSystem.create(Path f,
boolean overwrite,
int bufferSize)
Opens an FSDataOutputStream at the indicated Path. |
FSDataOutputStream |
FileSystem.create(Path f,
boolean overwrite,
int bufferSize,
Progressable progress)
Opens an FSDataOutputStream at the indicated Path with write-progress reporting. |
FSDataOutputStream |
FileSystem.create(Path f,
boolean overwrite,
int bufferSize,
short replication,
long blockSize)
Opens an FSDataOutputStream at the indicated Path. |
FSDataOutputStream |
RawLocalFileSystem.create(Path f,
boolean overwrite,
int bufferSize,
short replication,
long blockSize,
Progressable progress)
Opens an FSDataOutputStream at the indicated Path with write-progress reporting. |
FSDataOutputStream |
FileSystem.create(Path f,
boolean overwrite,
int bufferSize,
short replication,
long blockSize,
Progressable progress)
Opens an FSDataOutputStream at the indicated Path with write-progress reporting. |
FSDataOutputStream |
FileContext.create(Path f,
EnumSet<CreateFlag> createFlag,
Options.CreateOpts... opts)
Create or overwrite file on indicated path and returns an output stream for writing into the file. |
protected FSDataOutputStream |
AbstractFileSystem.create(Path f,
EnumSet<CreateFlag> createFlag,
Options.CreateOpts... opts)
The specification of this method matches that of FileContext.create(Path, EnumSet, Options.CreateOpts...) except
that the Path f must be fully qualified and the permission is absolute
(i.e. |
FSDataOutputStream |
RawLocalFileSystem.create(Path f,
FsPermission permission,
boolean overwrite,
int bufferSize,
short replication,
long blockSize,
Progressable progress)
Opens an FSDataOutputStream at the indicated Path with write-progress reporting. |
FSDataOutputStream |
ChecksumFileSystem.create(Path f,
FsPermission permission,
boolean overwrite,
int bufferSize,
short replication,
long blockSize,
Progressable progress)
Opens an FSDataOutputStream at the indicated Path with write-progress reporting. |
FSDataOutputStream |
FilterFileSystem.create(Path f,
FsPermission permission,
boolean overwrite,
int bufferSize,
short replication,
long blockSize,
Progressable progress)
Opens an FSDataOutputStream at the indicated Path with write-progress reporting. |
abstract FSDataOutputStream |
FileSystem.create(Path f,
FsPermission permission,
boolean overwrite,
int bufferSize,
short replication,
long blockSize,
Progressable progress)
Opens an FSDataOutputStream at the indicated Path with write-progress reporting. |
FSDataOutputStream |
FileSystem.create(Path f,
Progressable progress)
Create an FSDataOutputStream at the indicated Path with write-progress reporting. |
FSDataOutputStream |
FileSystem.create(Path f,
short replication)
Opens an FSDataOutputStream at the indicated Path. |
FSDataOutputStream |
FileSystem.create(Path f,
short replication,
Progressable progress)
Opens an FSDataOutputStream at the indicated Path with write-progress reporting. |
protected abstract FSDataOutputStream |
AbstractFileSystem.createInternal(Path f,
EnumSet<CreateFlag> flag,
FsPermission absolutePermission,
int bufferSize,
short replication,
long blockSize,
Progressable progress,
int bytesPerChecksum,
boolean createParent)
The specification of this method matches that of AbstractFileSystem.create(Path, EnumSet, Options.CreateOpts...) except that the opts
have been declared explicitly. |
boolean |
FileSystem.createNewFile(Path f)
Creates the given Path as a brand-new zero-length file. |
void |
FileContext.createSymlink(Path target,
Path link,
boolean createParent)
Creates a symbolic link to an existing file. |
protected void |
AbstractFileSystem.createSymlink(Path target,
Path link,
boolean createParent)
The specification of this method matches that of FileContext.createSymlink(Path, Path, boolean) ; |
boolean |
FileSystem.delete(Path f)
Deprecated. Use FileSystem.delete(Path, boolean) instead. |
boolean |
RawLocalFileSystem.delete(Path p,
boolean recursive)
|
boolean |
FileContext.delete(Path f,
boolean recursive)
Delete a file. |
boolean |
ChecksumFileSystem.delete(Path f,
boolean recursive)
Implement the delete(Path, boolean) in checksum file system. |
boolean |
FilterFileSystem.delete(Path f,
boolean recursive)
Delete a file |
abstract boolean |
FileSystem.delete(Path f,
boolean recursive)
Delete a file. |
protected abstract boolean |
AbstractFileSystem.delete(Path f,
boolean recursive)
The specification of this method matches that of FileContext.delete(Path, boolean) except that Path f must be for
this file system. |
boolean |
FileContext.deleteOnExit(Path f)
Mark a path to be deleted on JVM shutdown. |
boolean |
FilterFileSystem.deleteOnExit(Path f)
Mark a path to be deleted when FileSystem is closed. |
boolean |
FileSystem.deleteOnExit(Path f)
Mark a path to be deleted when FileSystem is closed. |
boolean |
FileContext.Util.exists(Path f)
Does the file exist? Note: Avoid using this method if you already have FileStatus in hand. |
boolean |
FileSystem.exists(Path f)
Check if exists. |
static void |
FileUtil.fullyDelete(FileSystem fs,
Path dir)
Deprecated. Use FileSystem.delete(Path, boolean) |
long |
FileSystem.getBlockSize(Path f)
Deprecated. Use getFileStatus() instead |
Path |
ChecksumFileSystem.getChecksumFile(Path file)
Return the name of the checksum file associated with a file. |
long |
ChecksumFileSystem.getChecksumFileLength(Path file,
long fileSize)
Return the length of the checksum file given the size of the actual file. |
ContentSummary |
FileContext.Util.getContentSummary(Path f)
Return the ContentSummary of path f. |
ContentSummary |
FileSystem.getContentSummary(Path f)
Return the ContentSummary of a given Path . |
BlockLocation[] |
FileContext.getFileBlockLocations(Path f,
long start,
long len)
Return blockLocation of the given file for the given offset and len. |
BlockLocation[] |
FileSystem.getFileBlockLocations(Path p,
long start,
long len)
Return an array containing hostnames, offset and size of portions of the given file. |
protected abstract BlockLocation[] |
AbstractFileSystem.getFileBlockLocations(Path f,
long start,
long len)
The specification of this method matches that of FileContext.getFileBlockLocations(Path, long, long) except that
Path f must be for this file system. |
FileChecksum |
FileContext.getFileChecksum(Path f)
Get the checksum of a file. |
FileChecksum |
FilterFileSystem.getFileChecksum(Path f)
Get the checksum of a file. |
FileChecksum |
FileSystem.getFileChecksum(Path f)
Get the checksum of a file. |
protected abstract FileChecksum |
AbstractFileSystem.getFileChecksum(Path f)
The specification of this method matches that of FileContext.getFileChecksum(Path) except that Path f must be for
this file system. |
FileStatus |
FileContext.getFileLinkStatus(Path f)
Return a file status object that represents the path. |
protected FileStatus |
AbstractFileSystem.getFileLinkStatus(Path f)
The specification of this method matches that of FileContext.getFileLinkStatus(Path)
except that an UnresolvedLinkException may be thrown if a symlink is
encountered in the path leading up to the final path component. |
FileStatus |
RawLocalFileSystem.getFileStatus(Path f)
|
FileStatus |
FileContext.getFileStatus(Path f)
Return a file status object that represents the path. |
FileStatus |
FilterFileSystem.getFileStatus(Path f)
Get file status. |
abstract FileStatus |
FileSystem.getFileStatus(Path f)
Return a file status object that represents the path. |
protected abstract FileStatus |
AbstractFileSystem.getFileStatus(Path f)
The specification of this method matches that of FileContext.getFileStatus(Path)
except that an UnresolvedLinkException may be thrown if a symlink is
encountered in the path. |
FsStatus |
FileContext.getFsStatus(Path f)
Returns a status object describing the use and capacity of the file system denoted by the Parh argument p. |
protected FsStatus |
AbstractFileSystem.getFsStatus(Path f)
The specification of this method matches that of FileContext.getFsStatus(Path) except that Path f must be for this
file system. |
long |
FileSystem.getLength(Path f)
Deprecated. Use getFileStatus() instead |
Path |
FileContext.getLinkTarget(Path f)
Returns the un-interpreted target of the given symbolic link. |
protected Path |
AbstractFileSystem.getLinkTarget(Path f)
The specification of this method matches that of FileContext.getLinkTarget(Path) ; |
short |
FileSystem.getReplication(Path src)
Deprecated. Use getFileStatus() instead |
FsStatus |
RawLocalFileSystem.getStatus(Path p)
Returns a status object describing the use and capacity of the file system. |
FsStatus |
FilterFileSystem.getStatus(Path p)
Returns a status object describing the use and capacity of the file system. |
FsStatus |
FileSystem.getStatus(Path p)
Returns a status object describing the use and capacity of the file system. |
protected String |
AbstractFileSystem.getUriPath(Path p)
Get the path-part of a pathname. |
FileStatus[] |
FileContext.Util.globStatus(Path pathPattern)
Return all the files that match filePattern and are not checksum files. |
FileStatus[] |
FileSystem.globStatus(Path pathPattern)
Return all the files that match filePattern and are not checksum files. |
FileStatus[] |
FileContext.Util.globStatus(Path pathPattern,
PathFilter filter)
Return an array of FileStatus objects whose path names match pathPattern and is accepted by the user-supplied path filter. |
FileStatus[] |
FileSystem.globStatus(Path pathPattern,
PathFilter filter)
Return an array of FileStatus objects whose path names match pathPattern and is accepted by the user-supplied path filter. |
static boolean |
ChecksumFileSystem.isChecksumFile(Path file)
Return true iff file is a checksum file name. |
boolean |
FileSystem.isDirectory(Path f)
True iff the named path is a directory. |
boolean |
FileSystem.isFile(Path f)
True iff the named path is a regular file. |
FileStatus[] |
RawLocalFileSystem.listStatus(Path f)
|
Iterator<FileStatus> |
FileContext.listStatus(Path f)
List the statuses of the files/directories in the given path if the path is a directory. |
FileStatus[] |
FileContext.Util.listStatus(Path f)
List the statuses of the files/directories in the given path if the path is a directory. |
FileStatus[] |
ChecksumFileSystem.listStatus(Path f)
List the statuses of the files/directories in the given path if the path is a directory. |
FileStatus[] |
FilterFileSystem.listStatus(Path f)
List files in a directory. |
abstract FileStatus[] |
FileSystem.listStatus(Path f)
List the statuses of the files/directories in the given path if the path is a directory. |
protected abstract FileStatus[] |
AbstractFileSystem.listStatus(Path f)
The specification of this method matches that of FileContext.Util.listStatus(Path) except that Path f must be
for this file system. |
FileStatus[] |
FileContext.Util.listStatus(Path[] files)
See FileContext.Util.listStatus(Path[], PathFilter) |
FileStatus[] |
FileSystem.listStatus(Path[] files)
Filter files/directories in the given list of paths using default path filter. |
FileStatus[] |
FileContext.Util.listStatus(Path[] files,
PathFilter filter)
Filter files/directories in the given list of paths using user-supplied path filter. |
FileStatus[] |
FileSystem.listStatus(Path[] files,
PathFilter filter)
Filter files/directories in the given list of paths using user-supplied path filter. |
FileStatus[] |
FileContext.Util.listStatus(Path f,
PathFilter filter)
Filter files/directories in the given path using the user-supplied path filter. |
FileStatus[] |
FileSystem.listStatus(Path f,
PathFilter filter)
Filter files/directories in the given path using the user-supplied path filter. |
protected Iterator<FileStatus> |
AbstractFileSystem.listStatusIterator(Path f)
The specification of this method matches that of FileContext.listStatus(Path) except that Path f must be for this
file system. |
Path |
FileContext.makeQualified(Path path)
Make the path fully qualified if it is isn't. |
Path |
FilterFileSystem.makeQualified(Path path)
Make sure that a path specifies a FileSystem. |
Path |
FileSystem.makeQualified(Path path)
Make sure that a path specifies a FileSystem. |
Path |
Path.makeQualified(URI defaultUri,
Path workingDir)
Returns a qualified path object. |
void |
FileContext.mkdir(Path dir,
FsPermission permission,
boolean createParent)
Make(create) a directory and all the non-existent parents. |
protected abstract void |
AbstractFileSystem.mkdir(Path dir,
FsPermission permission,
boolean createParent)
The specification of this method matches that of FileContext.mkdir(Path, FsPermission, boolean) except that the Path
f must be fully qualified and the permission is absolute (i.e. |
static boolean |
FileSystem.mkdirs(FileSystem fs,
Path dir,
FsPermission permission)
create a directory with the provided permission The permission of the directory is set to be the provided permission as in setPermission, not permission&~umask |
boolean |
RawLocalFileSystem.mkdirs(Path f)
Creates the specified directory hierarchy. |
boolean |
ChecksumFileSystem.mkdirs(Path f)
|
boolean |
FileSystem.mkdirs(Path f)
Call FileSystem.mkdirs(Path, FsPermission) with default permission. |
boolean |
RawLocalFileSystem.mkdirs(Path f,
FsPermission permission)
Make the given file and all non-existent parents into directories. |
boolean |
FilterFileSystem.mkdirs(Path f,
FsPermission permission)
Make the given file and all non-existent parents into directories. |
abstract boolean |
FileSystem.mkdirs(Path f,
FsPermission permission)
Make the given file and all non-existent parents into directories. |
void |
FileSystem.moveFromLocalFile(Path[] srcs,
Path dst)
The src files is on the local disk. |
void |
FileSystem.moveFromLocalFile(Path[] srcs,
Path dst)
The src files is on the local disk. |
void |
RawLocalFileSystem.moveFromLocalFile(Path src,
Path dst)
|
void |
FileSystem.moveFromLocalFile(Path src,
Path dst)
The src file is on the local disk. |
void |
FileSystem.moveToLocalFile(Path src,
Path dst)
The src file is under FS, and the dst is on the local disk. |
boolean |
Trash.moveToTrash(Path path)
Move a file or directory to the current trash directory. |
abstract T |
FileContext.FSLinkResolver.next(AbstractFileSystem fs,
Path p)
Generic helper function overridden on instantiation to perform a specific operation on the given file system using the given path which may result in an UnresolvedLinkException. |
FSDataInputStream |
FileContext.open(Path f)
Opens an FSDataInputStream at the indicated Path using default buffersize. |
FSDataInputStream |
FileSystem.open(Path f)
Opens an FSDataInputStream at the indicated Path. |
protected FSDataInputStream |
AbstractFileSystem.open(Path f)
The specification of this method matches that of FileContext.open(Path) except that Path f must be for this
file system. |
FSDataInputStream |
RawLocalFileSystem.open(Path f,
int bufferSize)
|
FSDataInputStream |
FileContext.open(Path f,
int bufferSize)
Opens an FSDataInputStream at the indicated Path. |
FSDataInputStream |
ChecksumFileSystem.open(Path f,
int bufferSize)
Opens an FSDataInputStream at the indicated Path. |
FSDataInputStream |
FilterFileSystem.open(Path f,
int bufferSize)
Opens an FSDataInputStream at the indicated Path. |
abstract FSDataInputStream |
FileSystem.open(Path f,
int bufferSize)
Opens an FSDataInputStream at the indicated Path. |
protected abstract FSDataInputStream |
AbstractFileSystem.open(Path f,
int bufferSize)
The specification of this method matches that of FileContext.open(Path, int) except that Path f must be for this
file system. |
File |
RawLocalFileSystem.pathToFile(Path path)
Convert a path to a File. |
File |
LocalFileSystem.pathToFile(Path path)
Convert a path to a File. |
protected FSDataOutputStream |
RawLocalFileSystem.primitiveCreate(Path f,
FsPermission absolutePermission,
EnumSet<CreateFlag> flag,
int bufferSize,
short replication,
long blockSize,
Progressable progress,
int bytesPerChecksum)
|
protected FSDataOutputStream |
FilterFileSystem.primitiveCreate(Path f,
FsPermission absolutePermission,
EnumSet<CreateFlag> flag,
int bufferSize,
short replication,
long blockSize,
Progressable progress,
int bytesPerChecksum)
|
protected FSDataOutputStream |
FileSystem.primitiveCreate(Path f,
FsPermission absolutePermission,
EnumSet<CreateFlag> flag,
int bufferSize,
short replication,
long blockSize,
Progressable progress,
int bytesPerChecksum)
Deprecated. |
protected boolean |
RawLocalFileSystem.primitiveMkdir(Path f,
FsPermission absolutePermission)
|
protected boolean |
FilterFileSystem.primitiveMkdir(Path f,
FsPermission abdolutePermission)
|
protected boolean |
FileSystem.primitiveMkdir(Path f,
FsPermission absolutePermission)
Deprecated. |
protected void |
FileSystem.primitiveMkdir(Path f,
FsPermission absolutePermission,
boolean createParent)
Deprecated. |
boolean |
RawLocalFileSystem.rename(Path src,
Path dst)
|
boolean |
ChecksumFileSystem.rename(Path src,
Path dst)
Rename files/dirs |
boolean |
FilterFileSystem.rename(Path src,
Path dst)
Renames Path src to Path dst. |
abstract boolean |
FileSystem.rename(Path src,
Path dst)
Renames Path src to Path dst. |
void |
FileContext.rename(Path src,
Path dst,
Options.Rename... options)
Renames Path src to Path dst |
protected void |
FileSystem.rename(Path src,
Path dst,
Options.Rename... options)
Deprecated. |
protected void |
AbstractFileSystem.rename(Path src,
Path dst,
Options.Rename... options)
The specification of this method matches that of FileContext.rename(Path, Path, Options.Rename...) except that Path
f must be for this file system. |
protected abstract void |
AbstractFileSystem.renameInternal(Path src,
Path dst)
The specification of this method matches that of FileContext.rename(Path, Path, Options.Rename...) except that Path
f must be for this file system and NO OVERWRITE is performed. |
protected void |
AbstractFileSystem.renameInternal(Path src,
Path dst,
boolean overwrite)
The specification of this method matches that of FileContext.rename(Path, Path, Options.Rename...) except that Path
f must be for this file system. |
boolean |
ChecksumFileSystem.reportChecksumFailure(Path f,
FSDataInputStream in,
long inPos,
FSDataInputStream sums,
long sumsPos)
Report a checksum error to the file system. |
boolean |
LocalFileSystem.reportChecksumFailure(Path p,
FSDataInputStream in,
long inPos,
FSDataInputStream sums,
long sumsPos)
Moves files to a bad file directory on the same device, so that their storage will not be reused. |
T |
FileContext.FSLinkResolver.resolve(FileContext fc,
Path p)
Performs the operation specified by the next function, calling it repeatedly until all symlinks in the given path are resolved. |
protected Path |
FileContext.resolve(Path f)
Resolves all symbolic links in the specified path. |
protected Path |
FileContext.resolveIntermediate(Path f)
Resolves all symbolic links in the specified path leading up to, but not including the final path component. |
void |
RawLocalFileSystem.setOwner(Path p,
String username,
String groupname)
Use the command chown to set owner. |
void |
FileContext.setOwner(Path f,
String username,
String groupname)
Set owner of a path (i.e. |
void |
FilterFileSystem.setOwner(Path p,
String username,
String groupname)
Set owner of a path (i.e. |
void |
FileSystem.setOwner(Path p,
String username,
String groupname)
Set owner of a path (i.e. |
protected abstract void |
AbstractFileSystem.setOwner(Path f,
String username,
String groupname)
The specification of this method matches that of FileContext.setOwner(Path, String, String) except that Path f must
be for this file system. |
void |
FileStatus.setPath(Path p)
|
void |
RawLocalFileSystem.setPermission(Path p,
FsPermission permission)
Use the command chmod to set permission. |
void |
FileContext.setPermission(Path f,
FsPermission permission)
Set permission of a path. |
void |
FilterFileSystem.setPermission(Path p,
FsPermission permission)
Set permission of a path. |
void |
FileSystem.setPermission(Path p,
FsPermission permission)
Set permission of a path. |
protected abstract void |
AbstractFileSystem.setPermission(Path f,
FsPermission permission)
The specification of this method matches that of FileContext.setPermission(Path, FsPermission) except that Path f
must be for this file system. |
boolean |
FileContext.setReplication(Path f,
short replication)
Set replication for an existing file. |
boolean |
ChecksumFileSystem.setReplication(Path src,
short replication)
Set replication for an existing file. |
boolean |
FilterFileSystem.setReplication(Path src,
short replication)
Set replication for an existing file. |
boolean |
FileSystem.setReplication(Path src,
short replication)
Set replication for an existing file. |
protected abstract boolean |
AbstractFileSystem.setReplication(Path f,
short replication)
The specification of this method matches that of FileContext.setReplication(Path, short) except that Path f must be
for this file system. |
void |
FileStatus.setSymlink(Path p)
|
void |
FileContext.setTimes(Path f,
long mtime,
long atime)
Set access time of a file. |
void |
FilterFileSystem.setTimes(Path p,
long mtime,
long atime)
Set access time of a file |
void |
FileSystem.setTimes(Path p,
long mtime,
long atime)
Set access time of a file |
protected abstract void |
AbstractFileSystem.setTimes(Path f,
long mtime,
long atime)
The specification of this method matches that of FileContext.setTimes(Path, long, long) except that Path f must be
for this file system. |
void |
FileContext.setVerifyChecksum(boolean verifyChecksum,
Path f)
Set the verify checksum flag for the file system denoted by the path. |
void |
RawLocalFileSystem.setWorkingDirectory(Path newDir)
Set the working directory to the given directory. |
void |
FileContext.setWorkingDirectory(Path newWDir)
Set the working directory for wd-relative names (such a "foo/bar"). |
void |
FilterFileSystem.setWorkingDirectory(Path newDir)
Set the current working directory for the given file system. |
abstract void |
FileSystem.setWorkingDirectory(Path new_dir)
Set the current working directory for the given file system. |
Path |
RawLocalFileSystem.startLocalOutput(Path fsOutputFile,
Path tmpLocalFile)
|
Path |
ChecksumFileSystem.startLocalOutput(Path fsOutputFile,
Path tmpLocalFile)
|
Path |
FilterFileSystem.startLocalOutput(Path fsOutputFile,
Path tmpLocalFile)
Returns a local File that the user can write output to. |
Path |
FileSystem.startLocalOutput(Path fsOutputFile,
Path tmpLocalFile)
Returns a local File that the user can write output to. |
static Path[] |
FileUtil.stat2Paths(FileStatus[] stats,
Path path)
convert an array of FileStatus to an array of Path. |
Constructors in org.apache.hadoop.fs with parameters of type Path | |
---|---|
AvroFSInput(FileContext fc,
Path p)
Construct given a FileContext and a Path . |
|
FileStatus(long length,
boolean isdir,
int block_replication,
long blocksize,
long modification_time,
long access_time,
FsPermission permission,
String owner,
String group,
Path path)
Constructor for file systems on which symbolic links are not supported |
|
FileStatus(long length,
boolean isdir,
int block_replication,
long blocksize,
long modification_time,
long access_time,
FsPermission permission,
String owner,
String group,
Path symlink,
Path path)
|
|
FileStatus(long length,
boolean isdir,
int block_replication,
long blocksize,
long modification_time,
Path path)
|
|
Path(Path parent,
Path child)
Resolve a child path against a parent path. |
|
Path(Path parent,
String child)
Resolve a child path against a parent path. |
|
Path(String parent,
Path child)
Resolve a child path against a parent path. |
Uses of Path in org.apache.hadoop.fs.ftp |
---|
Methods in org.apache.hadoop.fs.ftp that return Path | |
---|---|
Path |
FTPFileSystem.getHomeDirectory()
|
Path |
FTPFileSystem.getWorkingDirectory()
|
Methods in org.apache.hadoop.fs.ftp with parameters of type Path | |
---|---|
FSDataOutputStream |
FTPFileSystem.append(Path f,
int bufferSize,
Progressable progress)
This optional operation is not yet supported. |
FSDataOutputStream |
FTPFileSystem.create(Path file,
FsPermission permission,
boolean overwrite,
int bufferSize,
short replication,
long blockSize,
Progressable progress)
A stream obtained via this call must be closed before using other APIs of this class or else the invocation will block. |
boolean |
FTPFileSystem.delete(Path file,
boolean recursive)
|
FileStatus |
FTPFileSystem.getFileStatus(Path file)
|
FileStatus[] |
FTPFileSystem.listStatus(Path file)
|
boolean |
FTPFileSystem.mkdirs(Path file,
FsPermission permission)
|
FSDataInputStream |
FTPFileSystem.open(Path file,
int bufferSize)
|
boolean |
FTPFileSystem.rename(Path src,
Path dst)
|
void |
FTPFileSystem.setWorkingDirectory(Path newDir)
|
Uses of Path in org.apache.hadoop.fs.kfs |
---|
Methods in org.apache.hadoop.fs.kfs that return Path | |
---|---|
Path |
KosmosFileSystem.getWorkingDirectory()
|
Path |
KosmosFileSystem.startLocalOutput(Path fsOutputFile,
Path tmpLocalFile)
|
Methods in org.apache.hadoop.fs.kfs with parameters of type Path | |
---|---|
FSDataOutputStream |
KosmosFileSystem.append(Path f,
int bufferSize,
Progressable progress)
|
void |
KosmosFileSystem.completeLocalOutput(Path fsOutputFile,
Path tmpLocalFile)
|
void |
KosmosFileSystem.copyFromLocalFile(boolean delSrc,
Path src,
Path dst)
|
void |
KosmosFileSystem.copyToLocalFile(boolean delSrc,
Path src,
Path dst)
|
FSDataOutputStream |
KosmosFileSystem.create(Path file,
FsPermission permission,
boolean overwrite,
int bufferSize,
short replication,
long blockSize,
Progressable progress)
|
boolean |
KosmosFileSystem.delete(Path path,
boolean recursive)
|
FileStatus |
KosmosFileSystem.getFileStatus(Path path)
|
boolean |
KosmosFileSystem.isDirectory(Path path)
|
boolean |
KosmosFileSystem.isFile(Path path)
|
FileStatus[] |
KosmosFileSystem.listStatus(Path path)
|
void |
KosmosFileSystem.lock(Path path,
boolean shared)
Deprecated. |
boolean |
KosmosFileSystem.mkdirs(Path path,
FsPermission permission)
|
FSDataInputStream |
KosmosFileSystem.open(Path path,
int bufferSize)
|
void |
KosmosFileSystem.release(Path path)
Deprecated. |
boolean |
KosmosFileSystem.rename(Path src,
Path dst)
|
boolean |
KosmosFileSystem.setReplication(Path path,
short replication)
|
void |
KosmosFileSystem.setWorkingDirectory(Path dir)
|
Path |
KosmosFileSystem.startLocalOutput(Path fsOutputFile,
Path tmpLocalFile)
|
Uses of Path in org.apache.hadoop.fs.s3 |
---|
Methods in org.apache.hadoop.fs.s3 that return Path | |
---|---|
Path |
S3FileSystem.getWorkingDirectory()
|
Methods in org.apache.hadoop.fs.s3 with parameters of type Path | |
---|---|
FSDataOutputStream |
S3FileSystem.append(Path f,
int bufferSize,
Progressable progress)
This optional operation is not yet supported. |
FSDataOutputStream |
S3FileSystem.create(Path file,
FsPermission permission,
boolean overwrite,
int bufferSize,
short replication,
long blockSize,
Progressable progress)
|
boolean |
S3FileSystem.delete(Path path,
boolean recursive)
|
FileStatus |
S3FileSystem.getFileStatus(Path f)
FileStatus for S3 file systems. |
boolean |
S3FileSystem.isFile(Path path)
|
FileStatus[] |
S3FileSystem.listStatus(Path f)
|
boolean |
S3FileSystem.mkdirs(Path path,
FsPermission permission)
|
FSDataInputStream |
S3FileSystem.open(Path path,
int bufferSize)
|
boolean |
S3FileSystem.rename(Path src,
Path dst)
|
void |
S3FileSystem.setWorkingDirectory(Path dir)
|
Uses of Path in org.apache.hadoop.fs.s3native |
---|
Methods in org.apache.hadoop.fs.s3native that return Path | |
---|---|
Path |
NativeS3FileSystem.getWorkingDirectory()
|
Methods in org.apache.hadoop.fs.s3native with parameters of type Path | |
---|---|
FSDataOutputStream |
NativeS3FileSystem.append(Path f,
int bufferSize,
Progressable progress)
This optional operation is not yet supported. |
FSDataOutputStream |
NativeS3FileSystem.create(Path f,
FsPermission permission,
boolean overwrite,
int bufferSize,
short replication,
long blockSize,
Progressable progress)
|
boolean |
NativeS3FileSystem.delete(Path f,
boolean recurse)
|
FileStatus |
NativeS3FileSystem.getFileStatus(Path f)
|
FileStatus[] |
NativeS3FileSystem.listStatus(Path f)
If f is a file, this method will make a single call to S3. |
boolean |
NativeS3FileSystem.mkdirs(Path f,
FsPermission permission)
|
FSDataInputStream |
NativeS3FileSystem.open(Path f,
int bufferSize)
|
boolean |
NativeS3FileSystem.rename(Path src,
Path dst)
|
void |
NativeS3FileSystem.setWorkingDirectory(Path newDir)
Set the working directory to the given directory. |
Uses of Path in org.apache.hadoop.fs.shell |
---|
Methods in org.apache.hadoop.fs.shell with parameters of type Path | |
---|---|
protected void |
Count.run(Path path)
|
protected abstract void |
Command.run(Path path)
Execute the command on the input path |
Uses of Path in org.apache.hadoop.io |
---|
Methods in org.apache.hadoop.io with parameters of type Path | |
---|---|
SequenceFile.Writer |
SequenceFile.Sorter.cloneFileAttributes(Path inputFile,
Path outputFile,
Progressable prog)
Clones the attributes (like compression of the input file and creates a corresponding Writer |
protected SequenceFile.Reader |
MapFile.Reader.createDataFileReader(FileSystem fs,
Path dataFile,
Configuration conf)
Override this method to specialize the type of SequenceFile.Reader returned. |
static SequenceFile.Writer |
SequenceFile.createWriter(FileSystem fs,
Configuration conf,
Path name,
Class keyClass,
Class valClass)
Construct the preferred type of SequenceFile Writer. |
static SequenceFile.Writer |
SequenceFile.createWriter(FileSystem fs,
Configuration conf,
Path name,
Class keyClass,
Class valClass,
int bufferSize,
short replication,
long blockSize,
SequenceFile.CompressionType compressionType,
CompressionCodec codec,
Progressable progress,
SequenceFile.Metadata metadata)
Construct the preferred type of SequenceFile Writer. |
static SequenceFile.Writer |
SequenceFile.createWriter(FileSystem fs,
Configuration conf,
Path name,
Class keyClass,
Class valClass,
SequenceFile.CompressionType compressionType)
Construct the preferred type of SequenceFile Writer. |
static SequenceFile.Writer |
SequenceFile.createWriter(FileSystem fs,
Configuration conf,
Path name,
Class keyClass,
Class valClass,
SequenceFile.CompressionType compressionType,
CompressionCodec codec)
Construct the preferred type of SequenceFile Writer. |
static SequenceFile.Writer |
SequenceFile.createWriter(FileSystem fs,
Configuration conf,
Path name,
Class keyClass,
Class valClass,
SequenceFile.CompressionType compressionType,
CompressionCodec codec,
Progressable progress)
Construct the preferred type of SequenceFile Writer. |
static SequenceFile.Writer |
SequenceFile.createWriter(FileSystem fs,
Configuration conf,
Path name,
Class keyClass,
Class valClass,
SequenceFile.CompressionType compressionType,
CompressionCodec codec,
Progressable progress,
SequenceFile.Metadata metadata)
Construct the preferred type of SequenceFile Writer. |
static SequenceFile.Writer |
SequenceFile.createWriter(FileSystem fs,
Configuration conf,
Path name,
Class keyClass,
Class valClass,
SequenceFile.CompressionType compressionType,
Progressable progress)
Construct the preferred type of SequenceFile Writer. |
static long |
MapFile.fix(FileSystem fs,
Path dir,
Class<? extends Writable> keyClass,
Class<? extends Writable> valueClass,
boolean dryrun,
Configuration conf)
This method attempts to fix a corrupt MapFile by re-creating its index. |
SequenceFile.Sorter.RawKeyValueIterator |
SequenceFile.Sorter.merge(List<SequenceFile.Sorter.SegmentDescriptor> segments,
Path tmpDir)
Merges the list of segments of type SegmentDescriptor |
SequenceFile.Sorter.RawKeyValueIterator |
SequenceFile.Sorter.merge(Path[] inNames,
boolean deleteInputs,
int factor,
Path tmpDir)
Merges the contents of files passed in Path[] |
SequenceFile.Sorter.RawKeyValueIterator |
SequenceFile.Sorter.merge(Path[] inNames,
boolean deleteInputs,
int factor,
Path tmpDir)
Merges the contents of files passed in Path[] |
SequenceFile.Sorter.RawKeyValueIterator |
SequenceFile.Sorter.merge(Path[] inNames,
boolean deleteInputs,
Path tmpDir)
Merges the contents of files passed in Path[] using a max factor value that is already set |
SequenceFile.Sorter.RawKeyValueIterator |
SequenceFile.Sorter.merge(Path[] inNames,
boolean deleteInputs,
Path tmpDir)
Merges the contents of files passed in Path[] using a max factor value that is already set |
void |
SequenceFile.Sorter.merge(Path[] inFiles,
Path outFile)
Merge the provided files. |
void |
SequenceFile.Sorter.merge(Path[] inFiles,
Path outFile)
Merge the provided files. |
SequenceFile.Sorter.RawKeyValueIterator |
SequenceFile.Sorter.merge(Path[] inNames,
Path tempDir,
boolean deleteInputs)
Merges the contents of files passed in Path[] |
SequenceFile.Sorter.RawKeyValueIterator |
SequenceFile.Sorter.merge(Path[] inNames,
Path tempDir,
boolean deleteInputs)
Merges the contents of files passed in Path[] |
protected FSDataInputStream |
SequenceFile.Reader.openFile(FileSystem fs,
Path file,
int bufferSize,
long length)
Override this method to specialize the type of FSDataInputStream returned. |
void |
SequenceFile.Sorter.sort(Path[] inFiles,
Path outFile,
boolean deleteInput)
Perform a file sort from a set of input files into an output file. |
void |
SequenceFile.Sorter.sort(Path[] inFiles,
Path outFile,
boolean deleteInput)
Perform a file sort from a set of input files into an output file. |
void |
SequenceFile.Sorter.sort(Path inFile,
Path outFile)
The backwards compatible interface to sort. |
SequenceFile.Sorter.RawKeyValueIterator |
SequenceFile.Sorter.sortAndIterate(Path[] inFiles,
Path tempDir,
boolean deleteInput)
Perform a file sort from a set of input files and return an iterator. |
SequenceFile.Sorter.RawKeyValueIterator |
SequenceFile.Sorter.sortAndIterate(Path[] inFiles,
Path tempDir,
boolean deleteInput)
Perform a file sort from a set of input files and return an iterator. |
Constructors in org.apache.hadoop.io with parameters of type Path | |
---|---|
SequenceFile.Reader(FileSystem fs,
Path file,
Configuration conf)
Construct a reader by opening a file from the given file system. |
|
SequenceFile.Sorter.SegmentDescriptor(long segmentOffset,
long segmentLength,
Path segmentPathName)
Constructs a segment |
|
SequenceFile.Writer(FileSystem fs,
Configuration conf,
Path name,
Class keyClass,
Class valClass)
Create the named file. |
|
SequenceFile.Writer(FileSystem fs,
Configuration conf,
Path name,
Class keyClass,
Class valClass,
int bufferSize,
short replication,
long blockSize,
Progressable progress,
SequenceFile.Metadata metadata)
Create the named file with write-progress reporter. |
|
SequenceFile.Writer(FileSystem fs,
Configuration conf,
Path name,
Class keyClass,
Class valClass,
Progressable progress,
SequenceFile.Metadata metadata)
Create the named file with write-progress reporter. |
Uses of Path in org.apache.hadoop.io.compress |
---|
Methods in org.apache.hadoop.io.compress with parameters of type Path | |
---|---|
CompressionCodec |
CompressionCodecFactory.getCodec(Path file)
Find the relevant compression codec for the given file based on its filename suffix. |
|
||||||||||
PREV NEXT | FRAMES NO FRAMES |