Filesystem

From Just Solve the File Format Problem
(Difference between revisions)
Jump to: navigation, search
(Networked and cloud filesystems)
m
(46 intermediate revisions by 6 users not shown)
Line 4: Line 4:
 
|image=Office Supplies File Cabinet 02.png
 
|image=Office Supplies File Cabinet 02.png
 
}}
 
}}
 
+
'''Filesystems''' are [[Electronic_File_Formats|Electronic Formats]] that are a prerequisite to being able to read any [[file]] off a digital medium — you have to be able to mount the filesystem, and thus read it, in order to be able to read a file.
Filesystems are [[Electronic_File_Formats|Electronic Formats]] that are a prerequisite to being able to read any file off a digital medium — you have to be able to mount the filesystem, and thus read it, in order to be able to read a file.
+
  
 
== Single-system filesystems ==
 
== Single-system filesystems ==
(How files are organized on one system or device, such as a disk, tape, or flash memory; see next category for networked and cloud filesystems. Of course, any filesystem can be made available on a network to remote devices, but these are the native filesystems present on the storage device itself.)
+
(How files are organized on one system, device, or medium, such as a disk, tape, or flash memory; see next category for networked and cloud filesystems. Of course, any filesystem can be made available on a network to remote devices, but these are the native filesystems present on the storage device/medium itself.)
  
 
* [[+D filesystem]] (Sinclair, SAM Coupé)
 
* [[+D filesystem]] (Sinclair, SAM Coupé)
 
* [[Acer Fast Filesystem]] (SCO OpenServer)
 
* [[Acer Fast Filesystem]] (SCO OpenServer)
 
* [[ADFS]] (Acorn MOS, RISC OS)
 
* [[ADFS]] (Acorn MOS, RISC OS)
* [[AdvFS]](Advanced File System, Digital/Tru64 Unix)
+
* [[AdvFS]] (Advanced File System, Digital/Tru64 Unix)
* [[Ami File Safe]] (Amiga)
+
* [[AFS]] (Ami File Safe, Amiga)
 
* [[APF Imagination Machine disk file system]]
 
* [[APF Imagination Machine disk file system]]
 
* [[Apple DOS file system]] (Apple II; see also ProDOS below)
 
* [[Apple DOS file system]] (Apple II; see also ProDOS below)
 +
* [[Apple File System]] (APFS) (2017 system for Apple devices)
 
* [[Atari File Management Subsystem]] (FMS: Atari 400/800)
 
* [[Atari File Management Subsystem]] (FMS: Atari 400/800)
 
* [[AthFS]] (AtheOS/Syllable)
 
* [[AthFS]] (AtheOS/Syllable)
 +
* [[BetrFS]] [http://www.betrfs.org/]
 
* [[BFS]] (BeOS)
 
* [[BFS]] (BeOS)
* [[btrfs]] (Linux)
+
* [[Btrfs]] (Linux)
 
* [[CBMFS]] (Commodore 64, PET, etc.; 5.25" disks)
 
* [[CBMFS]] (Commodore 64, PET, etc.; 5.25" disks)
 
** [[Commodore 1581 filesystem]] (3.5" disks)
 
** [[Commodore 1581 filesystem]] (3.5" disks)
Line 28: Line 29:
 
* [[CP/M file system]]
 
* [[CP/M file system]]
 
* [[cramfs]]
 
* [[cramfs]]
 +
* [[Cromfs]] [https://bisqwit.iki.fi/source/cromfs.html]
 
* [[DDFS]] (Data Domain File System)
 
* [[DDFS]] (Data Domain File System)
 
* [[DTFS]] (Desktop File System, [[SCO OpenServer]])
 
* [[DTFS]] (Desktop File System, [[SCO OpenServer]])
 
* [[EFS]] (Extent File System, SGI IRIX. Replaced by [[XFS]])
 
* [[EFS]] (Extent File System, SGI IRIX. Replaced by [[XFS]])
 
* [[EOS file system]] (Coleco Adam "data pack" tape drives and disks)
 
* [[EOS file system]] (Coleco Adam "data pack" tape drives and disks)
* [[exFAT]] (Microsoft, for flash memory)
 
 
* [[ext]] (developed for Linux, previously used MINIX fs)
 
* [[ext]] (developed for Linux, previously used MINIX fs)
 
* [[ext2]], [[ext3]], [[ext4]] (these are all just variants of each other)
 
* [[ext2]], [[ext3]], [[ext4]] (these are all just variants of each other)
 
* [[F2FS]], (Flash Friendly Filesystem)
 
* [[F2FS]], (Flash Friendly Filesystem)
* [[FAT8]]
+
* [[FAT]]
* [[FAT12]]
+
** [[FAT8]]
* [[FAT16]]
+
** [[FAT12]]
* [[FAT32]]
+
** [[FAT16]]
 +
** [[FAT32]]
 +
** [[exFAT]] (Microsoft, for flash memory)
 
* [[FFS]] (Amiga Fast File System)
 
* [[FFS]] (Amiga Fast File System)
 
* [[Files-11]] (VMS)
 
* [[Files-11]] (VMS)
 +
* [[Firmware File System]]
 
* [[Fossil]] (Plan 9)
 
* [[Fossil]] (Plan 9)
* [[fuse-exFAT]] (open-source clone of exFAT)
 
 
* [[HAMMER]] (DragonflyBSD)
 
* [[HAMMER]] (DragonflyBSD)
 
* [[HFS]] (MacOS)
 
* [[HFS]] (MacOS)
Line 51: Line 54:
 
* [[JFFS2]]
 
* [[JFFS2]]
 
* [[LanyFS]] (Lanyard Filesystem)
 
* [[LanyFS]] (Lanyard Filesystem)
 +
* [[Linear Tape File System]] (LTFS)
 
* [[LogFS]]
 
* [[LogFS]]
 
* [[MDR (Floppy Disk)|MDR]] (audio instrument format close to MSDOS)
 
* [[MDR (Floppy Disk)|MDR]] (audio instrument format close to MSDOS)
Line 56: Line 60:
 
* [[MINIX file system]]
 
* [[MINIX file system]]
 
* [[NILFS2]]
 
* [[NILFS2]]
 +
* [[NOVA (filesystem)|NOVA]]
 
* [[NTFS]]
 
* [[NTFS]]
 +
* [[OFS]] (Amiga Old File System)
 +
* [[PFS]] (Professional File System, Amiga)
 
* [[POHMELFS]] (distributed Linux filesystem)
 
* [[POHMELFS]] (distributed Linux filesystem)
 
* [[PRAMFS]] (Persistent & Protected RAM File-System)
 
* [[PRAMFS]] (Persistent & Protected RAM File-System)
Line 65: Line 72:
 
** [[Reiser4]]
 
** [[Reiser4]]
 
* [[SDFS]] (Deduplication based filesystem)
 
* [[SDFS]] (Deduplication based filesystem)
 +
* [[securefs]] [https://github.com/netheril96/securefs]
 +
* [[SFS (Amiga)|SFS]] (Smart File System, Amiga)
 +
* [[Sinclair QL filesystem]]
 
* [[SkyFS]] (SkyOS)
 
* [[SkyFS]] (SkyOS)
* [[squashfs]]
+
* [[Squashfs]]
 +
* [[TFS]] [https://github.com/redox-os/tfs]
 +
* [[TR-DOS filesystem]] (ZX Spectrum)
 
* [[UCSD p-System Filesystem]] (UCSD Pascal)
 
* [[UCSD p-System Filesystem]] (UCSD Pascal)
* [[UDF]] (optical discs)
 
 
* [[UFS]] (Unix Files System, Solaris and BSD)
 
* [[UFS]] (Unix Files System, Solaris and BSD)
 
** [[UFS2]]
 
** [[UFS2]]
 +
* [[Universal Disk Format]] (UDF) (optical discs)
 
* [[VMUFAT]] (Filesystem for Dreamcast VMU units)
 
* [[VMUFAT]] (Filesystem for Dreamcast VMU units)
 
* [[VSAM]] (Virtual Storage Access Method)
 
* [[VSAM]] (Virtual Storage Access Method)
 
* [[VxFS]] (VERITAS File System)
 
* [[VxFS]] (VERITAS File System)
 
* [[WAFL]] (NetApp's commercial file system)
 
* [[WAFL]] (NetApp's commercial file system)
 +
* [[WBFS]]
 
* [[Xiafs]] (Linux, dropped in favour of ext2)
 
* [[Xiafs]] (Linux, dropped in favour of ext2)
 
* [[XFS]] (SGI)
 
* [[XFS]] (SGI)
Line 80: Line 93:
 
* [[YAFFS]]
 
* [[YAFFS]]
 
* [[ZFS]]
 
* [[ZFS]]
 +
* [[zisofs]]
  
 
== Networked and cloud filesystems ==
 
== Networked and cloud filesystems ==
Line 88: Line 102:
 
* [[Google Drive]]
 
* [[Google Drive]]
 
* [[Google File System]]
 
* [[Google File System]]
* [[Hadoop Distributed File System]]
+
* [[Hadoop Distributed File System]] (HDFS)
 +
* [[IPFS]]
 +
* [[Keybase filesystem]]
 
* [[Longaccess]]
 
* [[Longaccess]]
 
* [[MEGA file system]]
 
* [[MEGA file system]]
 
* [[NetWare File System]] (Novell NetWare, replaced by [[NSS]])
 
* [[NetWare File System]] (Novell NetWare, replaced by [[NSS]])
 +
* [[NFS]] (Unix network filesystem protocol)
 
* [[NSS]] (Novell Storage Services)
 
* [[NSS]] (Novell Storage Services)
 
* [[OneDrive]] (Microsoft)
 
* [[OneDrive]] (Microsoft)
 
* [[OpenStack Swift]]
 
* [[OpenStack Swift]]
 
* [[Permacoin]] (also a [[currency]])
 
* [[Permacoin]] (also a [[currency]])
 +
* [[SFS]] (SyncFS)
 
* [[SMB]] (Server Message Block, a protocol for a networked filesystem)
 
* [[SMB]] (Server Message Block, a protocol for a networked filesystem)
 
* [[Storj]] (another currency/filesystem scheme)
 
* [[Storj]] (another currency/filesystem scheme)
 +
* [[WebDAV]] (network filesystem implemented as extensions to HTTP)
 +
 +
== Virtual filesystems ==
 +
* [[%clay vane]] (Urbit)
 +
* [[AVFS]]
 +
* [[FUSE]]
 +
* [[GVfs (GNOME)]]
 +
* [[GVFS (Microsoft)]]
 +
 +
== Other / Misc. ==
 +
* [[πfs]]
 +
* [[BrowserFS]]
 +
* [[SAFS]]
  
 
== File content signature ==
 
== File content signature ==
Line 106: Line 137:
  
 
== Format details ==
 
== Format details ==
 +
* [[AAIP]]
 
* [[AppleDouble]]
 
* [[AppleDouble]]
 +
* [[Apple ISO 9660 extensions]]
 
* [[Apple Partition Map]]
 
* [[Apple Partition Map]]
 
* [[AppleSingle]]
 
* [[AppleSingle]]
 +
* [[ARCHIMEDES ISO 9660 extension]]
 
* [[desktop.ini]] (Windows)
 
* [[desktop.ini]] (Windows)
 
* [[Desktop Services Store]] (Mac OS X)
 
* [[Desktop Services Store]] (Mac OS X)
* [[MBR]] (Master Boot Record)
+
* [[El Torito]]
 +
* [[GUID Partition Table]]
 +
* [[Isofs transparent compression]]
 +
* [[Joliet]]
 +
* [[Master Boot Record]] (MBR)
 
* [[Resource Fork]] (MacOS)
 
* [[Resource Fork]] (MacOS)
 +
* [[Rock Ridge]]
 +
* [[System Use Sharing Protocol]] (SUSP)
 
* [[TRANS.TBL]]
 
* [[TRANS.TBL]]
  
 
== Links ==
 
== Links ==
 +
* [[Wikipedia:List of file systems|List of file systems (Wikipedia)]]
 
* [http://www.dreamhost.com/dreamscape/2013/09/12/cloud-storage-architectures/ Cloud Storage Architectures]
 
* [http://www.dreamhost.com/dreamscape/2013/09/12/cloud-storage-architectures/ Cloud Storage Architectures]
 
* [https://www.usenix.org/legacy/event/hotos09/tech/full_papers/seltzer/seltzer.pdf Hierarchical File Systems are Dead]
 
* [https://www.usenix.org/legacy/event/hotos09/tech/full_papers/seltzer/seltzer.pdf Hierarchical File Systems are Dead]
 
* [http://qanda.digipres.org/176/filesystem-checksums-value-digital-preservation-context Do filesystem-based checksums add value in a digital preservation context?]
 
* [http://qanda.digipres.org/176/filesystem-checksums-value-digital-preservation-context Do filesystem-based checksums add value in a digital preservation context?]
 +
* [http://lists.gnu.org/archive/html/coreutils/2014-08/msg00012.html My experience with using cp to copy a lot of files (432 millions, 39 TB)]
 +
* [https://www.csail.mit.edu/crash_tolerant_data_storage Crash-proof filesystem]
 +
* [http://l-o-c-a-l-h-o-s-t.com/wiki/doku.php?id=localhost:events:rwx:know_your_filesystem Know Your Filesystem]
 +
* [https://danluu.com/file-consistency/ File crash consistency and filesystems are hard]

Revision as of 14:27, 16 February 2019

File Format
Name Filesystem
Ontology

{{{caption}}}

Filesystems are Electronic Formats that are a prerequisite to being able to read any file off a digital medium — you have to be able to mount the filesystem, and thus read it, in order to be able to read a file.

Contents

Single-system filesystems

(How files are organized on one system, device, or medium, such as a disk, tape, or flash memory; see next category for networked and cloud filesystems. Of course, any filesystem can be made available on a network to remote devices, but these are the native filesystems present on the storage device/medium itself.)

Networked and cloud filesystems

(Used to make files available to multiple systems over a local or wide area network, including "on the cloud" via the Internet; systems access files through a protocol or API. The low-level storage details, usually concealed from end users and even most developers, may be within one or more of the single-device filesystems above, and the networked/cloud filesystem is generally defined independently of such details and might have very different characteristics and rules as to how the files are named, addressed, and structured.)

Virtual filesystems

Other / Misc.

File content signature

(used to match files to a hash table or similar system in order to detect duplicates, help find specific files when their exact location is unknown, handle distributed networked filesystems, etc. See also Error detection and correction.)

Format details

Links

Personal tools
Namespaces

Variants
Actions
Navigation
Toolbox