Archiving

From Just Solve the File Format Problem
(Difference between revisions)
Jump to: navigation, search
(Filesystem backup and restoration)
(230 intermediate revisions by 16 users not shown)
Line 1: Line 1:
{|
+
{{FormatInfo
|[[File Formats]]
+
|formattype=electronic
| >
+
|thiscat=Archiving
|[[Electronic File Formats]]
+
|image=Magazine-files.jpg
| >
+
}}
|Compression
+
|}
+
  
 
(Lossless, for generic data + file archives)
 
(Lossless, for generic data + file archives)
  
__NOTOC__
+
See also: [[Compression]], [[Error detection and correction]]
 
+
== Compression + archiving ==
+
(Multiple files => 1 file, makes it smaller)
+
 
+
* [[7ZIP]] (.7z)
+
* [[ARC]] (.arc)
+
* [[ARC (Web Archiving)]] (.arc.gz)
+
* [[Apple Disk Image]] (.dmg)
+
* [[ARJ]] (.arj)
+
* [[BRU]] (RSX-11M backup)
+
* [[DWC]] (.dwc)
+
* [[IMP]] (.imp)
+
* [[LHAv]] (.lzh, .lha)
+
* [[RAR]] (.rar)
+
* [[Spark]] (.spk)
+
* [[Stuffit]] (.sit)
+
* [[Stuffit X]] (.sitx)
+
* [[WARC]] (.warc.gz)
+
* [[ZIP]] (.zip)
+
* [[ZOO]] (.zoo)
+
  
 
== Archiving only ==
 
== Archiving only ==
 
(many files => 1 file, no compression attempted)
 
(many files => 1 file, no compression attempted)
  
* [[BinHex]] (.hqx)
+
* [[AR]] file format (.a, .lib) -- Unix Archiver (ar) format as used by various compilers/linkers
 +
* [[ARC (Internet Archive)]] (.arc)
 +
* [[BagIt]]
 +
* [[BAR (Age of Mythology)]]
 +
* [[bar]] (SunOS 4)
 +
* [[cpio]] (.cpio)
 +
* [[Hamster archive]]
 
* [[LBR]] (.lbr)
 
* [[LBR]] (.lbr)
 +
* [[LBR (Commodore)]] (.lbr)
 +
* [[Lynx archive]] (Commodore) (.lnx)
 +
* [[Mozilla Archive]] (.mar)
 +
* [[pax]]
 +
* [[Quake PAK]]
 +
* [[SeqBox]] (.sbx)
 
* [[Tape Archive]] (.tar)
 
* [[Tape Archive]] (.tar)
* [[LIB]] (.a, .lib) <!-- as used for libraries during compilation/linking; unix "ar" tool -->
+
* [[VIV]] (.viv, .big; used in Electronic Arts games)
* [[CPIO]] (.cpio)
+
* [[Webarchive (Safari)]]
 
+
== Compression only ==
+
(1 file => 1 file, makes it smaller)
+
 
+
* [[BZIP2]] (.bz2)
+
* [[Crunch]] (.?Z?)
+
* [[GZIP]] (.gz)
+
* [[Error Code Modeler]] (.ecm)
+
* [[LZMA]] (.lzma)
+
* [[Squeeze/SQ]] (.?Q?)
+
* [[XZ]] (.xz)
+
* [[LZIP]] (.lz)
+
* [[LZOP]] (.lzop)
+
* [[LZW]] (.Z)
+
  
 +
== Compression + archiving ==
 +
(Multiple files => 1 file, makes it smaller. See [[Compression]] for formats that compress single files/streams, and [[Disk Image Formats]] for formats that capture the low-level structure of a disk)
  
== Unknown ==
+
* [[4Q]] (.4q)
 
+
* [[7z]] (.7z)
* [[7zX]] (.s7z)
+
* [[9CDR]] (Amiga FileImploder Clone)
+
 
* [[ACE]] (.ace)
 
* [[ACE]] (.ace)
* [[AFA]] (.afa)
+
* [[afio]]
* [[ALZip]] (.alz)
+
* [[ALZ]] (.alz) (ALZip)
* [[APX]] (.apx)
+
* [[ARC (compression format)|ARC]] (PC/MS-DOS) (.arc)
* [[ARCFS]] (ArcFS ArchivePacker)
+
* [[ARC (Commodore)]] (.arc)
* [[ArchiveLib]] (GreenLeaf)
+
* [[ARC (FreeArc)]] (.arc)
 +
* [[ARC (Internet Archive)]] (gzipped form: .arc.gz)
 +
* [[ArcFS]] (RISC OS) (.arc)
 +
* [[ARJ]]
 +
* [[Astrotite]] (.afa)
 +
* [[B6Z]] (.b6z)
 
* [[BlakHole]] (.bh)
 
* [[BlakHole]] (.bh)
 +
* [[BRU]] - (RSX-11M backup)
 
* [[Cabinet]] (.cab)
 
* [[Cabinet]] (.cab)
 +
* [[CAR]] (a SAP archive format; also see [[SAR]])
 +
* [[CMZ (archive format)|CMZ]]
 
* [[Compact File Set]] (.cfs)
 
* [[Compact File Set]] (.cfs)
 
* [[Compact Pro]] (.cpt)
 
* [[Compact Pro]] (.cpt)
* [[DGCA]] (.dgc)
 
 
* [[Disk Archiver]] (.dar)
 
* [[Disk Archiver]] (.dar)
* [[DiskDoubler]] (.dd)
+
* [[DGCA]] (.dgc)
* [[DMS]] (.dms; Amiga Disk Masher compressed file)
+
* [[DWC]] (.dwc)
* [[DUPA]] (Amiga FileImploder Clone)
+
* [[EGG (ALZip)]] (.egg)
* [[DVDisaster Error Correction File]] (.ecc)
+
* [[FTCOMP]]
* [[FIMP]] (Amiga FileImploder)
+
* [[Freeze/Melt]] (.F)
+
 
* [[GCA]] (.gca)
 
* [[GCA]] (.gca)
 +
* [[Greenleaf ArchiveLib]]
 
* [[HA]] (.ha)
 
* [[HA]] (.ha)
* [[Huffman Encoding]] (.z)
+
* [[HKI]] (WinHKI) (.hki)
* [[ICE]] (.ice)
+
* [[ICE (ICEOWS)]] (.ice)
* [[IFHC]] (Amiga FileImploder Clone)
+
* [[IMP]] (.imp)
* [[IMP]] (Amiga FileImploder)
+
* [[JAR (ARJ Software)]] (.j)
* [[Inflate]] (.infl)
+
* [[Jar]] (.j, .jar) => this is just a renamed zip file with some mandatory files
+
 
* [[KGB Archiver]] (.kgb)
 
* [[KGB Archiver]] (.kgb)
* [[KiriKiri]] (.xp3)
+
* [[LHA]] (.lzh, .lha)
 
* [[LZX]] (.lzx)
 
* [[LZX]] (.lzx)
* [[LNX]] (.lnx; Lynx archive, used on Commodore 64)
+
* [[MAFF]] (Mozilla web archive; uses ZIP for compression)
* [[Mozilla Archive]] (.mar)
+
* [[NuFX]] (.bxy)
* [[MS-DOS Compression]] (.??_)
+
* [[packARC]] (.pja)
 +
* [[Packdir]] (RISC OS)
 
* [[PackIt]] (.pit)
 
* [[PackIt]] (.pit)
* [[PAK]] (.pak)
+
* [[PAK]] (.pak)  
* [[PAQ]] (.paq6, .paq7, .paq8)
+
* [[PAQ]] (.pa6, .pa7, .pa8, others)
* [[Parchive File]] (.par, .par2)
+
* [[PEA]] (PeaZIP) (.pea)  
* [[PartImage]] (.partimg)
+
* [[PeaZip]] (.pea)
+
 
* [[PerfectCompress]] (.uca)
 
* [[PerfectCompress]] (.uca)
 
* [[PIM]] (.pim)
 
* [[PIM]] (.pim)
* [[Quadruple D]] (.qda)
+
* [[PMA]] (.pma)
* [[RK]] (.rk)
+
* [[Quadruple D Archiver]] (.qda)
* [[RZIP]] (.rzip)
+
* [[Quantum compressed archive]] (.q)
* [[SCIFER]] (.ba)
+
* [[RAR]] (.rar)
* [[Scifer]] (.sen)
+
* [[RARC (Nintendo)]]
* [[Self Dissolving ARChive]] (.sda)
+
* [[RK]] (WinRK)
* [[Self-Extracting Archive]] (.sea)
+
* [[S7z]] (.s7z)
* [[Self-Extracting Archive]] (.sfx)
+
* [[SAR]] (a SAP archive format; also see [[CAR]])
* [[sfArk]] (.sfark)
+
* [[Scifer]] (.sen, .ba, .xml)
* [[Shell Archive]] (.shar)
+
* [[ShrinkIt]] (.shk)
 +
* [[Softlib]] (Softdisk Publishing) (.slb)
 +
* [[Spark]] (.spk)
 
* [[SQX]] (.sqx)
 
* [[SQX]] (.sqx)
* [[UHarc]] (.uha)
+
* [[StuffIt]] (.sit)
 +
* [[StuffIt X]] (.sitx)
 +
* [[UHARC]] (.uha)  
 
* [[UltraCompressor II]] (.uc, .uc0, .uc2, .ucn, .ur2, .ue2)
 
* [[UltraCompressor II]] (.uc, .uc0, .uc2, .ucn, .ur2, .ue2)
* [[Unix Archiver]] (.ar)
+
* [[WARC]] (.warc, .warc.gz)
* [[Windows Image]] (.wim)
+
* [[xar (Extensible Archive)]] (.xar)
* [[WinHKI]] (.hki)
+
* [[XP3]] (.xp3) - used in [[KiriKiri Adventure Game System]]
* [[WinRK]] (.rk)
+
* [[Yamazaki zipper archive]] (.yz1) - used in DeepFreezer
* [[XAR]] (.xar)
+
* [[ZIP]] (.zip)
* [[YZ1]] (.yz1)
+
* [[Zipx]] (.zipx)
 +
* [[ZOO]] (.zoo)
 +
* [[ZPAQ]]
 
* [[Zzip]] (.zz)
 
* [[Zzip]] (.zz)
 +
 +
== Diff files ==
 +
(containing only the parts of a file that have changed, so they can be applied to an existing file to update it; used for update distribution and incremental backups)
 +
* [[binpatch (Jaap Korthals Altes)]]
 +
* [[bsdiff]]
 +
* [[Courgette]]
 +
* [[diff]]
 +
* [[FidoNet nodediff]]
 +
* [[GDIFF]]
 +
* [[IPS (binary patch format)]]
 +
* [[JSON Patch]]
 +
* [[RTPatch]]
 +
* [[Unified diff]]
 +
* [[UPS (binary patch format)]]
 +
* [[VCDIFF]]
 +
 +
See also [[Wikipedia:Data differencing]].
 +
 +
== Encrypted or cryptographically signed archives ==
 +
* [[XIP]]
 +
* [[ZED]]
 +
 +
== Filesystem backup and restoration ==
 +
Formats designed for backing up disks, usually specifically targeted at particular [[filesystem]]s (but backing it up in the form of file structures, not raw sector images like [[Disk Image Formats]]).
 +
* [[BACKUP (MS-DOS)]]
 +
* [[BlockHashLoc]]
 +
* [[Partimage]]
 +
* [[ufsdump]]
 +
* [[Unix dump]]
 +
* [[Windows Imaging Format]] (.wim, .swm)
 +
 +
== Institutional archiving ==
 +
* [[ARK]] (identifier for archived documents)
 +
* [[OAIS]] (Open Archival Information System, an organization that does archiving)
 +
* [[Planets Core Registry]]
 +
* [[PRONOM]]
 +
** [[PUID]]
 +
* [[SIRF]] (Self-Contained Information Retention Format)
 +
* [[Submission Information Package]]
 +
* [[UPF]] (Universal Preservation Format)
 +
 +
== Metadata formats ==
 +
* [[Archive Team hostname file]]
 +
* [[CDX]] (associated with web archives)
 +
* [[DFDL]] (Data Format Description Language) - a file format for describing file formats
 +
* [[Internet Archive metadata]]
 +
* [[mtree]]
 +
* [[Portland Common Data Model]]
 +
* [[TOSEC Naming Convention]]
 +
* [[Web Archive Metadata File]] (metadata for [[WARC]])
 +
 +
(see also [[Metadata]], [[Bibliographic data]])
 +
 +
== Miscellaneous ==
 +
* [[7-Zip]]
 +
* [[Cache Directory Tagging Standard]]
 +
 +
== Program/App/Applet/Installer specialized archive formats ==
 +
* [[APK]] (Android app)
 +
* [[Bundle file (Linux)]]
 +
* [[Bundle file (OS X)]]
 +
* [[Cabal]]
 +
* [[Cross-Platform Installer Module]]
 +
* [[deb]] (Debian package)
 +
* [[IPS archive|Image Packaging System (IPS) archive]] (.p5p)
 +
* [[IPS manifest|Image Packaging System (IPS) manifest]] (.p5m)
 +
* [[Inno Setup self-extracting archive]]
 +
* [[InstallShield CAB]]
 +
* [[InstallShield installer archive]]
 +
* [[InstallShield Z]]
 +
* [[IPA]] (.ipa) => iOS app in archived form; actually in zip format
 +
* [[Jar]] (.j, .jar) (Java) => this is just a renamed zip file with some mandatory files
 +
* [[Meta-Package File]] (.mpkg) (Mac OS X)
 +
* [[Microsoft Update Standalone Package]]
 +
* [[NSIS]] (Nullsoft Scriptable Install System)
 +
* [[Olive]] (executable virtual-machine archive of software)
 +
* [[Package File (OS X)]] (.pkg)
 +
* [[RPM]] (RedHat Package Manager)
 +
* [[SIS]] (Symbian)
 +
* [[Snap]] [https://docs.snapcraft.io/the-snap-format/698]
 +
* [[Windows Installer]] (.msi, .msp)
 +
* [[XAR (Executable Archive)]]
 +
 +
== Self-extracting archives ==
 +
(in addition, some of the other archivers are able to produce executable files for some platform which include the archived data and a program to extract them, and generally have the file extension normal for executables, such as .exe for DOS/Windows. In many cases, if you rename the extension to the appropriate one for the archive type involved, e.g., '''.zip''', the file will open in the appropriate archiver, which is handy for extracting them on systems not compatible with the original executable.)
 +
* [[SDA]] (Self Dissolving Archive)
 +
* [[SEA]] (Self-Extracting Archive]
 +
* [[Self-extracting ZIP]]
 +
* [[SFX]] (Self-Extracting Archive)
 +
* [[shar]] (Shell Archive, in Unix-like systems)
 +
 +
== Transfer formats ==
 +
(encapsulate a system-specific file structure to make it compatible with foreign systems, file transfer protocols, etc.)
 +
* [[AppleDouble]]
 +
* [[AppleSingle]]
 +
* [[Bento]] (1990s Apple cross-platform compound content format)
 +
* [[Binary II]] (.bny) (for Apple II series) (often [[squeeze]]d as .bqy)
 +
* [[BinHex]] (.hqx)
 +
* [[GEOS Convert]] (.cvt)
 +
* [[MacBinary]]
 +
* [[TI variable file]]
 +
 +
For low-level transfer encodings, see [[Transfer Encodings]].
 +
 +
== Links ==
 +
* [http://www.coredumps.de/doc/dump/zwicky/testdump.doc.html Torture-testing Backup and Archive Programs: Things You Ought to Know But Probably Would Rather Not]
 +
* [http://www.ietf.org/mail-archive/web/apps-discuss/current/msg13094.html Discussion of proposed top-level MIME type for 'archive']
 +
* [http://blogs.loc.gov/digitalpreservation/2014/02/what-do-you-mean-by-archive-genres-of-usage-for-digital-preservers/ What Do you Mean by Archive? Genres of Usage for Digital Preservers]

Revision as of 05:18, 26 January 2019

File Format
Name Archiving
Ontology

{{{caption}}}

(Lossless, for generic data + file archives)

See also: Compression, Error detection and correction

Contents

Archiving only

(many files => 1 file, no compression attempted)

Compression + archiving

(Multiple files => 1 file, makes it smaller. See Compression for formats that compress single files/streams, and Disk Image Formats for formats that capture the low-level structure of a disk)

Diff files

(containing only the parts of a file that have changed, so they can be applied to an existing file to update it; used for update distribution and incremental backups)

See also Wikipedia:Data differencing.

Encrypted or cryptographically signed archives

Filesystem backup and restoration

Formats designed for backing up disks, usually specifically targeted at particular filesystems (but backing it up in the form of file structures, not raw sector images like Disk Image Formats).

Institutional archiving

Metadata formats

(see also Metadata, Bibliographic data)

Miscellaneous

Program/App/Applet/Installer specialized archive formats

Self-extracting archives

(in addition, some of the other archivers are able to produce executable files for some platform which include the archived data and a program to extract them, and generally have the file extension normal for executables, such as .exe for DOS/Windows. In many cases, if you rename the extension to the appropriate one for the archive type involved, e.g., .zip, the file will open in the appropriate archiver, which is handy for extracting them on systems not compatible with the original executable.)

Transfer formats

(encapsulate a system-specific file structure to make it compatible with foreign systems, file transfer protocols, etc.)

For low-level transfer encodings, see Transfer Encodings.

Links

Personal tools
Namespaces

Variants
Actions
Navigation
Toolbox