Archiving
From Just Solve the File Format Problem
(Difference between revisions)
Dan Tobias (Talk | contribs) (→Program/App/Applet/Installer specialized archive formats) |
Dan Tobias (Talk | contribs) (→Compression + archiving) |
||
| (13 intermediate revisions by 4 users not shown) | |||
| Line 18: | Line 18: | ||
* [[bar]] (SunOS 4) | * [[bar]] (SunOS 4) | ||
* [[cpio]] (.cpio) | * [[cpio]] (.cpio) | ||
| + | * [[Hamster archive]] | ||
* [[LBR]] (.lbr) | * [[LBR]] (.lbr) | ||
* [[LBR (Commodore)]] (.lbr) | * [[LBR (Commodore)]] (.lbr) | ||
| Line 23: | Line 24: | ||
* [[Mozilla Archive]] (.mar) | * [[Mozilla Archive]] (.mar) | ||
* [[pax]] | * [[pax]] | ||
| + | * [[SeqBox]] (.sbx) | ||
* [[Tape Archive]] (.tar) | * [[Tape Archive]] (.tar) | ||
* [[VIV]] (.viv, .big; used in Electronic Arts games) | * [[VIV]] (.viv, .big; used in Electronic Arts games) | ||
| Line 42: | Line 44: | ||
* [[ARJ]] | * [[ARJ]] | ||
* [[Astrotite]] (.afa) | * [[Astrotite]] (.afa) | ||
| + | * [[B6Z]] (.b6z) | ||
* [[BlakHole]] (.bh) | * [[BlakHole]] (.bh) | ||
* [[BRU]] - (RSX-11M backup) | * [[BRU]] - (RSX-11M backup) | ||
* [[Cabinet]] (.cab) | * [[Cabinet]] (.cab) | ||
| + | * [[CAR]] (a SAP archive format; also see [[SAR]]) | ||
* [[Compact File Set]] (.cfs) | * [[Compact File Set]] (.cfs) | ||
* [[Compact Pro]] (.cpt) | * [[Compact Pro]] (.cpt) | ||
| Line 55: | Line 59: | ||
* [[HA]] (.ha) | * [[HA]] (.ha) | ||
* [[HKI]] (WinHKI) (.hki) | * [[HKI]] (WinHKI) (.hki) | ||
| − | * [[ICE]] (.ice) | + | * [[ICE (ICEOWS)]] (.ice) |
* [[IMP]] (.imp) | * [[IMP]] (.imp) | ||
* [[JAR (ARJ Software)]] (.j) | * [[JAR (ARJ Software)]] (.j) | ||
| Line 76: | Line 80: | ||
* [[RK]] (WinRK) | * [[RK]] (WinRK) | ||
* [[S7z]] (.s7z) | * [[S7z]] (.s7z) | ||
| + | * [[SAR]] (a SAP archive format; also see [[CAR]]) | ||
* [[Scifer]] (.sen, .ba, .xml) | * [[Scifer]] (.sen, .ba, .xml) | ||
* [[ShrinkIt]] (.shk) | * [[ShrinkIt]] (.shk) | ||
| Line 92: | Line 97: | ||
* [[Zipx]] (.zipx) | * [[Zipx]] (.zipx) | ||
* [[ZOO]] (.zoo) | * [[ZOO]] (.zoo) | ||
| − | * [[Zzip]] (.zz | + | * [[ZPAQ]] |
| + | * [[Zzip]] (.zz | ||
== Diff files == | == Diff files == | ||
| Line 103: | Line 109: | ||
* [[GDIFF]] | * [[GDIFF]] | ||
* [[IPS (binary patch format)]] | * [[IPS (binary patch format)]] | ||
| + | * [[JSON Patch]] | ||
* [[RTPatch]] | * [[RTPatch]] | ||
* [[Unified diff]] | * [[Unified diff]] | ||
* [[UPS (binary patch format)]] | * [[UPS (binary patch format)]] | ||
| + | * [[VCDIFF]] | ||
| − | == Filesystem backup == | + | See also [[Wikipedia:Data differencing]]. |
| + | |||
| + | == Encrypted archives == | ||
| + | * [[ZED]] | ||
| + | |||
| + | == Filesystem backup and restoration == | ||
Formats designed for backing up disks, usually specifically targeted at particular [[filesystem]]s (but backing it up in the form of file structures, not raw sector images like [[Disk Image Formats]]). | Formats designed for backing up disks, usually specifically targeted at particular [[filesystem]]s (but backing it up in the form of file structures, not raw sector images like [[Disk Image Formats]]). | ||
* [[BACKUP (MS-DOS)]] | * [[BACKUP (MS-DOS)]] | ||
| + | * [[BlockHashLoc]] | ||
* [[Partimage]] | * [[Partimage]] | ||
* [[ufsdump]] | * [[ufsdump]] | ||
| Line 126: | Line 140: | ||
== Metadata formats == | == Metadata formats == | ||
* [[Archive Team hostname file]] | * [[Archive Team hostname file]] | ||
| + | * [[CDX]] (associated with web archives) | ||
* [[DFDL]] (Data Format Description Language) - a file format for describing file formats | * [[DFDL]] (Data Format Description Language) - a file format for describing file formats | ||
* [[Internet Archive metadata]] | * [[Internet Archive metadata]] | ||
* [[mtree]] | * [[mtree]] | ||
| + | * [[Portland Common Data Model]] | ||
* [[TOSEC Naming Convention]] | * [[TOSEC Naming Convention]] | ||
* [[Web Archive Metadata File]] (metadata for [[WARC]]) | * [[Web Archive Metadata File]] (metadata for [[WARC]]) | ||
| Line 143: | Line 159: | ||
* [[Bundle file (Linux)]] | * [[Bundle file (Linux)]] | ||
* [[Bundle file (OS X)]] | * [[Bundle file (OS X)]] | ||
| + | * [[Cross-Platform Installer Module]] | ||
* [[deb]] (Debian package) | * [[deb]] (Debian package) | ||
* [[GEOS Convert]] (.cvt) | * [[GEOS Convert]] (.cvt) | ||
Revision as of 22:38, 6 October 2017
(Lossless, for generic data + file archives)
See also: Compression, Error detection and correction
Contents |
Archiving only
(many files => 1 file, no compression attempted)
- AR file format (.a, .lib) -- Unix Archiver (ar) format as used by various compilers/linkers
- ARC (Internet Archive) (.arc)
- BagIt
- BAR (Age of Mythology)
- bar (SunOS 4)
- cpio (.cpio)
- Hamster archive
- LBR (.lbr)
- LBR (Commodore) (.lbr)
- Lynx archive (Commodore) (.lnx)
- Mozilla Archive (.mar)
- pax
- SeqBox (.sbx)
- Tape Archive (.tar)
- VIV (.viv, .big; used in Electronic Arts games)
- Webarchive (Safari)
Compression + archiving
(Multiple files => 1 file, makes it smaller. See Compression for formats that compress single files/streams, and Disk Image Formats for formats that capture the low-level structure of a disk)
- 4Q (.4q)
- 7z (.7z)
- ACE (.ace)
- afio
- ALZ (.alz) (ALZip)
- ARC (PC/MS-DOS) (.arc)
- ARC (Commodore) (.arc)
- ARC (FreeArc) (.arc)
- ARC (Internet Archive) (gzipped form: .arc.gz)
- ArcFS (RISC OS) (.arc)
- ARJ
- Astrotite (.afa)
- B6Z (.b6z)
- BlakHole (.bh)
- BRU - (RSX-11M backup)
- Cabinet (.cab)
- CAR (a SAP archive format; also see SAR)
- Compact File Set (.cfs)
- Compact Pro (.cpt)
- Disk Archiver (.dar)
- DGCA (.dgc)
- DWC (.dwc)
- EGG (ALZip) (.egg)
- GCA (.gca)
- Greenleaf ArchiveLib
- HA (.ha)
- HKI (WinHKI) (.hki)
- ICE (ICEOWS) (.ice)
- IMP (.imp)
- JAR (ARJ Software) (.j)
- KGB Archiver (.kgb)
- LHA (.lzh, .lha)
- LZX (.lzx)
- MAFF (Mozilla web archive; uses ZIP for compression)
- NuFX (.bxy)
- Packdir (RISC OS)
- PackIt (.pit)
- PAK (.pak)
- PAQ (.pa6, .pa7, .pa8, others)
- PEA (PeaZIP) (.pea)
- PerfectCompress (.uca)
- PIM (.pim)
- PMA (.pma)
- Quadruple D Archiver (.qda)
- Quantum compressed archive (.q)
- RAR (.rar)
- RK (WinRK)
- S7z (.s7z)
- SAR (a SAP archive format; also see CAR)
- Scifer (.sen, .ba, .xml)
- ShrinkIt (.shk)
- Softlib (Softdisk Publishing) (.slb)
- Spark (.spk)
- SQX (.sqx)
- StuffIt (.sit)
- StuffIt X (.sitx)
- UHARC (.uha)
- UltraCompressor II (.uc, .uc0, .uc2, .ucn, .ur2, .ue2)
- WARC (.warc, .warc.gz)
- xar (.xar)
- XP3 (.xp3) - used in KiriKiri Adventure Game System
- Yamazaki zipper archive (.yz1) - used in DeepFreezer
- ZIP (.zip)
- Zipx (.zipx)
- ZOO (.zoo)
- ZPAQ
- Zzip (.zz
Diff files
(containing only the parts of a file that have changed, so they can be applied to an existing file to update it; used for update distribution and incremental backups)
- binpatch (Jaap Korthals Altes)
- bsdiff
- Courgette
- diff
- FidoNet nodediff
- GDIFF
- IPS (binary patch format)
- JSON Patch
- RTPatch
- Unified diff
- UPS (binary patch format)
- VCDIFF
See also Wikipedia:Data differencing.
Encrypted archives
Filesystem backup and restoration
Formats designed for backing up disks, usually specifically targeted at particular filesystems (but backing it up in the form of file structures, not raw sector images like Disk Image Formats).
- BACKUP (MS-DOS)
- BlockHashLoc
- Partimage
- ufsdump
- Windows Imaging Format (.wim, .swm)
Institutional archiving
- ARK (identifier for archived documents)
- OAIS (Open Archival Information System, an organization that does archiving)
- Planets Core Registry
- PRONOM
- SIRF (Self-Contained Information Retention Format)
- Submission Information Package
- UPF (Universal Preservation Format)
Metadata formats
- Archive Team hostname file
- CDX (associated with web archives)
- DFDL (Data Format Description Language) - a file format for describing file formats
- Internet Archive metadata
- mtree
- Portland Common Data Model
- TOSEC Naming Convention
- Web Archive Metadata File (metadata for WARC)
(see also Metadata, Bibliographic data)
Miscellaneous
Program/App/Applet/Installer specialized archive formats
- APK (Android app)
- Bento (1990s Apple cross-platform compound content format)
- Bundle file (Linux)
- Bundle file (OS X)
- Cross-Platform Installer Module
- deb (Debian package)
- GEOS Convert (.cvt)
- Image Packaging System (IPS) archive (.p5p)
- Image Packaging System (IPS) manifest (.p5m)
- Inno Setup self-extracting archive
- InstallShield CAB
- InstallShield Z
- IPA (.ipa) => iOS app in archived form; actually in zip format
- Jar (.j, .jar) (Java) => this is just a renamed zip file with some mandatory files
- Meta-Package File (.mpkg) (Mac OS X)
- Microsoft Update Standalone Package
- NSIS (Nullsoft Scriptable Install System)
- Olive (executable virtual-machine archive of software)
- Package File (OS X) (.pkg)
- RPM (RedHat Package Manager)
- SIS (Symbian)
- TI variable file
- Windows Installer (.msi, .msp)
Self-extracting archives
(in addition, some of the other archivers are able to produce executable files for some platform which include the archived data and a program to extract them, and generally have the file extension normal for executables, such as .exe for DOS/Windows. In many cases, if you rename the extension to the appropriate one for the archive type involved, e.g., .zip, the file will open in the appropriate archiver, which is handy for extracting them on systems not compatible with the original executable.)
- SDA (Self Dissolving Archive)
- SEA (Self-Extracting Archive]
- Self-extracting ZIP
- SFX (Self-Extracting Archive)
- shar (Shell Archive, in Unix-like systems)
Transfer encodings
(convert binaries to printable ASCII for download; encode resource forks or metadata together with file, etc.)
See also the main article, Transfer Encodings.
