Compression

From Just Solve the File Format Problem
(Difference between revisions)
Jump to: navigation, search
(Compression algorithms and compressed data formats)
(Transparent file compression)
(41 intermediate revisions by 3 users not shown)
Line 18: Line 18:
 
* [[DEFLATE]]
 
* [[DEFLATE]]
 
* [[DivANS]]
 
* [[DivANS]]
 +
* [[EXEPACK2]]
 +
* [[Fractal compression]]
 
* [[HPACK (HTTP)|HPACK]] (used to compress HTTP headers)
 
* [[HPACK (HTTP)|HPACK]] (used to compress HTTP headers)
 
* [[Huffman coding]]
 
* [[Huffman coding]]
 +
** [[Adaptive Huffman coding]]
 +
** [[Canonical Huffman code]]
 +
* [[Lempel–Ziv–Stac]] (LZS)
 
* [[LZ4]]
 
* [[LZ4]]
 
* [[LZ77]]
 
* [[LZ77]]
 +
* [[LZ77 with Huffman coding]]
 
* [[LZ78]]
 
* [[LZ78]]
 
* [[LZFSE]]
 
* [[LZFSE]]
Line 27: Line 33:
 
* [[LZMA]]
 
* [[LZMA]]
 
* [[LZMA2]]
 
* [[LZMA2]]
 +
* [[LZMW]]
 
* [[LZO]] (Lempel–Ziv–Oberhumer)
 
* [[LZO]] (Lempel–Ziv–Oberhumer)
 
* [[LZSS]] (Lempel–Ziv–Storer–Szymanski)
 
* [[LZSS]] (Lempel–Ziv–Storer–Szymanski)
 
* [[LZW]]
 
* [[LZW]]
 +
* [[LZX]]
 +
** [[LZX Delta]]
 
* [[MSZIP]]
 
* [[MSZIP]]
 
* [[PKWARE DCL Implode]]
 
* [[PKWARE DCL Implode]]
Line 35: Line 44:
 
* [[Prediction by partial matching]] (PPM)
 
* [[Prediction by partial matching]] (PPM)
 
* [[Run-length encoding]]
 
* [[Run-length encoding]]
 +
** [[PackBits]]
 
** [[RLE90]]
 
** [[RLE90]]
 
* [[Shannon–Fano coding]]
 
* [[Shannon–Fano coding]]
Line 50: Line 60:
  
 
* [[9CDR]] (Amiga FileImploder Clone)
 
* [[9CDR]] (Amiga FileImploder Clone)
 +
* [[ABC (Advanced Blocksorting Compressor)]]
 +
* [[ABComp]] (.abp)
 
* [[BARF]] (.x, .x??)
 
* [[BARF]] (.x, .x??)
 +
* [[BGZF]]
 
* [[BWTC32Key]] (.B3K)
 
* [[BWTC32Key]] (.B3K)
 
* [[bzip]] (.bz)
 
* [[bzip]] (.bz)
 
* [[bzip2]] (.bz2)
 
* [[bzip2]] (.bz2)
 +
* [[BZip3]] (.bz3)
 +
* [[CAZIP]]
 +
* [[ChiefLZ]] (.LZZ)
 +
* [[compact (Gene Olson)]] (.W)
 
* [[compact (Unix)]] (.C)
 
* [[compact (Unix)]] (.C)
 
* [[compress (Unix)]] (.Z)
 
* [[compress (Unix)]] (.Z)
Line 60: Line 77:
 
* [[Crunch]] (.?z?)
 
* [[Crunch]] (.?z?)
 
* [[Crunch-Mania]]
 
* [[Crunch-Mania]]
 +
* [[DACT]]
 
* [[DUPA]] (Amiga FileImploder Clone)
 
* [[DUPA]] (Amiga FileImploder Clone)
 +
* [[EDI Install archive]]
 +
* [[EDI Install packed file]]
 +
* [[EDI LZSSLib]]
 
* [[Error Code Modeler]] (.ecm)
 
* [[Error Code Modeler]] (.ecm)
 
* [[File Imploder]] (Amiga) (.imp)
 
* [[File Imploder]] (Amiga) (.imp)
 +
* [[FlySpeed st/exp]]
 
* [[Freeze/Melt]] (Unix) (.F)
 
* [[Freeze/Melt]] (Unix) (.F)
 
* [[gzip]] (.gz)
 
* [[gzip]] (.gz)
Line 70: Line 92:
 
* [[Inflate]] (.infl) - parody format that actually increases size
 
* [[Inflate]] (.infl) - parody format that actually increases size
 
* [[JAM (W. Jiang)]]
 
* [[JAM (W. Jiang)]]
 +
* [[The JAM Packer]]
 
* [[JCalG1]] (.jc, Commodore Amiga)
 
* [[JCalG1]] (.jc, Commodore Amiga)
 +
* [[Kboom11]]
 
* [[lrzip]] (.lrz)
 
* [[lrzip]] (.lrz)
 +
* [[LZARI]]
 +
* [[LZHUF]]
 
* [[Lzip]] (.lz)
 
* [[Lzip]] (.lz)
 
* [[LZMA Alone|LZMA_Alone]] (.lzma)
 
* [[LZMA Alone|LZMA_Alone]] (.lzma)
 
* [[lzop]] (.lzo)
 
* [[lzop]] (.lzo)
* [[LZX]]
+
* [[LZS221]]
 +
* [[LZSS (Haruhiko Okumura)]]
 +
* [[LZWCOM]]
 +
* [[LzwPak]]
 
* [[Mozilla LZ4]] (.jsonlz4)
 
* [[Mozilla LZ4]] (.jsonlz4)
 
* [[MS-DOS installation compression]] (.??_)
 
* [[MS-DOS installation compression]] (.??_)
 +
* [[NOAH]]
 +
* [[NPack]]
 +
* [[NRV (Not Really Vanished)]]
 
* [[Oodle Data Compression]]
 
* [[Oodle Data Compression]]
 
* [[pack (Unix)]] (.z)
 
* [[pack (Unix)]] (.z)
 +
* [[PGNPack]]
 
* [[PowerPacker]] (.pp)
 
* [[PowerPacker]] (.pp)
 
* [[Pro-Pack]]
 
* [[Pro-Pack]]
 +
* [[PUT and GET (Scott Jennings)]]
 +
* [[Quasijarus Strong Compression]]
 
* [[RAC]]
 
* [[RAC]]
* [[RK]] (WinRK)
+
* [[RKUC]]
 
* [[rzip]] (.rz)
 
* [[rzip]] (.rz)
 
* [[SCO compress LZH]]
 
* [[SCO compress LZH]]
 +
* [[SEMONE]] (.one)
 +
* [[SFDN Packer]]
 
* [[SHARC]] (density)
 
* [[SHARC]] (density)
 
* [[Softdisk Text Compressor]] (.ctx)
 
* [[Softdisk Text Compressor]] (.ctx)
 +
* [[Splint]]
 +
* [[SQ2]]
 
* [[Squash (RISC OS)|Squash]] - single file compression on RISC OS
 
* [[Squash (RISC OS)|Squash]] - single file compression on RISC OS
 
* [[Squeeze|Squeeze/SQ]] (.?q?)
 
* [[Squeeze|Squeeze/SQ]] (.?q?)
* [[TTComp archive]]
+
* [[SQUEEZE (AJP Systems)]]
 +
* [[squeeze (Daniel Bernstein)]] (.MW)
 +
* [[Squish (Mike Albert)]]
 +
* [[Sunzip]] (.sz)
 +
* [[TERSE]]
 +
* [[Top4]]
 +
* [[TTCOMP]]
 
* [[TTW]]
 
* [[TTW]]
 
* [[tzip]]
 
* [[tzip]]
 
* [[Tzip (Text ZIP)]]
 
* [[Tzip (Text ZIP)]]
 +
* [[UHBC]]
 
* [[WWPACK]]
 
* [[WWPACK]]
 
* [[XPK]]
 
* [[XPK]]
 
* [[XZ]] (.xz)
 
* [[XZ]] (.xz)
 
* [[Yaz0]]
 
* [[Yaz0]]
 +
* [[zchunk]]
 +
* [[Zoo filter format]]
 +
* [[Zoo Z format]]
 +
* [[ZSQ (LZW compression)]]
  
 
== Transparent file compression ==
 
== Transparent file compression ==
 
(A mostly-obsolete technique in which a background process hooks into the OS and decompresses files transparently when they are read. ''Compression'' might be done manually. The line between this and ''Disk compression'' can be blurry.)
 
(A mostly-obsolete technique in which a background process hooks into the OS and decompresses files transparently when they are read. ''Compression'' might be done manually. The line between this and ''Disk compression'' can be blurry.)
  
 +
* [[AFX (Atari ST)]]
 
* [[CFS (Computer Concepts Compression)]]
 
* [[CFS (Computer Concepts Compression)]]
 
* [[DIET (compression)|DIET]]
 
* [[DIET (compression)|DIET]]
Line 117: Line 168:
 
* [[Stacker]]
 
* [[Stacker]]
  
For filesystem formats that feature compression, see [[Filesystem]].
+
For filesystem formats that feature compression, see [[Filesystem]] (especially [[Filesystem#Compressed filesystems]]).
  
 
== Executable compression ==
 
== Executable compression ==
Line 125: Line 176:
 
== See also ==
 
== See also ==
  
 +
* [[Compression and archiving software]]
 
* [[Compression research]]
 
* [[Compression research]]
 
* [[Archiving]] (for formats that place multiple files together in one file, with or without compression)
 
* [[Archiving]] (for formats that place multiple files together in one file, with or without compression)

Revision as of 22:02, 25 June 2022

File Format
Name Compression
Ontology

{{{caption}}}

Contents

Stream compression formats

A stream format takes a stream of bytes, and outputs a different, hopefully smaller, stream of bytes. These compression formats are often used internally in other data structures to compress data, as well as in network protocols, such as http. Used stand-alone, a stream compression format does not offer archiving capability, however in the UNIX doctrine, an archiver like tar can be combined with an archive format to produce a proper compressed archive.

Compression algorithms and compressed data formats

(excluding formats usually used as file formats)

Graphics compression

See Graphics#Compression for compression formats used primarily with graphics.

Specific file formats/programs

(multi-file compressors are in Archiving)

Transparent file compression

(A mostly-obsolete technique in which a background process hooks into the OS and decompresses files transparently when they are read. Compression might be done manually. The line between this and Disk compression can be blurry.)

Disk compression

(Transparent disk compression software and the like, excluding filesystem formats.)

For filesystem formats that feature compression, see Filesystem (especially Filesystem#Compressed filesystems).

Executable compression

See Executable compression.

See also

Links

Personal tools
Namespaces

Variants
Actions
Navigation
Toolbox