Compression

From Just Solve the File Format Problem
(Difference between revisions)
Jump to: navigation, search
(Stream compression formats)
(Specific file formats/programs)
 
(72 intermediate revisions by 7 users not shown)
Line 2: Line 2:
 
|formattype=electronic
 
|formattype=electronic
 
|thiscat=Compression
 
|thiscat=Compression
 +
|image=Vise.png
 
}}
 
}}
  
Line 8: Line 9:
 
A stream format takes a stream of bytes, and outputs a different, hopefully smaller, stream of bytes. These compression formats are often used internally in other data structures to compress data, as well as in network protocols, such as http. Used stand-alone, a stream compression format does not offer archiving capability, however in the UNIX doctrine, an archiver like [[tar]] can be combined with an archive format to produce a proper compressed archive.
 
A stream format takes a stream of bytes, and outputs a different, hopefully smaller, stream of bytes. These compression formats are often used internally in other data structures to compress data, as well as in network protocols, such as http. Used stand-alone, a stream compression format does not offer archiving capability, however in the UNIX doctrine, an archiver like [[tar]] can be combined with an archive format to produce a proper compressed archive.
  
 +
== Compression algorithms and compressed data formats ==
 +
 +
(excluding formats usually used as file formats)
 +
 +
* [[Arithmetic coding]]
 +
* [[Brotli]]
 +
* [[Burrows–Wheeler transform]]
 +
* [[DEFLATE]]
 +
* [[DivANS]]
 +
* [[Huffman coding]]
 +
* [[LZ4]]
 +
* [[LZ77]]
 +
* [[LZ78]]
 +
* [[LZFSE]]
 +
* [[LZHAM]]
 +
* [[LZMA]]
 +
* [[LZMA2]]
 +
* [[LZO]] (Lempel–Ziv–Oberhumer)
 +
* [[LZSS]] (Lempel–Ziv–Storer–Szymanski)
 +
* [[LZW]]
 +
* [[PKWARE DCL Implode]]
 +
* [[PPMd]]
 +
* [[Run-length encoding]]
 +
** [[RLE90]]
 +
* [[Shannon–Fano coding]]
 +
* [[Snappy]] (Google-created compression also used by Apple in iWork formats)
 +
* [[zlib]]
 +
* [[Zstandard]] (Zstd)
 +
** [[Zstandard dictionary]]
 +
 +
=== Graphics compression ===
 +
See [[Graphics#Compression]] for compression formats used primarily with graphics.
 +
 +
== Specific file formats/programs ==
 +
 +
(multi-file compressors are in [[Archiving]])
 +
 +
* [[9CDR]] (Amiga FileImploder Clone)
 +
* [[BARF]] (.x, .x??)
 +
* [[bzip]] (.bz)
 
* [[bzip2]] (.bz2)
 
* [[bzip2]] (.bz2)
* [[CCITT Group 4]]
+
* [[compress]] (.Z)
 
* [[CrLZH]] (.?y?)
 
* [[CrLZH]] (.?y?)
 +
* [[CRN]] (.crn) - compressed text files used for PC-Write manual
 
* [[Crunch]] (.?z?)
 
* [[Crunch]] (.?z?)
* [[gzip]] (.gz)
+
* [[DIET (compression)|DIET]]
 +
* [[DiskDoubler]]
 +
* [[DUPA]] (Amiga FileImploder Clone)
 
* [[Error Code Modeler]] (.ecm)
 
* [[Error Code Modeler]] (.ecm)
* [[LZIP]] (.lz)
+
* [[File Imploder]] (Amiga) (.imp)
* [[LZMA]] (.lzma)
+
* [[Freeze/Melt]] (Unix) (.F)
* [[LZOP]] (.lzop)
+
* [[gzip]] (.gz)
* [[LZW]] (.z)
+
* [[Hammer (compression)|Hammer]]
 +
* [[ICE (Michael Lamanuzzi)|ICE]] (.ice, by Michael Lamanuzzi)
 +
* [[Inflate]] (.infl) - parody format that actually increases size
 +
* [[JCalG1]] (.jc, Commodore Amiga)
 +
* [[lrzip]] (.lrz)
 +
* [[Lzip]] (.lz)
 +
* [[LZMA Alone|LZMA_Alone]] (.lzma)
 +
* [[lzop]] (.lzo)
 +
* [[LZX]]
 +
* [[Mozilla LZ4]] (.jsonlz4)
 +
* [[MS-DOS installation compression]] (.??_)
 +
* [[Oodle Data Compression]]
 +
* [[pack]] (.z)
 +
* [[Pack-Ice]]
 +
* [[PowerPacker]] (.pp)
 +
* [[Pro-Pack]]
 +
* [[RK]] (WinRK)
 +
* [[rzip]] (.rz)
 +
* [[SHARC]] (density)
 
* [[Softdisk Text Compressor]] (.ctx)
 
* [[Softdisk Text Compressor]] (.ctx)
 
* [[Squash (RISC OS)|Squash]] - single file compression on RISC OS
 
* [[Squash (RISC OS)|Squash]] - single file compression on RISC OS
* [[Squeeze/SQ]] (.?q?)
+
* [[Squeeze|Squeeze/SQ]] (.?q?)
 +
* [[TTComp archive]]
 +
* [[tzip]]
 +
* [[Tzip (Text ZIP)]]
 +
* [[WWPACK]]
 +
* [[XPACK]]
 
* [[XZ]] (.xz)
 
* [[XZ]] (.xz)
 +
* [[Yaz0]]
 +
 +
== Executable compression ==
 +
 +
See [[Executable compression]].
  
 
== See also ==
 
== See also ==
  
* [[Archiving]]
+
* [[Compression research]]
 +
* [[Archiving]] (for formats that place multiple files together in one file, with or without compression)
 +
* [[Graphics#Compression|Graphics]] (for image-specific compression)
 +
* [[Video]] (for video-specific compression)
 +
* [[Audio and Music]] (for audio-specific compression)
 +
 
 +
== Links ==
 +
* [http://boingboing.net/2014/03/04/data-compression-with-playing.html Data-compression with playing cards]
 +
* [http://www.quora.com/What-is-the-most-compressed-file-ever/answer/Kelly-Martin?srid=uejz&share=1 What is the most compressed file ever?]
 +
* [http://ieeeghn.org/wiki/index.php/History_of_Lossless_Data_Compression_Algorithms History of Lossless Data Compression Algorithms]

Latest revision as of 20:15, 9 October 2019

File Format
Name Compression
Ontology

{{{caption}}}

Contents

[edit] Stream compression formats

A stream format takes a stream of bytes, and outputs a different, hopefully smaller, stream of bytes. These compression formats are often used internally in other data structures to compress data, as well as in network protocols, such as http. Used stand-alone, a stream compression format does not offer archiving capability, however in the UNIX doctrine, an archiver like tar can be combined with an archive format to produce a proper compressed archive.

[edit] Compression algorithms and compressed data formats

(excluding formats usually used as file formats)

[edit] Graphics compression

See Graphics#Compression for compression formats used primarily with graphics.

[edit] Specific file formats/programs

(multi-file compressors are in Archiving)

[edit] Executable compression

See Executable compression.

[edit] See also

[edit] Links

Personal tools
Namespaces

Variants
Actions
Navigation
Toolbox