Compression

From Just Solve the File Format Problem
(Difference between revisions)
Jump to: navigation, search
(Specific formats/programs: added 7z)
(Specific file formats/programs)
(41 intermediate revisions by 3 users not shown)
Line 2: Line 2:
 
|formattype=electronic
 
|formattype=electronic
 
|thiscat=Compression
 
|thiscat=Compression
 +
|image=Vise.png
 
}}
 
}}
  
Line 8: Line 9:
 
A stream format takes a stream of bytes, and outputs a different, hopefully smaller, stream of bytes. These compression formats are often used internally in other data structures to compress data, as well as in network protocols, such as http. Used stand-alone, a stream compression format does not offer archiving capability, however in the UNIX doctrine, an archiver like [[tar]] can be combined with an archive format to produce a proper compressed archive.
 
A stream format takes a stream of bytes, and outputs a different, hopefully smaller, stream of bytes. These compression formats are often used internally in other data structures to compress data, as well as in network protocols, such as http. Used stand-alone, a stream compression format does not offer archiving capability, however in the UNIX doctrine, an archiver like [[tar]] can be combined with an archive format to produce a proper compressed archive.
  
== Compression schemes used in multiple formats ==
+
== Compression algorithms and compressed data formats ==
  
* [[Huffman encoding]]
+
(excluding formats usually used as file formats)
* [[Lempel-Zev]]
+
 
 +
* [[Arithmetic coding]]
 +
* [[Brotli]]
 +
* [[Burrows–Wheeler transform]]
 +
* [[DEFLATE]]
 +
* [[Huffman coding]]
 +
* [[LZ4]]
 +
* [[LZ77]]
 +
* [[LZ78]]
 +
* [[LZFSE]]
 +
* [[LZHAM]]
 +
* [[LZMA]]
 +
* [[LZMA2]]
 +
* [[LZO]] (Lempel–Ziv–Oberhumer)
 +
* [[LZSS]] (Lempel–Ziv–Storer–Szymanski)
 
* [[LZW]]
 
* [[LZW]]
 +
* [[PPMd]]
 +
* [[Run-length encoding]]
 +
* [[Shannon–Fano coding]]
 +
* [[Snappy]] (Google-created compression also used by Apple in iWork formats)
 +
* [[zlib]]
 +
* [[Zstandard]] (Zstd)
 +
 +
=== Graphics compression ===
 +
See [[Graphics#Compression]] for compression formats used primarily with graphics.
 +
 +
== Specific file formats/programs ==
  
== Specific formats/programs ==
+
(multi-file compressors are in [[Archiving]])
  
 
* [[7z]]  
 
* [[7z]]  
 
* [[9CDR]] (Amiga FileImploder Clone)
 
* [[9CDR]] (Amiga FileImploder Clone)
 
* [[BARF]] (.x, .x??)
 
* [[BARF]] (.x, .x??)
 +
* [[bzip]] (.bz)
 
* [[bzip2]] (.bz2)
 
* [[bzip2]] (.bz2)
* [[CCITT Group 4]]
+
* [[compress]] (.Z)
 
* [[CrLZH]] (.?y?)
 
* [[CrLZH]] (.?y?)
 
* [[CRN]] (.crn) - compressed text files used for PC-Write manual
 
* [[CRN]] (.crn) - compressed text files used for PC-Write manual
Line 30: Line 57:
 
* [[Freeze/Melt]] (Unix) (.F)
 
* [[Freeze/Melt]] (Unix) (.F)
 
* [[gzip]] (.gz)
 
* [[gzip]] (.gz)
 +
* [[Inflate]] (.infl) - parody format that actually increases size
 
* [[JCalG1]] (.jc, Commodore Amiga)
 
* [[JCalG1]] (.jc, Commodore Amiga)
* [[LZIP]] (.lz)
+
* [[lrzip]] (.lrz)
* [[LZMA]] (.lzma)
+
* [[Lzip]] (.lz)
* [[LZOP]] (.lzop)
+
* [[LZMA Alone|LZMA_Alone]] (.lzma)
 +
* [[lzop]] (.lzo)
 +
* [[LZX]]
 +
* [[MS-DOS installation compression]] (.??_)
 +
* [[Oodle Data Compression]]
 
* [[pack]] (.z)
 
* [[pack]] (.z)
 +
* [[Pack-Ice]]
 +
* [[PowerPacker]] (.pp)
 +
* [[Pro-Pack]]
 
* [[RK]] (WinRK)
 
* [[RK]] (WinRK)
 +
* [[rzip]] (.rz)
 +
* [[SHARC]] (density)
 
* [[Softdisk Text Compressor]] (.ctx)
 
* [[Softdisk Text Compressor]] (.ctx)
 
* [[Squash (RISC OS)|Squash]] - single file compression on RISC OS
 
* [[Squash (RISC OS)|Squash]] - single file compression on RISC OS
 
* [[Squeeze|Squeeze/SQ]] (.?q?)
 
* [[Squeeze|Squeeze/SQ]] (.?q?)
 +
* [[TTComp archive]]
 +
* [[tzip]]
 +
* [[Tzip (Text ZIP)]]
 
* [[XZ]] (.xz)
 
* [[XZ]] (.xz)
  
 
== See also ==
 
== See also ==
  
 +
* [[Compression research]]
 
* [[Archiving]] (for formats that place multiple files together in one file, with or without compression)
 
* [[Archiving]] (for formats that place multiple files together in one file, with or without compression)
 +
* [[Graphics#Compression|Graphics]] (for image-specific compression)
 +
* [[Video]] (for video-specific compression)
 +
* [[Audio and Music]] (for audio-specific compression)
 +
* [[Executables#Executable compression|Executables]] (for executable-specific compression)
 +
 +
== Links ==
 +
* [http://boingboing.net/2014/03/04/data-compression-with-playing.html Data-compression with playing cards]
 +
* [http://www.quora.com/What-is-the-most-compressed-file-ever/answer/Kelly-Martin?srid=uejz&share=1 What is the most compressed file ever?]
 +
* [http://ieeeghn.org/wiki/index.php/History_of_Lossless_Data_Compression_Algorithms History of Lossless Data Compression Algorithms]

Revision as of 10:13, 10 October 2017

File Format
Name Compression
Ontology

{{{caption}}}

Contents

Stream compression formats

A stream format takes a stream of bytes, and outputs a different, hopefully smaller, stream of bytes. These compression formats are often used internally in other data structures to compress data, as well as in network protocols, such as http. Used stand-alone, a stream compression format does not offer archiving capability, however in the UNIX doctrine, an archiver like tar can be combined with an archive format to produce a proper compressed archive.

Compression algorithms and compressed data formats

(excluding formats usually used as file formats)

Graphics compression

See Graphics#Compression for compression formats used primarily with graphics.

Specific file formats/programs

(multi-file compressors are in Archiving)

See also

Links

Personal tools
Namespaces

Variants
Actions
Navigation
Toolbox