View source for ZIP

:''Not to be confused with [[Zip disk]], an unrelated disk cartridge unit.''
{{FormatInfo
|formattype=electronic
|subcat=Archiving
|extensions={{ext|zip}}
|mimetypes={{mimetype|application/zip}}
|uniform type={{UTI|com.pkware.zip-archive}}
|locfdd={{LoCFDD|fdd000354}}, {{LoCFDD|fdd000355}}, {{LoCFDD|fdd000362}}, {{LoCFDD|fdd000361}}
|pronom={{PRONOM|x-fmt/263}}
|wikidata={{wikidata|Q136218}}
|kaitai struct=zip
|released=1989
}}
'''ZIP''' is one of the most popular file compression formats. It was created in 1989 as the native format of the PKZIP program, which was introduced by Phil Katz (with co-creator Gary Conway) in the wake of a lawsuit (which he lost) against him by the makers of the then-popular [[ARC (compression format)|ARC]] program (and file format) for copyright and trademark infringement in an earlier program PKARC which had been file-compatible with ARC.  This resulted in Katz creating a new file format, which rapidly overtook ARC in popularity (to a large extent because of BBS sysops, then the primary users of such compression, resenting the lawsuit). Many programs have been released for a variety of operating systems to compress and decompress ZIP files, and native support for the format is built into several popular operating systems.

ZIP implementations vary in their support for features in the specification from PKWARE<ref>http://www.pkware.com/documents/casestudies/APPNOTE.TXT</ref>, particularly features added since version 2 (1993), some of which are protected by patents and require licensing.  Many implementations limit the use of compression to the [[DEFLATE]] algorithm, introduced with version 2. Extensions incorporated into the specification that have been widely adopted are: long filenames; large files (using a technique known as ZIP64); and filenames in [[UTF-8]].  In 2011 work began on an interoperable subset of the latest APPNOTE.TXT with the intention of publication as ISO/IEC 21320-1, Document Container File -- Part 1: Core.  As of November 2012, a discussion draft is available<ref>http://kikaku.itscj.ipsj.or.jp/sc34/open/1855.pdf</ref>.  Designed to promote interoperable implementations, the draft ISO/IEC 21320-1 prohibits compression other than using [[DEFLATE]], segmentation or multiple volumes, and features that are subject to patents.

While .zip is the usual file extension, ZIP-formatted files can be found with many other extensions since a number of other file formats use ZIP compression but store their files in application-specific extensions. See [[:Category:ZIP based file formats]] for a list of such formats.

== See also ==
* [[PKLITE]]
* [[Self-extracting ZIP]]
* [[Zipx]]

== Disambiguation ==
The term "ZIP compression" is sometimes misleadingly used to mean [[DEFLATE]] (which is by far the most common compression scheme used in ZIP files). In such cases, the compressed data format could turn out to be raw [[DEFLATE]], or [[zlib]], or [[gzip]].

== Identification ==
The byte sequence <code>'P' 'K' 0x05 0x06</code> (the "end of central directory signature") appears somewhere in the file, usually beginning exactly 22 bytes from the end of the file. However, it will appear earlier if the file contains a "ZIP file comment" (common in the BBS era, but rare today), or for various other reasons. There seems to be no theoretical limit to how far back you may have to search for the signature, but some software limits it to around 64KB, which is the maximum length of a comment.

Most ZIP files (but not [[self-extracting ZIP]] files) happen to begin with <code>'P' 'K' 0x03 0x04</code>. This is not a global file signature, but is the signature that appears once for every compressed file inside the ZIP file. Some ZIP-based formats are designed such that they necessarily begin in this way. But in general, it is even legal for a ZIP file to contain zero files, and such a ZIP file would not contain this signature at all.

That Phil Katz guy has thus managed to get his initials at the start of a large number of files on many millions of computers and devices, given how many file formats are based on ZIP (even if they use different extensions). He died in 2000, but this memorial to him will live on indefinitely.

== Compression ==
Each file in a ZIP file is compressed using one of a number of compression algorithms. Only compression types 0 (uncompressed) and 8 (DEFLATE) are likely to be seen in modern portable ZIP files. In old ZIP files, types 1 (Shrink) and 6 (Implode) are common.

{| class="wikitable"
! Code
! Compression scheme
! Notes and references
|-
|0 || Uncompressed
|-
|1 || Shrink || [[LZW]]. Used by PKZIP 0.x and 1.x.
|-
|2–5 || Reduce || [[LZ77]] + prediction. Used by PKZIP v0.x. See also [[SCRNCH]].
|-
|6 || Implode || [[LZ77]] + [[Huffman coding|Huffman]]. Used by PKZIP v1.x.
|-
|7 || Tokenized || Never used?
|-
|8 || [[DEFLATE]] || [[LZ77]] + [[Huffman coding|Huffman]]. Used by PKZIP v2.0+.
|-
|9 || Deflate64, a.k.a. Enhanced Deflate || Format version 2.1+.
|-
|10 || [[PKWARE DCL Implode]] (old IBM TERSE) || Format version 2.5+.
|-
|12 || [[Bzip2]] || Format version 4.6+.
|-
|14 || [[LZMA]] (EFS) || Defined in ZIP specification v6.3+.
|-
|16 || IBM z/OS CMPSC
|-
|18 || IBM [[TERSE]] (new)
|-
|19 || IBM LZ77 z Architecture (PFS)
|-
|94 || [[MP3]] || Supported by WinZip 21+.
|-
|95 || [[XZ]] || Supported by WinZip 18+.
|-
|96 || [[JPEG]] variant
|-
|97 || [[WavPack]] || Defined in ZIP specification v6.3.2+.
|-
|98 || [[PPMd]] version I, Rev 1 || Defined in ZIP specification v6.3+.
|-
|99 || AES / AE-x encryption marker
|}

== Extensible data fields ==
Each member file of a ZIP file may have one or more ''extensible data fields'' (or ''extra fields''), containing arbitrary data. Each field is tagged with a 16-bit identifier. Extra fields are normally used for platform-specific or filesystem-specific metadata, or to work around limitations of the original ZIP format. They are not normally used for application-specific data.

Most of the extra fields in use are documented in the ZIP "APPNOTE" specification, or by the Info-ZIP software (e.g. the proginfo/extrafld.txt file in the Zip program's source distribution).

=== Known extensible data fields ===
{| class="wikitable"
!ID !! Owner !! Description !! Reference (identification) !! Reference (details)
|-
|0x0001 || PKWARE || Zip64 extended information || APPNOTE || APPNOTE, Info-ZIP
|-
|0x0007 || PKWARE || AV Info || APPNOTE ||
|-
|0x0008 || PKWARE || Reserved for extended language encoding data (PFS) || APPNOTE ||
|-
|0x0009 || PKWARE || OS/2 || APPNOTE || APPNOTE, Info-ZIP
|-
|0x000a || PKWARE || NTFS  || APPNOTE || APPNOTE, Info-ZIP
|-
|0x000c || PKWARE || OpenVMS || APPNOTE || APPNOTE, Info-ZIP
|-
|0x000d || PKWARE || UNIX || APPNOTE || APPNOTE, Info-ZIP
|-
|0x000e || PKWARE || Reserved for file stream and fork descriptors || APPNOTE ||
|-
|0x000f || PKWARE || Patch Descriptor || APPNOTE || APPNOTE, Info-ZIP
|-
|0x0014 || PKWARE || PKCS#7 Store for X.509 Certificates || APPNOTE || APPNOTE, Info-ZIP
|-
|0x0015 || PKWARE || X.509 Certificate ID and Signature for individual file || APPNOTE || APPNOTE, Info-ZIP
|-
|0x0016 || PKWARE || X.509 Certificate ID for Central Directory || APPNOTE || APPNOTE, Info-ZIP
|-
|0x0017 || PKWARE || Strong Encryption Header || APPNOTE || APPNOTE
|-
|0x0018 || PKWARE || Record Management Controls || APPNOTE || APPNOTE
|-
|0x0019 || PKWARE || PKCS#7 Encryption Recipient Certificate List || APPNOTE || APPNOTE
|-
|0x0020 || PKWARE || Reserved for Timestamp || APPNOTE ||
|-
|0x0021 || PKWARE || Policy Decryption Key || APPNOTE || APPNOTE
|-
|0x0022 || PKWARE || Smartcrypt Key Provider || APPNOTE || APPNOTE
|-
|0x0023 || PKWARE || Smartcrypt Policy Key Data || APPNOTE || APPNOTE
|-
|rowspan="2"|0x0065 || PKWARE || MVS / IBM S/390 (Z390) attributes - uncompressed || APPNOTE || APPNOTE
|-
|PKWARE || OS/400 / AS/400 (I400) attributes - uncompressed || APPNOTE || APPNOTE
|-
|0x0066 || PKWARE || Reserved for IBM S/390 (Z390), AS/400 (I400) attributes - compressed || APPNOTE ||
|-
|0x07c8 || || Macintosh (Info-ZIP Macintosh, old) || APPNOTE || Info-ZIP
|-
|0x2605 || || ZipIt Macintosh || APPNOTE || APPNOTE, Info-ZIP
|-
|0x2705 || || ZipIt Macintosh 1.3.5+ (w/o full filename) || APPNOTE || APPNOTE, Info-ZIP
|-
|0x2805 || || ZipIt Macintosh 1.3.5+ || APPNOTE || APPNOTE
|-
|0x334d "<code>M3</code>" || || Info-ZIP Macintosh || APPNOTE || Info-ZIP
|-
|0x4154 "<code>TA</code>" || || Tandem NSK || Info-ZIP || Info-ZIP
|-
|0x4341 "<code>AC</code>" || || Acorn/SparkFS || APPNOTE || Info-ZIP
|-
|0x4453 "<code>SE</code>" || || Windows NT security descriptor (binary ACL) || APPNOTE || Info-ZIP
|-
|0x4690 || PKWARE || POSZIP 4690 (reserved) || APPNOTE ||
|-
|0x4704 || || VM/CMS || APPNOTE || Info-ZIP
|-
|0x470f || || MVS || APPNOTE || Info-ZIP
|-
|0x4854 "<code>TH</code>" || || Theos (old) || Info-ZIP || Info-ZIP
|-
|0x4b46 "<code>FK</code>" || || FWKCS MD5 || APPNOTE || APPNOTE, Info-ZIP
|-
|0x4c41 "<code>AL</code>" || || OS/2 access control list (text ACL) || APPNOTE || Info-ZIP
|-
|0x4d49 "<code>IM</code>" || || Info-ZIP OpenVMS || APPNOTE || Info-ZIP
|-
|0x4d63 "<code>cM</code>" || || Macintosh SmartZIP || Info-ZIP || Info-ZIP
|-
|0x4f4c "<code>LO</code>" || || Xceed original location || APPNOTE ||
|-
|0x5350 "<code>PS</code>" || || (Observed in some Psion files.) || ||
|-
|0x5356 "<code>VS</code>" || || AOS/VS (binary ACL) || APPNOTE || Info-ZIP
|-
|0x5455 "<code>UT</code>" || || Extended timestamp || APPNOTE || Info-ZIP
|-
|0x554e "<code>NU</code>" || || Xceed unicode || APPNOTE ||
|-
|0x5855 "<code>UX</code>" || || Info-ZIP UNIX (original, also OS/2, NT, etc.) || APPNOTE || Info-ZIP
|-
|0x6375 "<code>uc</code>" || || Info-ZIP Unicode Comment || APPNOTE || APPNOTE, Info-ZIP
|-
|0x6542 "<code>Be</code>" || || BeOS (BeBox, PowerMac, etc.) || APPNOTE || Info-ZIP
|-
|0x6854 "<code>Th</code>" || || Theos || Info-ZIP || Info-ZIP
|-
|0x7075 "<code>up</code>" || || Info-ZIP Unicode Path || APPNOTE || APPNOTE, Info-ZIP
|-
|0x7441 "<code>At</code>" || || AtheOS || Old Info-ZIP || Old Info-ZIP (e.g. zip v2.32 [ftp://ftp.info-zip.org/pub/infozip/src/zip232.tgz])
|-
|0x756e "<code>nu</code>" || || ASi UNIX || APPNOTE || Info-ZIP
|-
|0x7855 "<code>Ux</code>" || || Info-ZIP Unix (previous new) || APPNOTE || Info-ZIP
|-
|0x7875 "<code>ux</code>" || || Info-ZIP Unix (new) || Info-ZIP || Info-ZIP
|-
|0xa220 || || Microsoft Open Packaging Growth Hint || APPNOTE || APPNOTE
|-
|0xfb4a || || SMS/QDOS || Info-ZIP || Info-ZIP
|-
|0xfd4a || || SMS/QDOS || APPNOTE ||
|}

== Specifications ==
* APPNOTEs - The format documentation from PKWARE is traditionally in a file named APPNOTE.TXT.
** [http://www.pkware.com/documents/casestudies/APPNOTE.TXT APPNOTE from PKWARE] (latest version of formal spec)
** [https://support.pkware.com/display/PKZIP/Application+Note+Archives APPNOTE Archives from PKWARE] (selected versions all the way back to 1.0)
** [ftp://ftp.info-zip.org/pub/infozip/doc/ Documentation from Info-ZIP] (Includes Info-ZIP variants on APPNOTE.TXT dated from 1996 to 2004, specifications used as the basis for various open-source tools)
** [https://www.loc.gov/preservation/digital/formats/digformatspecs/ LoC archive]
** [http://www.textfiles.com/programming/FORMATS/appnote.hac An early version of APPNOTE] (apparently from PKZIP v1.10)
** {{CdTextfiles|simtel/simtel20/MSDOS/ZIP/APPNOTE.ZIP|APPNOTE.ZIP}} - Possibly the first v2.x APPNOTE
** [https://web.archive.org/web/20040819182806/http://www.pkware.com/company/standards/appnote/ APPNOTE v6.1.0], from archive.org
** Bundled with PKZIP software through v1.93 - refer to the [[#Software]] section below.
* [http://www.iana.org/assignments/media-types/application/zip IANA registration for application/zip in July 1993] (corresponds to version 2 of APPNOTE.TXT)
* [http://kikaku.itscj.ipsj.or.jp/sc34/open/1855.pdf November 2012 working draft of ISO/IEC WD 21320-1, Document Container File -- Part 1: Core] Intended as restricted subset of APPNOTE 6.3.3 designed to promote interoperability.
* [http://kikaku.itscj.ipsj.or.jp/sc34/open/1886.pdf February 2013 committee draft of ISO/IEC CD 21320-1, Document Container File -- Part 1: Core] Essentially the same as November 2012 working draft except that it mandates use of the UTF-8 indicator.
* [http://apple2.org.za/gswv/a2zine/GS.WorldView/Resources/The.MacShrinkIt.Project/ARCHIVES.TXT Archive format info, including ZIP] (from 1989, when ZIP was newly released)
* [http://www.textfiles.com/programming/FORMATS/arc_fmts.txt ZIP file header format (among other archive types)]
* [http://rescene.wikidot.com/torrentzip TorrentZip]
* Note that in general there is [https://twitter.com/tef/status/436555938879655937 no official file name encoding for ZIP files], and non ASCII filenames [http://stackoverflow.com/questions/106367/add-non-ascii-file-names-to-zip-in-java are not generally well supported]. The original implementation specified [[CP437|IBM Code Page 437]] for filenames, but as many characters cannot be expressed in that encoding, the filename bytes have often been interpreted using the current system codepage (implementation dependent behaviour). There is a flag to specify [[UTF-8]] as the encoding, but it is not supported in all major clients (e.g. Windows Explorer).
* [http://www.opensource.apple.com/source/zip/zip-6/unzip/unzip/proginfo/extra.fld Info-ZIP's "extra fields" documentation]

== Metaformat files ==

* {{Synalysis|zip}}

== Software ==
* [http://www.info-zip.org Info-ZIP]: [http://www.info-zip.org/Zip.html Zip], [http://www.info-zip.org/UnZip.html UnZip]
* [[7-Zip]]
* [[zlib]] - The zlib library does not support ZIP format, but it is distributed with "minizip" code that supports most ZIP files.
* [http://www.nih.at/libzip/ libzip] - Uses zlib.
* [http://www.libarchive.org libarchive] - Uses zlib.
* [http://zziplib.sourceforge.net zziplib]
** [http://search.cpan.org/~vspader/Archive-ZZip-0.13/ZZip/ZZip.pm Archive::ZZip]: Perl bindings for zziplib
* [https://github.com/richgel999/miniz miniz]
* PKZIP
** For DOS: {{CdTextfiles|swinnund/disk3/FILEUTIL/PKZ080.ZIP|0.80-beta}} · {{CdTextfiles|rbbsv3n1/pool/pkz090.exe|0.90}} · {{CdTextfiles|rbbsv3n1/pool/pkz092.exe|0.92}} · {{CdTextfiles|rbbsv3n1/pool/pkz101.exe|1.01}} · {{CdTextfiles|rbbsv3n1/pool/pkz102.exe|1.02}} · '''{{CdTextfiles|rbbsv3n1/pool/pkz110.exe|1.10}}''' · {{CdTextfiles|somuch/smsharew2/UTIL2/PKZ193A.EXE|1.93-alpha}} · {{CdTextfiles|20mnn/ARCHIVE/PKZ204C.EXE|2.04c}} · {{CdTextfiles|megmonster/ARCHIVE/PKZ204E.EXE|2.04e}} · '''{{CdTextfiles|simtel/simtel20/MSDOS/ZIP/PKZ204G.EXE|2.04g}}''' · {{CdTextfiles|simtel/simtel0101/simtel/arcers/pk250dos.exe|2.50}}
* [[Konvertor]]
* {{Deark}} (for analysis, or converting old compression methods)

== Sample files ==
* https://github.com/corkami/pocs/tree/master/zip
* Examples that use the uncommon "Reduce" compression scheme: {{CdTextfiles|ccbwindows93/CORELDRA/VISA_CRD.ZIP|VISA_CRD.ZIP}}, {{CdTextfiles|librisbritannia/GRAPHICS/CLIPMAC/1608A.ZIP|1608A.ZIP}} → D1-MAC.ZIP
* https://telparia.com/fileFormatSamples/archive/zip/ → *.zip

== Links ==
* [[Wikipedia:Zip (file format)|Wikipedia: Zip (file format)]]
* [[Wikipedia:PKZIP|Wikipedia: PKZIP]]
* [http://research.swtch.com/zip Zip files all the way down] (creating an infinitely-regressed ZIP file)
* [http://imgur.com/a/PbN8H#1 ZIP101 an archive walkthrough]
* [http://literarymachin.es/deepzoom-osd-server/ Serve deepzoom images from a zip archive with openseadragon]
* [https://stackoverflow.com/questions/20762094/how-are-zlib-gzip-and-zip-related-what-do-they-have-in-common-and-how-are-they/20765054#20765054 How are zlib, gzip and Zip related? What do they have in common and how are they different?] - Response to StackOverflow question by zlib/gzip co-creator Mark Adler
* [https://www.bitsgalore.org/2020/03/11/does-microsoft-onedrive-export-large-ZIP-files-that-are-corrupt Does Microsoft OneDrive export large ZIP files that are corrupt?] - Discusses an issue where large ZIP files generated by Microsoft OneDrive result in read errors when they are opened with tools like Info-Zip and 7-Zip
* [https://blog.archive.org/2019/02/13/zip-is-broken-except-its-not-except-it-is/ ZIP is Broken, Except it’s Not, Except it Is]

== References ==
<references/>

[[Category:Compression]]
[[Category:Metaformats]]
[[Category:ZIP based file formats]]
[[Category:PKWARE]]