LHA

From Just Solve the File Format Problem
(Difference between revisions)
Jump to: navigation, search
(Compression schemes)
(Compression schemes: Added table of "other" identifiers)
(16 intermediate revisions by 2 users not shown)
Line 12: Line 12:
 
It was particularly popular in Japan. Most of the best information about it is in Japanese.
 
It was particularly popular in Japan. Most of the best information about it is in Japanese.
  
It supports a number of different compression schemes, most of which use [[LZ77]] combined with [[Huffman coding]].
+
It supports a number of different compression schemes, most of which use [[LZ77 with Huffman coding|LZ77 combined with Huffman coding]].
  
 
The file format is also known as '''LZH'''. See the [[LZH|LZH disambiguation page]] for other "LZH" formats.
 
The file format is also known as '''LZH'''. See the [[LZH|LZH disambiguation page]] for other "LZH" formats.
 +
 +
This article covers the format used by LHarc/LHA, as well as "generalized" LHA format: the same file format, but with other compression schemes. The generalized format was possibly designed by Kazuhiko Miki in 1988 for the LArc software, but confirmation of this is needed. If so, it was soon borrowed by LHarc, with new compression schemes.
  
 
== Format details ==
 
== Format details ==
An LHA file consists of a sequence of elements, each representing a member file or directory. There is no global archive-level header.
+
=== File structure ===
 +
An LHA file consists mainly of a sequence of elements, each representing a member file or directory. The sequence is usually terminated by an end-of-archive marker consisting of a single 0x00 byte (but take care, as level 2 headers could start with 0x00). There is no global archive-level header.
  
There are at least four different formats that an element can have. (Note that this is independent of compression schemes.) In LHA jargon, the formats are known as "header levels", and are usually called "header level 0", "... 1", "... 2", and "... 3".
+
=== Member format ===
 +
There are at least four different formats that an element can have. (Note that this is independent of compression schemes.) In LHA jargon, the formats are known as "header levels", and are usually called "header level 0", "... 1", "... 2", and "... 3". The header level is determined by the byte at offset 20 from the beginning of that element.
  
The format of an element is determined by the byte at offset 20 from the beginning of that element. It is possible for different formats to be used in the same LHA file.
+
The header levels are similar, but irritatingly different. They don't even follow the same principles with respect to how they must be parsed.
  
The formats are similar, but irritatingly different. They don't even follow the same principles with respect to how they must be parsed.
+
=== LZH compression overview ===
 +
From a decompression perspective, the LZ77+Huffman schemes work roughly as follows. (This is oversimplified.) There is a ''codes'' Huffman tree, and a separate ''offsets'' tree. A symbol is read using the codes tree which, depending on its value, represents either a literal byte value, or a ''length''. If it is a length, then an additional symbol is read using the offsets tree. Based on the offset and length, a run of recently-decompressed bytes is repeated.
  
 
=== Compression schemes ===
 
=== Compression schemes ===
The compression scheme of an element is identified by the alphanumeric bytes of its ''compression method'' field. Known compression schemes:
+
Each member file has a 5-byte ''compression method'' field, composed of ASCII characters. The first and last characters are virtually always dashes ("<code>-</code>"), and might be left off when discussing LHA compression schemes. Known schemes:
  
 
{| class="wikitable"
 
{| class="wikitable"
 
! ID !! Category !! Description and remarks
 
! ID !! Category !! Description and remarks
 
|-
 
|-
|<code>lh0</code> || || Uncompressed
+
|<code>-lh0-</code> || || Uncompressed
 
|-
 
|-
|<code>lh1</code> || || LZ77+Huffman, 4k window, dynamic Huffman for ''codes'' (a code can be a literal or a length, depending on its value), offsets use a pre-defined Huffman tree.
+
|<code>-lh1-</code> || || [[LZ77 with Huffman coding|LZ77+Huffman]], 4k window, [[Adaptive Huffman coding|adaptive Huffman]] for codes, offsets use a pre-defined Huffman tree.
 
|-
 
|-
|<code>lh2</code> || || LZ77+Huffman, 8k window, dynamic Huffman for codes and offsets. Considered obsolete.
+
|<code>-lh2-</code> || || LZ77+Huffman, 8k window, adaptive Huffman. Considered obsolete.
 
|-
 
|-
|<code>lh3</code> || || LZ77+Huffman, 8k window, static Huffman for codes, offsets can use static Huffman or a pre-defined Huffman tree. Considered obsolete.
+
|<code>-lh3-</code> || || LZ77+Huffman, 8k window, segmented, static Huffman for codes, offsets can use static Huffman or a pre-defined Huffman tree. Considered obsolete.
 
|-
 
|-
|<code>lh4</code> || || Like lh5, but 4k window
+
|<code>-lh4-</code> || || Like lh5, but 4k window. Rare.
 
|-
 
|-
|<code>lh5</code> || || LZ77+Huffman, 8k window, static Huffman for codes and offsets
+
|<code>-lh5-</code> || || [[LZ77 with Huffman coding|LZ77+Huffman]], 8k window, segmented, static Huffman
 
|-
 
|-
|<code>lh6</code> || || Like lh5, but 32k window
+
|<code>-lh6-</code> || || Like lh5, but 32k window
 
|-
 
|-
|<code>lh7</code> || || Like lh5, but 64k window
+
|<code>-lh7-</code> || || Like lh5, but 64k window
 
|-
 
|-
|<code>lh8</code> ||rowspan="5"| Joe Jared extensions || Same as lh7.
+
|<code>-lh7-</code> || LHARK extension || Refer to [[LHARK]].
 
|-
 
|-
|<code>lh9</code> || Like lh5, but 128k window. Probably never used.
+
|<code>-lh8-</code> ||rowspan="5"| Joe Jared extensions || Like lh5, but 64k window. (Same as lh7.)
 
|-
 
|-
|<code>lha</code> || Like lh5, but 256k window. Probably never used.
+
|<code>-lh9-</code> || Like lh5, but 128k window. Probably never used.
 
|-
 
|-
|<code>lhb</code> || Like lh5, but 512k window. Probably never used.
+
|<code>-lha-</code> || Like lh5, but 256k window. Probably never used.
 
|-
 
|-
|<code>lhc</code> || Like lh5, but 1M window. Probably never used.
+
|<code>-lhb-</code> || Like lh5, but 512k window. Probably never used.
 
|-
 
|-
|<code>lhd</code> || Special || Not a compression scheme. Indicates that the element represents a subdirectory.
+
|<code>-lhc-</code> || Like lh5, but 1M window. Probably never used.
 
|-
 
|-
|<code>lhe</code> || Joe Jared extensions || Like lh5, but 2M window. Probably never used.
+
|<code>-lhd-</code> || Special || Not a compression scheme. Indicates that the element represents a subdirectory.
 
|-
 
|-
|<code>lhx</code> || UNLHA32 extension ||  
+
|<code>-lhe-</code> || Joe Jared extensions || Like lh5, but 2M window. Probably never used.
 
|-
 
|-
|<code>lz2</code> ||rowspan="7"| LArc extensions ||  
+
|<code>-lhx-</code> ||rowspan="2"| UNLHA32 extensions ||  
 
|-
 
|-
|<code>lz3</code> ||  
+
|<code>-lx1-</code> ||  
 
|-
 
|-
|<code>lz4</code> || Uncompressed
+
|<code>-lz2-</code> ||rowspan="7"| LArc methods ||
 
|-
 
|-
|<code>lz5</code> || LZ77/[[LZSS]], 4k window. Almost identical to "SZDD" used in [[MS-DOS installation compression]].
+
|<code>-lz3-</code> ||  
 
|-
 
|-
|<code>lz7</code> ||  
+
|<code>-lz4-</code> || Uncompressed
 
|-
 
|-
|<code>lz8</code> ||  
+
|<code>-lz5-</code> || LZ77/[[LZSS]], 4k window. Almost identical to "SZDD" used in [[MS-DOS installation compression]].
 
|-
 
|-
|<code>lzs</code> || LZ77/[[LZSS]], 2k window
+
|<code>-lz7-</code> ||  
 
|-
 
|-
|<code>lZ0</code> ||rowspan="3"| PUT/GET variants ||rowspan="3"| Refer to [[PUT]].
+
|<code>-lz8-</code> ||  
 
|-
 
|-
|<code>lZ1</code>
+
|<code>-lzs-</code> || LZ77/[[LZSS]], 2k window
 
|-
 
|-
|<code>lZ5</code>
+
|<code>-pc1-</code> ||rowspan="4"| PMarc extensions ||rowspan="4"| Refer to [[PMA]].
 
|-
 
|-
|<code>pc1</code> ||rowspan="5"| PMarc extensions ||rowspan="5"| Refer to [[PMA]].
+
|<code>-pm0-</code>
 
|-
 
|-
|<code>pm0</code>
+
|<code>-pm1-</code>
 
|-
 
|-
|<code>pm1</code>
+
|<code>-pm2-</code>
 
|-
 
|-
|<code>pm2</code>
+
|<code>-ah0-</code> ||rowspan="3"| MAR extensions ||rowspan="3"| Refer to [[Micrognosis Compression Archiver]].
 
|-
 
|-
|<code>pms</code>
+
|<code>-ari-</code>
 +
|-
 +
|<code>-hf0-</code>
 +
|-
 +
|<code>-lZ0-</code> ||rowspan="3"| PUT/GET variants ||rowspan="3"| Refer to [[PUT]].
 +
|-
 +
|<code>-lZ1-</code>
 +
|-
 +
|<code>-lZ5-</code>
 +
|-
 +
|<code>␠LH0␠</code> ||rowspan="2"| SAR variants ||rowspan="2"| Refer to [[SAR (Streamline Design)]]. The compression IDs begin and end with a space (0x20).
 +
|-
 +
|<code>␠LH5␠</code>
 
|}
 
|}
  
 
The Wikipedia article has [[Wikipedia:LHA (file format)#Compression methods|more information]] about some of the schemes.
 
The Wikipedia article has [[Wikipedia:LHA (file format)#Compression methods|more information]] about some of the schemes.
 +
 +
Other LHA-like identifiers:
 +
 +
{| class="wikitable"
 +
! ID !! References and remarks
 +
|-
 +
|<code>-arn-</code> ||rowspan="2"| Possibly used by [[Micrognosis Compression Archiver]].
 +
|-
 +
|<code>-lzw-</code>
 +
|-
 +
|<code>-pms-</code> || Refer to [[PMA]].
 +
|-
 +
|<code>-sqx-</code> || Refer to [[SQX]].
 +
|-
 +
|<code>-sw1-</code> || Refer to [[SWG]].
 +
|-
 +
|<code>-TK1-</code> || Unknown. (Recognized by [[IDArc]].)
 +
|}
  
 
=== Extended headers ===
 
=== Extended headers ===
Line 107: Line 142:
  
 
== Identification ==
 
== Identification ==
Bytes {{magic|'-' 'l' ?? ?? '-'}} appear at offset 2. This is not a global file signature, but represents the compression scheme of the first member file of the archive.
+
LHA can be identified with high accuracy, but doing so can be laborious, due to the lack of a signature, and other complicating factors.
  
If you consider [[PMA]] to be a form of LHA, then the second of these bytes can also be <code>'p'</code>.
+
Identification logic could be based on the header of the first member file. Check that the compression method (offset 2–6) and header level (offset 20) fields have valid values. When suitable and possible, validate the header checksum field -- this depends on the header level.
 +
 
 +
See also the "[[#See also]]" section, for some formats that could masquerade as LHA.
  
 
== See also ==
 
== See also ==
 
* [[PMA]]
 
* [[PMA]]
 +
* [[LHARK]]
 
* [[LHice]]
 
* [[LHice]]
 +
* [[PUT]]
 +
* [[Micrognosis Compression Archiver]]
 +
* [[SAR (Streamline Design)]]
 +
 +
Other LHA-like formats to be aware of:
 +
* [[ARX]]
 +
* [[CAR (MylesHi!)]]
 +
* [[SWG]]
  
 
== Format documentation ==
 
== Format documentation ==
Line 146: Line 192:
 
*** {{CdTextfiles|simtel/simtel20/MSDOS/ARCHIVRS/LHARCSRC.ZIP|v1.13b}}
 
*** {{CdTextfiles|simtel/simtel20/MSDOS/ARCHIVRS/LHARCSRC.ZIP|v1.13b}}
 
*** {{CdTextfiles|simtel/simtel20/MSDOS/ARCHIVRS/LHA211SR.ZIP|v2.11}}
 
*** {{CdTextfiles|simtel/simtel20/MSDOS/ARCHIVRS/LHA211SR.ZIP|v2.11}}
* [http://www.manmrk.net/tutorials/compress/downloads/larc333.exe LArc v3.33] (May 19, 1989) (DOS software)
+
* [http://www.manmrk.net/tutorials/compress/downloads/larc333.exe LArc v3.33] (1989-05-19) (DOS software)
* {{CdTextfiles|sourcecode/msdos/arc_lbr/ar002.zip|ar version "002" by Haruhiko Okumura}} (1990) (DOS binary + source code)
+
* LZHUF.C - Source code related to "lh1" compression
* {{Deark}} (might be useful for analysis; doesn't decompress the format)
+
** {{CdTextfiles|powerprogramming/PROGTOOL/COMPRESS/LZHSRC10.ZIP|LZHSRC10.ZIP}} - "LZHUF.C English version 1.0 /  Based on Japanese version 29-NOV-1988 / LZSS coded by Haruhiko OKUMURA / Adaptive Huffman Coding coded by Haruyasu YOSHIZAKI / Edited and translated to English by Kenji RIKITAKE"
 +
** {{CdTextfiles|rbbsv3n1/pac4/okumura.zip|okumura.zip}}... - "lzhuf.c / written by Haruyasu Yoshizaki 11/20/1988 / some minor changes 4/6/1989 / comments translated by Haruhiko Okumura 4/7/1989"
 +
** See [http://www.svgalib.org/rus/lbrate.html lbrate] → lzhuf-post.txt for a discussion of the terms of use.
 +
* {{CdTextfiles|sourcecode/msdos/arc_lbr/ar002.zip|ar version "002" by Haruhiko Okumura}} (1990) (DOS binary + source code) - Implementation of "lh5" compression
 +
* [https://github.com/temisu/ancient Ancient] - Has modern C++ code for decompressing most LHA schemes, but as of this writing there's no easy way to use it.
 +
* {{Deark}} (might be useful for analysis; doesn't necessarily decompress the format)
  
 
== Sample files ==
 
== Sample files ==
Line 155: Line 206:
 
* [http://aminet.net/ aminet]
 
* [http://aminet.net/ aminet]
 
* {{CdTextfiles|hof91/}} ...
 
* {{CdTextfiles|hof91/}} ...
* https://telparia.com/fileFormatSamples/archive/hexify.lha
+
* https://telparia.com/fileFormatSamples/archive/lha/hexify.lha
  
 
== Other links ==
 
== Other links ==
 
* [[Wikipedia:LHA (file format)|Wikipedia article]]
 
* [[Wikipedia:LHA (file format)|Wikipedia article]]

Revision as of 14:53, 13 November 2020

File Format
Name LHA
Ontology
Extension(s) .lha, .lzh, .lzs
MIME Type(s) application/x-lzh-compressed
PRONOM fmt/626
Wikidata ID Q368782
Kaitai Struct Spec lzh.ksy
Released 1988

LHA is an archiving program and file format created by Haruyasu Yoshizaki (a.k.a. Yoshi) in 1988. It was originally called LHarc, then was briefly LH before settling on LHA. In the 1990s, it was the most popular archiving format on the Amiga platform. It also got some use on the PC platform including in the installers for id Software games such as Doom and Quake, because ZIP compression was inferior until the release of PKZIP 2.0, which brought the formats to parity.

It was particularly popular in Japan. Most of the best information about it is in Japanese.

It supports a number of different compression schemes, most of which use LZ77 combined with Huffman coding.

The file format is also known as LZH. See the LZH disambiguation page for other "LZH" formats.

This article covers the format used by LHarc/LHA, as well as "generalized" LHA format: the same file format, but with other compression schemes. The generalized format was possibly designed by Kazuhiko Miki in 1988 for the LArc software, but confirmation of this is needed. If so, it was soon borrowed by LHarc, with new compression schemes.

Contents

Format details

File structure

An LHA file consists mainly of a sequence of elements, each representing a member file or directory. The sequence is usually terminated by an end-of-archive marker consisting of a single 0x00 byte (but take care, as level 2 headers could start with 0x00). There is no global archive-level header.

Member format

There are at least four different formats that an element can have. (Note that this is independent of compression schemes.) In LHA jargon, the formats are known as "header levels", and are usually called "header level 0", "... 1", "... 2", and "... 3". The header level is determined by the byte at offset 20 from the beginning of that element.

The header levels are similar, but irritatingly different. They don't even follow the same principles with respect to how they must be parsed.

LZH compression overview

From a decompression perspective, the LZ77+Huffman schemes work roughly as follows. (This is oversimplified.) There is a codes Huffman tree, and a separate offsets tree. A symbol is read using the codes tree which, depending on its value, represents either a literal byte value, or a length. If it is a length, then an additional symbol is read using the offsets tree. Based on the offset and length, a run of recently-decompressed bytes is repeated.

Compression schemes

Each member file has a 5-byte compression method field, composed of ASCII characters. The first and last characters are virtually always dashes ("-"), and might be left off when discussing LHA compression schemes. Known schemes:

ID Category Description and remarks
-lh0- Uncompressed
-lh1- LZ77+Huffman, 4k window, adaptive Huffman for codes, offsets use a pre-defined Huffman tree.
-lh2- LZ77+Huffman, 8k window, adaptive Huffman. Considered obsolete.
-lh3- LZ77+Huffman, 8k window, segmented, static Huffman for codes, offsets can use static Huffman or a pre-defined Huffman tree. Considered obsolete.
-lh4- Like lh5, but 4k window. Rare.
-lh5- LZ77+Huffman, 8k window, segmented, static Huffman
-lh6- Like lh5, but 32k window
-lh7- Like lh5, but 64k window
-lh7- LHARK extension Refer to LHARK.
-lh8- Joe Jared extensions Like lh5, but 64k window. (Same as lh7.)
-lh9- Like lh5, but 128k window. Probably never used.
-lha- Like lh5, but 256k window. Probably never used.
-lhb- Like lh5, but 512k window. Probably never used.
-lhc- Like lh5, but 1M window. Probably never used.
-lhd- Special Not a compression scheme. Indicates that the element represents a subdirectory.
-lhe- Joe Jared extensions Like lh5, but 2M window. Probably never used.
-lhx- UNLHA32 extensions
-lx1-
-lz2- LArc methods
-lz3-
-lz4- Uncompressed
-lz5- LZ77/LZSS, 4k window. Almost identical to "SZDD" used in MS-DOS installation compression.
-lz7-
-lz8-
-lzs- LZ77/LZSS, 2k window
-pc1- PMarc extensions Refer to PMA.
-pm0-
-pm1-
-pm2-
-ah0- MAR extensions Refer to Micrognosis Compression Archiver.
-ari-
-hf0-
-lZ0- PUT/GET variants Refer to PUT.
-lZ1-
-lZ5-
␠LH0␠ SAR variants Refer to SAR (Streamline Design). The compression IDs begin and end with a space (0x20).
␠LH5␠

The Wikipedia article has more information about some of the schemes.

Other LHA-like identifiers:

ID References and remarks
-arn- Possibly used by Micrognosis Compression Archiver.
-lzw-
-pms- Refer to PMA.
-sqx- Refer to SQX.
-sw1- Refer to SWG.
-TK1- Unknown. (Recognized by IDArc.)

Extended headers

For header levels 1 and higher, each member file has an associated list of "extended headers", similar to ZIP's extensible data fields. Each extended header is tagged with a single byte indicating its type. Extended headers are used to store platform-specific metadata, and to extend the format in other ways.

Header level 0 supports extended data in a more limited way. It allows for just one set of extended header fields (called the "extended area"), the content of which is determined by the initial one-byte "OS type" field.

Identification

LHA can be identified with high accuracy, but doing so can be laborious, due to the lack of a signature, and other complicating factors.

Identification logic could be based on the header of the first member file. Check that the compression method (offset 2–6) and header level (offset 20) fields have valid values. When suitable and possible, validate the header checksum field -- this depends on the header level.

See also the "#See also" section, for some formats that could masquerade as LHA.

See also

Other LHA-like formats to be aware of:

Format documentation

Software

Sample files

Other links

Personal tools
Namespaces

Variants
Actions
Navigation
Toolbox