PKLITE

Latest revision as of 15:28, 12 October 2024

PKLITE is an executable compression utility, from the makers of PKZIP. There was a free-for-noncommercial-use version, and a "Professional" version. There was a separate PKLITE32 product for 32-bit Windows.

It compresses DOS EXE files (to EXE), and COM files (to COM). Version 2.01 added the ability to compress Windows 3.x executables.

Many files compressed by PKLITE can be decompressed by PKLITE, using the -x option. The main exception is files compressed with -e ("extra compression"), an option only available in the Professional version.

[edit] Overview of PKLITE versions

The nine free versions listed in the Software section are probably all there were.

It seems plausible that the official Pro versions correspond to the free versions, except that whether v1.00 Pro existed is unclear.

PKWARE maintained a special internal version of PKLITE, used to compress many of the files they distributed, and the executable part of many self-extracting ZIP files. Such files are usually labeled v1.20, with a few of the earliest labeled v1.10. "1.20" does not represent a single format version; it's a whole line of formats, independent of the released versions.

There is a widely-distributed fake v1.20, which is actually a hacked copy of v1.12 Pro. The files it creates are labeled v1.12. There's no evidence of any legitimate v1.20 release.

There's evidence of some other versions used by companies outside of PKWARE, perhaps as part of a private beta test program. Files made by such versions can sometimes be identified in one way or another, though not all of them have a unique version number. In particular, files labeled v1.11, v1.16, or v2.00 may have such an origin. Note that the existence of v2.00β is claimed by GetTyp.

[edit] Format details

[edit] Version descriptor

Immediately preceding the copyright string in a pristine PKLITE-compressed file is a 16-bit little-endian integer we'll call the version descriptor. In DOS EXE files, it's always at offset 28.

It characterizes, in broad terms, the version of PKLITE that was used, and the type of compression. The low 12 bits are the version number; for example, 0x10f means version 1.15. The 0x1000 bit is set if "extra" compression was used. The 0x2000 bit is for "large" compression mode.

[edit] Compression scheme

The compression scheme is a kind of LZ77 with Huffman coding, with pre-defined Huffman codebooks.

There are actually two different base compression schemes, sometimes called "small" and "large" mode. Large mode is used for larger files.

A different set of "small" and "large" schemes is used in version 1.10/1.20 files, so there are four base compression schemes total.

The base compression scheme can then be modified in two known ways:

• Encrypted literals: A simple obfuscation method, used with "extra" compression.
• Encrypted offsets: Another obfuscation method, used only in a few late-era v1.20 files.

This does not account for the relocation table, which is compressed in its own way, using one of several specialized schemes.

[edit] Encrypted decompressor

Files made by v1.14+ with the -e option, and "v1.20" files, have an encrypted decompressor. The bulk of the decompression code is obfuscated, to make it harder to analyze and modify.

V1.14+ uses a fairly simple XOR-based algorithm. The "v1.20" algorithm is similar, but with modular addition instead of XOR.

The decryption normally happens one "word" (two bytes) at a time, and in reverse order (last word first). The algorithm is initialized with a decryption key, but due to an apparent design error, the key is only needed for very "first" (last) word. In most or all relevant files, the key appears early in the program code, following a 0xba byte.

A decompression utility does not necessarily have to decrypt the decompressor in order to decompress the file. But doing so allows the compression parameters to be determined more reliably. And it is necessary for files with encrypted offsets, because the offset decryption key is embedded in the encrypted decompressor.

[edit] Identification

Robust identification of PKLITE-compressed files is challenging, due to the many versions and options, and the fact that PKLITE files were often modified to make them more difficult to identify and/or decompress.

Note that PKLITE includes CHK4LITE, a utility that tries to identify PKLITE-compressed files, and the version of PKLITE they were created with. Different versions of CHK4LITE work differently, but it is fairly rudimentary, and never stood much chance in the arms race over disguising PKLITE files.

[edit] Identification of DOS COM

Based on the start of the copyright message near the beginning of the file...

• v1.00β has "PK Copyr" at offset 38.
• v1.00 has "PKlite" at offset 44.
• v1.03-1.14 has "PKLITE" at offset 44.
• v1.15-2.01 has "PKLITE" at offset 46.

[edit] Identification of DOS EXE

There is a copyright message at offset 30 that starts with "PKlite" (v2.01) or "PKLITE" (all other versions).

It's likely that all files (except those from v1.00β) have bytes 00 00 or 01 00 at offset 6, and 00 01 f0 ff at offset 20 (refer to MS-DOS EXE#Header structure). This is fairly distinctive, though false positives are possible.

[edit] Identification of Windows EXE

There is a copyright message at offset 66 that starts "PKlite" or "Pklite". In files made by PKLITE 2.01, the "K" in this string is capitalized. In most files distributed directly by PKWARE, including relevant self-extracting ZIP files, it's lowercase.

There is a possible signature, "TNT4", starting 8 bytes after the start of the standard "NE" signature. That is, at offset {8 + {the 4-byte integer at offset 60}}.

[edit] Specifications

• ModdingWiki: PKLite
• PKLITE V1.12 compression format

[edit] Software

• PKLITE freeware/shareware, for DOS
  • v1.00 (1990-12-01)
  • v1.03 (1990-12-20)
  • v1.05 (1991-03-20)
  • v1.12 (1991-06-15)
  • v1.13 (1991-08-01)
  • v1.14 (1992-06-01)
  • v1.15 (1992-07-30)
  • v1.50 (1995-04-10)
  • v2.01 (1996-03-15)
• PKLITE - other/various
  • PKLite at old-dos.ru - various versions
  • v1.00β (1990-05-29) (not an authorized release[1])
  • fake v1.20 (1992-08-20): [2], [3], [4]
  • XADIP201.ZIP (at vetusware.com) - Hacked "XADi" version of PKLITE 2.01-shareware. Claims to support the -e option, but it only does a little of what the real software does.

Decompression, general:

• depklite (Not a complete decompression utility, but maybe useful.)
• mz-explode
• Deark (with -m pklite option)

Decompression, for DOS:

• PKLITE (with -x option)
• DISLITE by JohnPC & CV-Tassle: v1.17a · another copy · source code
• See Executable compression#Decompression software for some multi-format utilities that support PKLITE, e.g. UNP.
• UnPKLite (archived) by Tenth Planet Software / Clive Turvey
• PKUNLITE v1.00 by Montgomery Engineering
• PKUNLITE v3.00 by The Software Surgeon & Electronic Rats
• Universal PKLITE Unpacker (UNPKLITE.EXE) by PReDaTor 666: ANORMAL's DOSEXE collections → Executable Tools Pack → unpackers/universal pklite unpacker.*
• AVPACK
• ExLite by Inbar Raz (COM files only, includes source code)

Protectors (utilities that modify a PKLITE-compressed file to make it more difficult to identify and/or decompress):

• PKFOOL v1.0 (requires BRUN45.EXE, not included)
• PKLTEFIX
• UN²PACK v2.0

Other:

• LOWFIX - Patches v1.00-1.05 to fix bugs, and changes the version number to 1.06.
• pkla - Analyzer utility
• See also MEGALITE
• See also PKTINY

[edit] Sample files

Various:

• https://github.com/camoto-project/testexe/tree/master/compress
• dexvert samples — archive/pklitePacked

By version, COM (mainly in archives that include extraneous files):

• 1.00-beta COM: GRFWK70F.ZIP
• 1.00 COM: COLDCUT.ZIP, HDIR21.ZIP
• 1.03 COM: SAMPLES.ZIP, MPLAY200.ZIP
• 1.05 COM: DLINKS10.ZIP
• 1.12 COM: NEED65.ZIP
• 1.13 COM: TEENFMT2.ZIP
• 1.14 COM: TIMERA01.ZIP
• 1.15 COM: 3DVIS10.ZIP
• 2.01 COM: TI101A.ZIP

By version, EXE:

• 1.00-beta EXE: ezwindo1.zip
• 1.00 EXE: DISKOR10.ZIP, UMAIL11I.ZIP
• 1.03 EXE: NWRTH210.ZIP
• 1.05 EXE: APPINST.ZIP
• 1.12 EXE: MPGP11.ZIP, DCP41.ZIP
• 1.13 EXE: FAQ12.ZIP, MD5SUM.ZIP
• 1.14 EXE: XSUM11.ZIP, CPDSK195.ZIP
• 1.15 EXE: RCD24.ZIP, BMP2TXT.ZIP, CDROK99C.ZIP
• 1.50 EXE: MMCMP132.ZIP
• 2.01 EXE: ML96OCT.ZIP, 4DIZZY96.ZIP

By version, EXE with "extra compression":

• 1.03 EXE (-e): QBBS275U.ZIP
• 1.05 EXE (-e): ZNR093B.ZIP
• 1.12 EXE (-e): GIFLT210.ZIP
• 1.13 EXE (-e): WNEWSP11.ZIP, MEDLIN5.ZIP
• 1.14 EXE (-e): KA9QDR21.ZIP, GMOD13.ZIP
• 1.15 EXE (-e): FLMAS350.ZIP, FB315.ZIP
• 1.50 EXE (-e): MM-804RU.ZIP
• 2.01 EXE (-e): RRAFT212.ZIP
• Most EXE files from PKLITE distributions up to v1.13.

Special versions, EXE (usually labeled as version "1.20"):

• Most EXE Files from PKLITE v1.14, 1.15, 2.01.
• Most EXE files from PKZIP 1.93a+ for DOS (see ZIP#Software).
• Self-extracting ZIP files made by ZIP2EXE from PKZIP v2.04c+ - see Self-extracting ZIP#Sample files.
• DOS format self-extracting ZIP files made by some versions of PKZIP for Windows (e.g. v2.63). These report "PKSFX 2.49" when executed. (Refer to PKZIP#Software.)
• Self-extracting ZIP files made by ZIP2EXE from PKZIP 2.50 DOS shareware. (Refer to PKZIP#Software.)
• pk204c2g.zip → PKPATCH.EXE
• pkzm100.zip → PKZM100.EXE → PKZMENU.EXE - version "1.10"
• PKZM104.EXE → PKZMENU.EXE - version "1.10"
• PKZF15.ZIP

EXE for Windows 3.x:

• pk263w16.exe (this file, and the PKZIPW.EXE file contained in it)

Oddities:

• sd_200.zip → SD.EXE - File from StupenDOS, a PKWARE spin-off product. Apparently made by a pre-release version of PKLITE, then apparently code-named "PKPACK" (but not to be confused with PKPAK).
• Version "1.11" (File structure looks identical to v1.12.)
  • pkzm104.arj → PKZM104X.EXE → PKZMENU.EXE
  • Some of the EXE files in this package (said to be an update to PC Tools 7 by Central Point Software): cpb0701a.zip, cpb0701b.zip, cpb0701c.zip (e.g. CPBQ3.EXE, CPBQ5.EXE)
  • Many of the EXE files from OnNet16 v2.5 by FTP Software: PC World Komputer 04A/98 → Wtestowe/OnNet16/*.EXE (e.g. FTPVER.EXE)
• There are two unusual PKLITE-compressed files included with PC-DOS 6.3 (e.g. at WinWorld), apparently made by a beta or special version of PKLITE.
  • PC-DOS 6.3 → Disk 1 → FORMAT.COM - Version "1.16"
  • PC-DOS 6.3 → Disk 1 → XCOPY.EXE - Labeled "1.50", but different from the actual v1.50.
• DMAKER20.ZIP - Version "2.00"

Modified files - simple (Modification of the copyright message or other unimportant things. Such files are common -- these are just random examples.):

• glx212.zip - Probably via an EXE header optimizer.
• WNEWSP11.ZIP - Faked to make it look like it uses "extra compression", when it doesn't.
• COMMO70.ZIP - Wrong version descriptor.
• BLUEQ155.ZIP
• 10TK97EN.ZIP (beta)
• FLISEE3.ZIP
• SATFIND2.ZIP
• PGS099H.ZIP
• FHD210US.ZIP
• ZIP_GO52.ZIP (EXE, COM)
• CDM330.ZIP
• SBPV400B.ZIP (COM)
• UPTIM300.ZIP (COM)

Modified files - other:

• KWS144.ZIP
• LIQ100.ZIP
• 3220A.ZIP, 3220B.ZIP - Different encrypted literals scheme, "v1.23".
• W7V1.ZIP - Number of relocations > 1.
• ZPDISK21.ZIP

[edit] Links

• Archived copy of PKLITE web page