PKLITE

From Just Solve the File Format Problem
(Difference between revisions)
Jump to: navigation, search
(Sample files)
(Sample files)
(8 intermediate revisions by one user not shown)
Line 11: Line 11:
 
Many files compressed by PKLITE can be decompressed by PKLITE, using the <code>-x</code> option. The main exception is files compressed with <code>-e</code>, an option only available in the Professional version.
 
Many files compressed by PKLITE can be decompressed by PKLITE, using the <code>-x</code> option. The main exception is files compressed with <code>-e</code>, an option only available in the Professional version.
  
== Technical notes ==
+
== Overview of PKLITE versions ==
=== Version number ===
+
The nine free versions listed in the Software section are probably all there were.
For pristine PKLITE-compressed EXE files, the 16-bit little-endian integer at offset 28 characterizes, in broad terms, the version of PKLITE that was used, and the type of compression. The low 12 bits are the version number; for example, 0x10f means version 1.15. The 0x1000 bit is set if "extra" compression was used. The 0x2000 bit is another compression setting.
+
  
=== Version 1.20 ===
+
It seems plausible that the official Pro versions correspond to the free versions, except that whether v1.00 Pro existed is unclear.
There was no free v1.20 release, but legitimate files do exist with that version number. Most of them are [[self-extracting ZIP]] files made by PKZIP v2.04's ZIP2EXE utility.
+
  
There is also a fake version that claims to be v1.20, but is actually a hacked copy of v1.12 Professional. The files it creates are (correctly) labeled as v1.12.
+
PKWARE maintained a special internal version of PKLITE, used to compress many of the files they distributed, and the executable part of many [[self-extracting ZIP]] files. Such files are usually labeled v1.20, with a few of the earliest labeled v1.10. "1.20" does not represent a single format version; it's a whole line of formats, independent of the released versions.
 +
 
 +
There is a widely-distributed fake v1.20, which is actually a hacked copy of v1.12 Pro. The files it creates are labeled v1.12. There's no evidence of any legitimate v1.20 release.
 +
 
 +
There's evidence of some other versions used by companies outside of PKWARE, perhaps as part of a private beta test program. Files made by such versions can sometimes be identified in one way or another, though not all of them have a unique version number. In particular, files labeled v1.11, v1.16, or v2.00 may have such an origin. Note that the existence of v2.00β is claimed by [[GetTyp]].
 +
 
 +
== Format details ==
 +
=== Version descriptor ===
 +
Immediately preceding the copyright string in a pristine PKLITE-compressed file is a 16-bit little-endian integer we'll call the ''version descriptor''. In DOS EXE files, it's always at offset 28.
 +
 
 +
It characterizes, in broad terms, the version of PKLITE that was used, and the type of compression. The low 12 bits are the version number; for example, 0x10f means version 1.15. The 0x1000 bit is set if "extra" compression was used. The 0x2000 bit is for "large" compression mode.
 +
 
 +
=== Compression scheme ===
 +
The compression scheme is a kind of [[LZ77 with Huffman coding]], with pre-defined Huffman codebooks.
 +
 
 +
There are actually two different ''base'' compression schemes, sometimes called "small" and "large" mode. Large mode is used for larger files.
 +
 
 +
A different set of "small" and "large" schemes is used in version 1.10/1.20 files, so there are four base compression schemes total.
 +
 
 +
The base compression scheme can then be modified in two known ways:
 +
* ''Encrypted literals'': A simple obfuscation method, used with "extra" compression.
 +
* ''Encrypted offsets'': Another obfuscation method, used only in a few late-era v1.20 files.
 +
 
 +
This does not account for the relocation table, which is compressed in its own way, using one of several specialized schemes.
  
 
== Identification ==
 
== Identification ==
Line 92: Line 113:
 
Various:
 
Various:
 
* https://github.com/camoto-project/testexe/tree/master/compress
 
* https://github.com/camoto-project/testexe/tree/master/compress
 +
* {{DexvertSamples|archive/pklitePacked}}
  
 
By version, COM (mainly in archives that include extraneous files):
 
By version, COM (mainly in archives that include extraneous files):
 
* 1.00-beta COM: {{CdTextfiles|simtel/stmsdos9709/disk1/DISC1/GRAPHICS/GRFWK70F.ZIP|GRFWK70F.ZIP}}
 
* 1.00-beta COM: {{CdTextfiles|simtel/stmsdos9709/disk1/DISC1/GRAPHICS/GRFWK70F.ZIP|GRFWK70F.ZIP}}
 +
* 1.00 COM: {{CdTextfiles|smsharew/MUSIC/COLDCUT.ZIP|COLDCUT.ZIP}}, {{CdTextfiles|smsharew/UTIL1/HDIR21.ZIP|HDIR21.ZIP}}
 +
* 1.03 COM: {{CdTextfiles|smsharew/PASCAL/SAMPLES.ZIP|SAMPLES.ZIP}}, {{CdTextfiles|smsharew/MUSIC/MPLAY200.ZIP|MPLAY200.ZIP}}
 
* 1.05 COM: {{CdTextfiles|simtel/stmsdos9709/disk1/DISC1/DIRUTL/DLINKS10.ZIP|DLINKS10.ZIP}}
 
* 1.05 COM: {{CdTextfiles|simtel/stmsdos9709/disk1/DISC1/DIRUTL/DLINKS10.ZIP|DLINKS10.ZIP}}
 
* 1.12 COM: {{CdTextfiles|simtel/stmsdos9709/disk2/DISC2/SYSINFO/NEED65.ZIP|NEED65.ZIP}}
 
* 1.12 COM: {{CdTextfiles|simtel/stmsdos9709/disk2/DISC2/SYSINFO/NEED65.ZIP|NEED65.ZIP}}
Line 103: Line 127:
  
 
By version, EXE:
 
By version, EXE:
 +
* 1.00-beta EXE: {{CdTextfiles|wildcatgold/util/ezwindo1.zip|ezwindo1.zip}}
 
* 1.00 EXE: {{CdTextfiles|simtel/stmsdos9709/disk1/DISC1/DIRUTL/DISKOR10.ZIP|DISKOR10.ZIP}}, {{CdTextfiles|simtel/stmsdos9709/disk1/DISC1/MAILNEWS/UMAIL11I.ZIP|UMAIL11I.ZIP}}
 
* 1.00 EXE: {{CdTextfiles|simtel/stmsdos9709/disk1/DISC1/DIRUTL/DISKOR10.ZIP|DISKOR10.ZIP}}, {{CdTextfiles|simtel/stmsdos9709/disk1/DISC1/MAILNEWS/UMAIL11I.ZIP|UMAIL11I.ZIP}}
 
* 1.03 EXE: {{CdTextfiles|simtel/stmsdos9709/disk1/DISC1/MAILNEWS/NWRTH210.ZIP|NWRTH210.ZIP}}
 
* 1.03 EXE: {{CdTextfiles|simtel/stmsdos9709/disk1/DISC1/MAILNEWS/NWRTH210.ZIP|NWRTH210.ZIP}}
Line 114: Line 139:
  
 
By version, EXE with "extra compression":
 
By version, EXE with "extra compression":
 +
* 1.03 EXE (-e): {{CdTextfiles|640swstudio/BBS/QBBS275U.ZIP|QBBS275U.ZIP}}
 
* 1.05 EXE (-e): {{CdTextfiles|simtel/stmsdos9709/disk1/DISC1/MAILNEWS/ZNR093B.ZIP|ZNR093B.ZIP}}
 
* 1.05 EXE (-e): {{CdTextfiles|simtel/stmsdos9709/disk1/DISC1/MAILNEWS/ZNR093B.ZIP|ZNR093B.ZIP}}
 
* 1.12 EXE (-e): {{CdTextfiles|simtel/stmsdos9709/disk1/DISC1/GIF/GIFLT210.ZIP|GIFLT210.ZIP}}
 
* 1.12 EXE (-e): {{CdTextfiles|simtel/stmsdos9709/disk1/DISC1/GIF/GIFLT210.ZIP|GIFLT210.ZIP}}
Line 127: Line 153:
 
* Most EXE files from PKZIP 1.93a+ for DOS (see [[ZIP#Software]]).
 
* Most EXE files from PKZIP 1.93a+ for DOS (see [[ZIP#Software]]).
 
* Self-extracting ZIP files made by ZIP2EXE from PKZIP v2.04c+ - see [[Self-extracting ZIP#Sample files]].
 
* Self-extracting ZIP files made by ZIP2EXE from PKZIP v2.04c+ - see [[Self-extracting ZIP#Sample files]].
 +
* Self-extracting ZIP files made by ZIP2EXE from {{CdTextfiles|simtel/simtel0101/simtel/arcers/pk250dos.exe|PKZIP 2.50 DOS shareware}}
 
* {{CdTextfiles|swextrav4/swextrav4-3/arch/pk204c2g.zip|pk204c2g.zip}} → PKPATCH.EXE
 
* {{CdTextfiles|swextrav4/swextrav4-3/arch/pk204c2g.zip|pk204c2g.zip}} → PKPATCH.EXE
 
* {{CdTextfiles|californiacollect/his008/pkzm100.zip|pkzm100.zip}} → PKZM100.EXE → PKZMENU.EXE - version "1.10"
 
* {{CdTextfiles|californiacollect/his008/pkzm100.zip|pkzm100.zip}} → PKZM100.EXE → PKZMENU.EXE - version "1.10"
Line 134: Line 161:
 
Oddities:
 
Oddities:
 
* {{CdTextfiles|swextrav1993/disk3/diskutil/sd_200.zip|sd_200.zip}} → SD.EXE - File from StupenDOS, a PKWARE spin-off product. Apparently made by a pre-release version of PKLITE, then apparently code-named "PKPACK" (but not to be confused with [[PKARC/PKPAK|PKPAK]]).
 
* {{CdTextfiles|swextrav1993/disk3/diskutil/sd_200.zip|sd_200.zip}} → SD.EXE - File from StupenDOS, a PKWARE spin-off product. Apparently made by a pre-release version of PKLITE, then apparently code-named "PKPACK" (but not to be confused with [[PKARC/PKPAK|PKPAK]]).
* {{CdTextfiles|bbox4/archiver/pkzm104.arj|pkzm104.arj}} → PKZM104X.EXE → PKZMENU.EXE - Possibly a legitimate file made by unreleased PKLITE v1.11. Format seems the same as v1.12, except for the version number.
+
* Version "1.11" (File structure looks identical to v1.12.)
* There are two (and only two) unusual PKLITE-compressed files included with PC-DOS 6.3 (e.g. [https://winworldpc.com/product/pc-dos/6x at WinWorld]), suggesting that there was a special IBM version of PKLITE.
+
** {{CdTextfiles|bbox4/archiver/pkzm104.arj|pkzm104.arj}} → PKZM104X.EXE → PKZMENU.EXE
 +
** Some of the EXE files in this package (said to be an update to PC Tools 7 by Central Point Software): {{CdTextfiles|californiacollect/his041/cpb0701a.zip|cpb0701a.zip}}, {{CdTextfiles|californiacollect/his041/cpb0701b.zip|cpb0701b.zip}}, {{CdTextfiles|californiacollect/his041/cpb0701c.zip|cpb0701c.zip}} (e.g. CPBQ3.EXE, CPBQ5.EXE)
 +
** Many of the EXE files from OnNet16 v2.5 by FTP Software: [https://archive.org/details/pcwk-4a-98 PC World Komputer 04A/98] → Wtestowe/OnNet16/*.EXE (e.g. FTPVER.EXE)
 +
* There are two unusual PKLITE-compressed files included with PC-DOS 6.3 (e.g. [https://winworldpc.com/product/pc-dos/6x at WinWorld]), apparently made by a beta or special version of PKLITE.
 
** PC-DOS 6.3 → Disk 1 → FORMAT.COM - Version "1.16"
 
** PC-DOS 6.3 → Disk 1 → FORMAT.COM - Version "1.16"
 
** PC-DOS 6.3 → Disk 1 → XCOPY.EXE - Labeled "1.50", but different from the actual v1.50.
 
** PC-DOS 6.3 → Disk 1 → XCOPY.EXE - Labeled "1.50", but different from the actual v1.50.
* {{CdTextfiles|simtel/stmsdos9709/disk1/DISC1/FILEUTIL/DMAKER20.ZIP|DMAKER20.ZIP}} - Either a fake version number, or evidence that v2.00 existed.
+
* {{CdTextfiles|simtel/stmsdos9709/disk1/DISC1/FILEUTIL/DMAKER20.ZIP|DMAKER20.ZIP}} - Version "2.00"
  
 
Modified files - simple (Modification of the copyright message or other unimportant things. Such files are common -- these are just random examples.):
 
Modified files - simple (Modification of the copyright message or other unimportant things. Such files are common -- these are just random examples.):
Line 158: Line 188:
 
* {{CdTextfiles|simtel/stmsdos9709/disk1/DISC1/TXTUTL/KWS144.ZIP|KWS144.ZIP}}
 
* {{CdTextfiles|simtel/stmsdos9709/disk1/DISC1/TXTUTL/KWS144.ZIP|KWS144.ZIP}}
 
* {{CdTextfiles|pdos9606/SOUND/MODPLAY/LIQ100.ZIP|LIQ100.ZIP}}
 
* {{CdTextfiles|pdos9606/SOUND/MODPLAY/LIQ100.ZIP|LIQ100.ZIP}}
* {{CdTextfiles|librisbritannia/COMMUNIC/BULLETIN/3220A.ZIP|3220A.ZIP}}, {{CdTextfiles|librisbritannia/COMMUNIC/BULLETIN/3220A.ZIP|3220B.ZIP}} - Different ''encrypted literals'' scheme, "v1.23".
+
* {{CdTextfiles|librisbritannia/COMMUNIC/BULLETIN/3220A.ZIP|3220A.ZIP}}, {{CdTextfiles|librisbritannia/COMMUNIC/BULLETIN/3220B.ZIP|3220B.ZIP}} - Different ''encrypted literals'' scheme, "v1.23".
 
* {{CdTextfiles|simtel/stmsdos9709/disk1/DISC1/ANIMATE/W7V1.ZIP|W7V1.ZIP}} - Number of relocations &gt; 1.
 
* {{CdTextfiles|simtel/stmsdos9709/disk1/DISC1/ANIMATE/W7V1.ZIP|W7V1.ZIP}} - Number of relocations &gt; 1.
 
* {{CdTextfiles|simtel/stmsdos9709/disk1/DISC1/ARCUTILS/ZPDISK21.ZIP|ZPDISK21.ZIP}}
 
* {{CdTextfiles|simtel/stmsdos9709/disk1/DISC1/ARCUTILS/ZPDISK21.ZIP|ZPDISK21.ZIP}}

Revision as of 13:54, 15 May 2024

File Format
Name PKLITE
Ontology
Released 1990

PKLITE is an executable compression utility, from the makers of PKZIP (see ZIP). There was a free-for-noncommercial-use version, and a "Professional" version. There was a separate PKLITE32 product for 32-bit Windows.

It supports mainly DOS .EXE and .COM formats. Version 2.01 added the ability to compress Windows 3.x executables.

Many files compressed by PKLITE can be decompressed by PKLITE, using the -x option. The main exception is files compressed with -e, an option only available in the Professional version.

Contents

Overview of PKLITE versions

The nine free versions listed in the Software section are probably all there were.

It seems plausible that the official Pro versions correspond to the free versions, except that whether v1.00 Pro existed is unclear.

PKWARE maintained a special internal version of PKLITE, used to compress many of the files they distributed, and the executable part of many self-extracting ZIP files. Such files are usually labeled v1.20, with a few of the earliest labeled v1.10. "1.20" does not represent a single format version; it's a whole line of formats, independent of the released versions.

There is a widely-distributed fake v1.20, which is actually a hacked copy of v1.12 Pro. The files it creates are labeled v1.12. There's no evidence of any legitimate v1.20 release.

There's evidence of some other versions used by companies outside of PKWARE, perhaps as part of a private beta test program. Files made by such versions can sometimes be identified in one way or another, though not all of them have a unique version number. In particular, files labeled v1.11, v1.16, or v2.00 may have such an origin. Note that the existence of v2.00β is claimed by GetTyp.

Format details

Version descriptor

Immediately preceding the copyright string in a pristine PKLITE-compressed file is a 16-bit little-endian integer we'll call the version descriptor. In DOS EXE files, it's always at offset 28.

It characterizes, in broad terms, the version of PKLITE that was used, and the type of compression. The low 12 bits are the version number; for example, 0x10f means version 1.15. The 0x1000 bit is set if "extra" compression was used. The 0x2000 bit is for "large" compression mode.

Compression scheme

The compression scheme is a kind of LZ77 with Huffman coding, with pre-defined Huffman codebooks.

There are actually two different base compression schemes, sometimes called "small" and "large" mode. Large mode is used for larger files.

A different set of "small" and "large" schemes is used in version 1.10/1.20 files, so there are four base compression schemes total.

The base compression scheme can then be modified in two known ways:

  • Encrypted literals: A simple obfuscation method, used with "extra" compression.
  • Encrypted offsets: Another obfuscation method, used only in a few late-era v1.20 files.

This does not account for the relocation table, which is compressed in its own way, using one of several specialized schemes.

Identification

Robust identification of PKLITE-compressed files is challenging, due to the many versions and options, and the fact that PKLITE files were often modified to make them more difficult to identify and/or decompress.

Note that PKLITE includes CHK4LITE, a utility that tries to identify PKLITE-compressed files, and the version of PKLITE they were created with. Different versions of CHK4LITE work differently, but it is fairly rudimentary, and never stood much chance in the arms race over disguising PKLITE files.

Identification of DOS COM

Based on the start of the copyright message near the beginning of the file...

  • v1.00β has "PK Copyr" at offset 38.
  • v1.00 has "PKlite" at offset 44.
  • v1.03-1.14 has "PKLITE" at offset 44.
  • v1.15-2.01 has "PKLITE" at offset 46.

Identification of DOS EXE

There is a copyright message at offset 30 that starts with "PKlite" (v2.01) or "PKLITE" (all other versions).

It's likely that all files (except those from v1.00β) have bytes 00 00 or 01 00 at offset 6, and 00 01 f0 ff at offset 20 (refer to MS-DOS EXE#Header structure). This is fairly distinctive, though false positives are possible.

Identification of Windows EXE

There is a copyright message at offset 66 that starts with "PKlite".

Specifications

Software

  • PKLITE freeware/shareware, for DOS
  • PKLITE - other/various
    • PKLite at old-dos.ru - various versions
    • v1.00β (1990-05-29) (not an authorized release[1])
    • fake v1.20 (1992-08-20): [2], [3], [4]
    • XADIP201.ZIP (at vetusware.com) - Hacked "XADi" version of PKLITE 2.01-shareware. Claims to support the -e option, but it only does a little of what the real software does.

Decompression, general:

Decompression, for DOS:

Protectors (utilities that modify a PKLITE-compressed file to make it more difficult to identify and/or decompress):

Other:

  • LOWFIX - Patches v1.00-1.05 to fix bugs, and changes the version number to 1.06.
  • pkla - Analyzer utility
  • See also MEGALITE
  • See also PKTINY

Sample files

Various:

By version, COM (mainly in archives that include extraneous files):

By version, EXE:

By version, EXE with "extra compression":

Special versions, EXE (usually labeled as version "1.20"):

Oddities:

  • sd_200.zip → SD.EXE - File from StupenDOS, a PKWARE spin-off product. Apparently made by a pre-release version of PKLITE, then apparently code-named "PKPACK" (but not to be confused with PKPAK).
  • Version "1.11" (File structure looks identical to v1.12.)
  • There are two unusual PKLITE-compressed files included with PC-DOS 6.3 (e.g. at WinWorld), apparently made by a beta or special version of PKLITE.
    • PC-DOS 6.3 → Disk 1 → FORMAT.COM - Version "1.16"
    • PC-DOS 6.3 → Disk 1 → XCOPY.EXE - Labeled "1.50", but different from the actual v1.50.
  • DMAKER20.ZIP - Version "2.00"

Modified files - simple (Modification of the copyright message or other unimportant things. Such files are common -- these are just random examples.):

Modified files - other:

Links

Personal tools
Namespaces

Variants
Actions
Navigation
Toolbox