Sources
From Just Solve the File Format Problem
(Difference between revisions)
(→List of Places Keeping Track of Formats) |
Ljcool2006 (Talk | contribs) (→List of Places Keeping Track of Formats) |
||
| (4 intermediate revisions by 4 users not shown) | |||
| Line 4: | Line 4: | ||
==List of Places Keeping Track of Formats== | ==List of Places Keeping Track of Formats== | ||
| − | {| class="wikitable" style=" | + | {| class="wikitable" style="width: 100%;" |
|- | |- | ||
! URL !! Notes | ! URL !! Notes | ||
| Line 13: | Line 13: | ||
| [https://filext.com/ FilExt] | | [https://filext.com/ FilExt] | ||
| Similar to FileInfo | | Similar to FileInfo | ||
| + | |- | ||
| + | | [https://forensics.wiki/ Forensics Wiki] | ||
| + | | | ||
|- | |- | ||
| http://archivematica.org/preservation | | http://archivematica.org/preservation | ||
| Line 69: | Line 72: | ||
|- | |- | ||
| http://wiki.mobileread.com/wiki/E-book_formats | | http://wiki.mobileread.com/wiki/E-book_formats | ||
| − | | detailed information on | + | | detailed information on e-Book formats. |
|- | |- | ||
| http://mediapedia.nla.gov.au/ | | http://mediapedia.nla.gov.au/ | ||
| Line 92: | Line 95: | ||
| | | | ||
|- | |- | ||
| − | | [http://hg.python.org/cpython/file/2.7/Lib/mimetypes.py#l402 Python | + | | [http://hg.python.org/cpython/file/2.7/Lib/mimetypes.py#l402 Python source code for mimetypes module] |
| /etc/mimetypes on *nix systems defines a number of file formats and [[MIME types]] | | /etc/mimetypes on *nix systems defines a number of file formats and [[MIME types]] | ||
|- | |- | ||
| Line 129: | Line 132: | ||
|- | |- | ||
| [http://gitorious.org/msoscheme msoscheme] | | [http://gitorious.org/msoscheme msoscheme] | ||
| − | | Project that creates a machine readable description of the binary file formats of Microsoft Office | + | | Project that creates a machine-readable description of the binary file formats of Microsoft Office |
|- | |- | ||
| http://www.schnarff.com/file-formats/ | | http://www.schnarff.com/file-formats/ | ||
| Line 152: | Line 155: | ||
|- | |- | ||
| [http://www.binwalk.org Binwalk] | | [http://www.binwalk.org Binwalk] | ||
| − | | Can recognise and extract data in many formats | + | | Can recognise and extract data in many formats embedded inside firmware images |
|- | |- | ||
| http://www.math.utah.edu/~beebe/fonts/X-Window-System-fonts.html | | http://www.math.utah.edu/~beebe/fonts/X-Window-System-fonts.html | ||
| Line 185: | Line 188: | ||
|- | |- | ||
| https://extension.nirsoft.net | | https://extension.nirsoft.net | ||
| − | | | + | | Contains program data related to files. |
|} | |} | ||
The following resources are no longer available: | The following resources are no longer available: | ||
| − | {| class="wikitable" style=" | + | {| class="wikitable" style="width: 100%;" |
|- | |- | ||
! URL !! Notes | ! URL !! Notes | ||
| − | |||
| − | |||
| − | |||
|- | |- | ||
| http://wotsit.org/ | | http://wotsit.org/ | ||
| − | | (their download page is broken. need to ping webmaster about that.) | + | | (<s>their download page is broken. need to ping webmaster about that.</s> now the entire website is just a parking page) |
|- | |- | ||
| http://unarchiver.c3.cx/formats | | http://unarchiver.c3.cx/formats | ||
| Line 224: | Line 224: | ||
* [http://www.amazon.com/Lotus-File-Formats-1-2-3-Symphony/dp/0201168243/ Lotus File Formats for 1-2-3 Symphony & Jazz: File Structure Descriptions for Developers] from Lotus, Inc. (1986) | * [http://www.amazon.com/Lotus-File-Formats-1-2-3-Symphony/dp/0201168243/ Lotus File Formats for 1-2-3 Symphony & Jazz: File Structure Descriptions for Developers] from Lotus, Inc. (1986) | ||
* [http://www.amazon.com/Inside-Windows-File-Formats-Swan/dp/0672303388/ Inside Windows File Formats] by Tom Swan (Nov 1993) | * [http://www.amazon.com/Inside-Windows-File-Formats-Swan/dp/0672303388/ Inside Windows File Formats] by Tom Swan (Nov 1993) | ||
| − | * [http://www.amazon.com/Internet-File-Formats-Complete-Receiving/dp/188357756X/ Internet File Formats: Your Complete Resource for Sending, Receiving, and Using Internet Files] by Tim Kientzle (Oct 15, 1995) | + | * [http://www.amazon.com/Internet-File-Formats-Complete-Receiving/dp/188357756X/ Internet File Formats: Your Complete Resource for Sending, Receiving, and Using Internet Files] by Tim Kientzle (Oct 15, 1995) [https://archive.org/details/mac_Internet_File_Formats_1995 Archive.org Scan], [https://archive.org/details/internet-file-formats-cd Companion CD-ROM] |
* [http://www.amazon.com/File-Formats-Popular-PC-Software/dp/0471528064/ File Formats for Popular PC Software] by Jeff Walden (Nov 1992) | * [http://www.amazon.com/File-Formats-Popular-PC-Software/dp/0471528064/ File Formats for Popular PC Software] by Jeff Walden (Nov 1992) | ||
* [http://www.amazon.com/File-Formats-Conversions-Book-Developers/dp/155755059X/ PC File Formats and Conversions/Book and Disk (Developers Series)] by Ralf Kussmann (Mar 1990) | * [http://www.amazon.com/File-Formats-Conversions-Book-Developers/dp/155755059X/ PC File Formats and Conversions/Book and Disk (Developers Series)] by Ralf Kussmann (Mar 1990) | ||
Latest revision as of 10:26, 17 May 2024
If you're looking for places to pull either file format information, or to verify stuff you've found, or to go that extra mile to track down variations, here's some similar endeavors and items.
[edit] List of Places Keeping Track of Formats
| URL | Notes |
|---|---|
| FileInfo | A vast catalog of file extensions, but the data they give is very minimal. |
| FilExt | Similar to FileInfo |
| Forensics Wiki | |
| http://archivematica.org/preservation | |
| http://www.fileformat.info/ | |
| http://www.ace.net.nz/tech/TechFileFormat.html | |
| http://en.wikipedia.org/wiki/List_of_file_formats | Also wikipedia:Template:Infobox file format (pages using this template) |
| Wikidata | we can use SPARQL to query for MIME types or file extensions. |
| The PRONOM format registry | |
| http://wiki.multimedia.cx | |
| http://archive.org/download/file-format-encyclopedia/fileformat.zip | |
| http://www.digitalpreservation.gov/formats/fdd/descriptions.shtml | |
| http://www.udfr.org/ | See also http://gdfr.info/ |
| http://gitorious.org/re-lab | Tools & specs from re-lab- graphics formats, and office formats |
| http://www-mmsp.ece.mcgill.ca/documents/AudioFormats/index.html | Documentation, details, specs, and samples for a handful of audio formats |
| http://wiki.xentax.com/index.php/Game_File_Format_Central | This wiki is the home of the most game (archive) file format knowledge in the world. |
| http://mark0.net/soft-trid-e.html | Home to TrID, which can identify a vast number of file formats using an updateable database |
| http://mark0.net/soft-trid-deflist.html | Online searchable version of the TrID database file |
| http://file-extension.net/seeker/ | Metasearch engine for file extensions. Find info about unknown file extensions or filetypes |
| http://www.vgmpf.com/Wiki/index.php?title=Main_Page | the Videogame Music Preservation Foundation Wiki has information on a number of formats used to play back videogame music |
| http://hackipedia.org/File%20formats/ | loads of info on various formats here |
| http://wiki.mobileread.com/wiki/E-book_formats | detailed information on e-Book formats. |
| http://mediapedia.nla.gov.au/ | "The Mediapedia resource is intended to enable the identification of various physical media carrier types for assisting with collection planning, assessment, documentation, infrastructure and preservation planning for the content they hold. These could include media across various genres such as cine, video, photo, audio, data, paper carriers, microfilm, etc." |
| http://wiki.opf-labs.org/display/TR/Formats | Small list of formats with detailed descriptions of some known access/preservation problems. |
| CASPAR/DCC Representation Information Repository | |
| The Software Ontology | |
| KEEP Totem | Also covers software, hardware etc. |
| Dead Media Archives | |
| The >4000 formats known to FI Tools by extension by MIME type |
|
| Python source code for mimetypes module | /etc/mimetypes on *nix systems defines a number of file formats and MIME types |
| http://www.iasa-web.org/tc04/key-digital-principles | Recommended Audio formats by Audiovisual Archives and Institutions |
| http://www.gpsbabel.org/capabilities.html | List of formats used by GPS devices |
| Microsoft's Open Document Specifications | |
| http://mamedev.org/source/src/lib/formats/index.html http://mamedev.org/source/src/mess/formats/index.html |
Format handlers for disk images, cassette images, and memory snapshots/quickloads in the MESS source code. |
| http://minidisc.org | A lot of minidisc related info |
| http://cool.conservation-us.org/ | Conservation Online |
| http://filext.com/ | File Extensions with MIME types |
| http://en.wikipedia.org/wiki/List_of_file_formats_(alphabetical) | Wikipedia list of file formats (alphabetical) |
| http://ist.uwaterloo.ca/~schepers/formats.html | The C64 file formats list |
| http://3dbrew.org/wiki/Category:File_formats | Nintendo 3DS file formats |
| IANA MIME Media Types | lots of useful info here and often quite detailed as well |
| msoscheme | Project that creates a machine-readable description of the binary file formats of Microsoft Office |
| http://www.schnarff.com/file-formats/ | File Formats documentation collection |
| The Format Registry | |
| http://www.freebase.com/computer/file_format?instances= | Freebase instances in category "File Format" |
| https://bitbucket.org/haypo/hachoir/src/default/hachoir-parser/hachoir_parser/ | Hachoir file format parsers |
| https://bitbucket.org/haypo/hachoir/wiki/FileFormatResources | Hachoir list of file format resources |
| https://theiphonewiki.com/wiki/Category:File_Formats | iPhone related file formats |
| Synalize It | File-format grammars |
| Binwalk | Can recognise and extract data in many formats embedded inside firmware images |
| http://www.math.utah.edu/~beebe/fonts/X-Window-System-fonts.html | Good info about the Fonts on Windows X system |
| http://www.online-convert.com/file-type | |
| https://melog.info/archives/2004/09/30223144.html | PC98 disk image formats (Japanese) |
| http://lclevy.free.fr/amiga/formats.html | Amiga file formats |
| http://hitmen.c02.at/files/yagcd/yagcd/ | Contains Nintendo GameCube file formats |
| https://wiibrew.org/wiki/Category:File_formats | Files related to the Nintendo Wii |
| http://wiki.tockdom.com/wiki/Category:File_Format | File formats related to the Mario Kart games |
| https://www.cgsecurity.org/wiki/File_Formats_Recovered_By_PhotoRec | File Format Signatures used in data recovery |
| Atari Forum Wiki | |
| http://www.undocprint.org/ | Information on printing-related formats, languages, and protocols |
| https://extension.nirsoft.net | Contains program data related to files. |
The following resources are no longer available:
| URL | Notes |
|---|---|
| http://wotsit.org/ | ( |
| http://unarchiver.c3.cx/formats | (View on the Wayback Machine) |
| http://rewiki.regengedanken.de/ Game reverse-engineering | (View on the Wayback Machine) |
[edit] Emulation
- http://nonmess.retrogames.com/ - Emulator listing for various computer formats, including MESS and single-machine emulators.
- The Emulation Framework is software developed by the international KEEP project, co-funded by the European Union's 7th Framework Programme.
[edit] Books
- Compressed Image File Formats: JPEG, PNG, GIF, XBM, BMP by John Miano (1999)
- Encyclopedia of Graphics File Formats by James D. Murray and William VanRyper (1994, 1996) Copy Acquired! Refer to the main article.
- Graphics File Formats by David C. Kay and John R. Levine (1994)
- Graphics File Formats: Reference and Guide by C. Wayne Brown, Barry J. Shepherd (1994)
- File Formats for Popular Personal Computer Software: A Programmer's Reference (Self-teaching Guides) by Jeff Walden (1986) Copy Acquired!
- File Formats on the Internet: A Guide for PC Users by Allison B. Zhang (1996) Copy Acquired!
- 3D Graphics File Formats: A Programmer's Reference by Keith Rule (1996)
- More File Formats for Popular PC Software: A Programmer's Reference by Jeff Walden (1987) Copy Acquired!
- Lotus File Formats for 1-2-3 Symphony & Jazz: File Structure Descriptions for Developers from Lotus, Inc. (1986)
- Inside Windows File Formats by Tom Swan (Nov 1993)
- Internet File Formats: Your Complete Resource for Sending, Receiving, and Using Internet Files by Tim Kientzle (Oct 15, 1995) Archive.org Scan, Companion CD-ROM
- File Formats for Popular PC Software by Jeff Walden (Nov 1992)
- PC File Formats and Conversions/Book and Disk (Developers Series) by Ralf Kussmann (Mar 1990)
- Windows Undocumented File Formats; Working Inside 16- and 32- bit Windows by Pete Davis (Jan 23, 1997)
- Graphics File Formats: The Complete Reference by John R. Levine and David C. Kay (May 1992)
- Using Pcx Graphics Files: The Programmer's Definitive Guide to Pcx File Formats by Roger T. Stevens (Apr 1, 1996)
- The File Formats Handbook by Gunter Born (Sep 1995)
- X Window System File Formats and Application Conventions (X11R4) by The Open Group (Jul 17, 1991)
- Guidelines on the Production and Preservation of Digital Audio Objects by IASA (2009)
- Android Forensics: Investigation, Analysis and Mobile Security for Google Android - Andrew Hoog - contains info on the Android file structure and how to obtain data from a locked phone, usually of a dead person, or a poor guy who forgot his password.
[edit] Other Useful Materials and Services
- http://www.nsrl.nist.gov/ National Software Reference Library (see also http://blogs.loc.gov/digitalpreservation/2012/05/life-saving-the-national-software-reference-library/)
- http://www.openplanetsfoundation.org/software/fido Format Identification for Digital Objects
- https://github.com/usnationalarchives/File-Analyzer File Analyzer
- https://sk1project.net/modules.php?name=Products&product=uniconvertor UniConvertor is a universal vector graphics translator. It is a command line tool which uses sK1 object model to convert one format to another
- http://www.textfiles.com/programming/FORMATS/
- http://wiki.opf-labs.org/display/SPR/Digital+Preservation+Tools Wiki list of digital preservation tool lists
- http://wiki.opf-labs.org/display/REQ/Digital+Preservation+and+Data+Curation+Requirements+and+Solutions Digital Preservation and Data Curation Requirements and Solutions. Not classified by formats, but by datasets, issues and solutions.
- http://fileformats.wordpress.com/ - The File Formats Blog
- http://www.archive.org/details/cdbbsarchive - The Internet Archive has over 1,500 CD-ROMs loaded with shareware, and with that comes converters, documentation and other vital works related to file formats.
- Crowd sourced Representation Information for Supporting Preservation (cRIsp)
- National Software Reference Library
- Linked Data URIs for MIME Types
- http://darwinsys.com/file/ UNIX file(1) format guessing utility
- http://www.filesignatures.net/ Online database of file signatures (magic numbers)
- http://www.garykessler.net/library/file_sigs.html List of file signatures (magic numbers)
- Data Formats from Paul Bourke Useful information on older formats. Categories include Geometric (e.g., 3-D), Audio, and Image.
- Graphics File Formats page from Martin Reddy Useful information on older formats. Categories are: 2-D and 3-D, with supplementary resources.
- LibAV Sample Files collection, over 50GB
- http://www.corel.com/content/pdf/wpx4/corel-wordperfect-office-X4-reviewers-guide.pdf Corel WordPerfect Office Reviewers Guide, Appendix A gives useful overview of old Office formats + their typical file extensions.
- http://documentation.statsoft.com/STATISTICAHelp.aspx?path=common/CommonMenus/CompatibleDocumentTypes Some info on formats of / compatible with Statsoft Statistica
- http://web-beta.archive.org/web/20100210224635/http://medlem.spray.se/converters Loads of DOS / Windows conversion programs - this appears to be the most recent grab held by the Internet Archive
- https://github.com/kreativekorp/ksfl Project to read/write various container formats
- http://www.kreativekorp.com/swdownload/wildfire/HC%20FILE%20FORMAT%202010.TXT Description of the HyperCard stack file format
- Media Archeology Lab
- Bitsavers document library of DEC manuals
- Document Liberation Project
- Unusual sources of file format signatures
- The Dead Media Project
- Advice on File Formats for the Creation of Digital Records (Archives New Zealand)
- An introduction to using the command line interface to work with files and directories
- DigiPres Commons Community-owned digital preservation resources
- POWRR Tool Grid
- Falstaff: online file identification utility
- BitCurator access tools
- Document Liberation Project projects
- Open LossLess in STanDards (GitHub)
- http://www.manmrk.net/tutorials/compress/index.htm A large collection of 1990s compression software
