Character encoding

From Just Solve the File Format Problem
(Difference between revisions)
Jump to: navigation, search
(→‎Specific character sets or encodings)
Line 131: Line 131:
 
* [[PETSCII]] (or PET ASCII or CBM ASCII; used by Commodore computers)
 
* [[PETSCII]] (or PET ASCII or CBM ASCII; used by Commodore computers)
 
* [[Unicode]]
 
* [[Unicode]]
 +
** [[BOCU-1]]
 
** [[CESU-8]]
 
** [[CESU-8]]
 
** [[GB18030]]
 
** [[GB18030]]
 
** [[Punycode]]
 
** [[Punycode]]
 +
** [[SCSU]]
 
** [[UCS-2]]
 
** [[UCS-2]]
 
** [[UTF-1]]
 
** [[UTF-1]]

Revision as of 16:59, 12 April 2016

File Format
Name Character encoding
Ontology

{{{caption}}}

Character Encodings are methods of representing characters of text, usually as numeric values which can be stored on computers as bits and bytes, but sometimes in other things (e.g., Braille represents them as patterns of raised dots). Sometimes they're also referred to as "character sets", but purists will make a distinction in that, strictly speaking, a character set is merely a repertoire of characters, the list of characters supported by some system, protocol, or file format, without it necessarily having any inherent order or numbering system. A character encoding assigns specific values (in some coding system) to each character. However, the distinction can get vague and fuzzy; there are multiple levels of abstraction (Unicode includes a set of defined characters as well as assigned numeric code points for each, but leaves it to other more specific encodings such as UTF-8 to define the specific bits/bytes that represent them in a file), and some protocols even use parameter names such as 'charset' to indicate which character encoding is in use, so the terminology can slip and slide even in "tech" uses. This section documents all the various sorts of character sets/encodings of any sort.

See Fonts for the renditions of character encodings as seen on screens and printouts. The appearance of a character is known as a "glyph", and a font consists of a set of glyphs mapped onto the more abstractly-defined characters as included in the character set that is part of a character encoding.

Contents

Specific character sets or encodings

Format details

Character encoding naming and numbering systems

Character escape codes

(used to enter characters in various systems and formats)

Character memory storage types

C++

  • char (C++) at least 8 bits
  • char16_t no less than 16 bits, no less than char
  • char32_t no less than 32 bits, no less than char16_t
  • wchar_t whatever the largest block of addressable memory happens to be on the system

Glib library

  • gunichar Unicode character (variable memory length)

Java Virtual Machine

Scala

Both char and scala.Char are wrappers around JVM's original types.

.Net framework

QuickBasic

There is no single character datatype. (There's STRING that holds up to 32767 characters assumed to be 1 byte each).

Tools

Commentary and satire

Other external links

References

Retrieved from "http://fileformats.archiveteam.org/index.php?title=Character_encoding&oldid=25374"
Personal tools
Namespaces

Variants
Actions
Navigation
Toolbox