Jump to content

Windows-1252

From Wikipedia, the free encyclopedia
(Redirected from Code Page 1252)
This article is about the character encoding commonly mislabeled as "ANSI". For the actual ANSI character encoding, see ASCII. For the actual "ANSI extended Latin" encoding, see ANSEL.
Windows-1252
MIME / IANAwindows-1252[1]
Alias(es)cp1252 (code page 1252)
Language(s)All supported by ISO/IEC 8859-1 plus full support for French and Finnish and ligature forms for English; e.g. Danish (except for a rare exceptional letter), Irish, Italian, Norwegian, Portuguese, Spanish, Swedish, German (missing uppercase ẞ), Icelandic, Faroese, Luxembourgish, Albanian, Estonian, Swahili, Tswana, Catalan, Basque, Occitan, Rotokas, Toki Pona, Lojban, Romansh, Dutch (except the IJ/ij character, substituted by IJ/ij or ÿ), and Slovene (except the č character, substituted by ç).
Created byMicrosoft
StandardWHATWG Encoding Standard
Classificationextended ASCII, Windows-125x
ExtendsISO 8859-1 (excluding C1 controls)
Transforms / EncodesISO 8859-15
Succeeded byUnicode (UTF-8, UTF-16)

Windows-1252 or CP-1252 (Windows code page 1252) is a legacy single-byte character encoding[2] that is used by default (as the "ANSI code page") in Microsoft Windows throughout the Americas, Western Europe, Oceania, and much of Africa.[3]

Initially the same as ISO 8859-1, it began to diverge starting in Windows 2.0 by adding additional characters in the 0x80 to 0x9F (hex) range (the ISO standards reserve this range for C1 control codes). Notable additional characters include curly quotation marks and all printable characters from ISO 8859-15.

It is the most-used single-byte character encoding in the world. Although almost all websites now use the multi-byte character encoding UTF-8, as of July 2024 1.2%[4] of websites declared ISO 8859-1 which is treated as Windows-1252 by all modern browsers (as demanded by the HTML5 standard[5]), plus 0.3% declared Windows-1252 directly,[4][6] for a total of 1.5%. Some countries or languages show a higher usage than the global average, in 2024 Brazil according to website use, use is at 3.4%,[7] and in Germany at 2.7%.[8][9] (these are the sums of ISO-8859-1 and CP-1252 declarations).

Name

[edit]

It is known to Windows by the code page number 1252, and by the IANA-approved name "windows-1252".

Historically, the phrase "ANSI Code Page" was used in Windows to refer to non-DOS encodings; the intention was that most of these would be ANSI standards such as ISO-8859-1. Even though Windows-1252 was the first and by far most popular code page named so in Microsoft Windows parlance, the code page has never been an ANSI standard. Microsoft explains, "The term ANSI as used to signify Windows code pages is a historical reference, but is nowadays a misnomer that continues to persist in the Windows community."[10]

LaTeX can input Windows-1252 by using inputenc.sty with parameter ansinew (and more recently cp1252). [11][12]

IBM uses code page 1252 (CCSID 1252 and euro sign extended CCSID 5348) for Windows-1252.[13][14][15]

It is called "WE8MSWIN1252" by Oracle Database.[16]

History

[edit]
  • The first version of the codepage was used in Microsoft Windows 1.0. It matched the ISO-8859-1 standard (including leaving code points 0xD7 and 0xF7 undefined, as they were not in the standard at that time).
  • The second version of the codepage was introduced in Microsoft Windows 2.0. In this version, code points 0xD7, 0xF7, 0x91, and 0x92 are defined.
  • The third version of the codepage was introduced in Microsoft Windows 3.1. It defined all code points used in the final version except the euro sign and the Z with caron character pair.
  • The final version (shown below) was introduced in Microsoft Windows 98.

Starting in the 1990s, many Microsoft products that could produce HTML included Windows-1252-exclusive characters, but marked the encoding as ISO-8859-1, ASCII, or undeclared.[citation needed] Characters exclusive to Windows-1252 would render incorrectly on non-Windows operating systems (often as question marks).[17][18] In particular, typographers' quotes—curly variants of the standard straight apostrophes and quotation marks in US-ASCII—were commonly used in files produced in Windows applications such as Microsoft Word due to the smart quotes feature, which can automatically convert straight apostrophes and quotation marks to the curly variants.[19] To fix this, by 2000 most web browsers and e-mail clients treated the charsets ISO-8859-1 and US-ASCII as Windows-1252[citation needed]—this behavior is now required by the HTML5 specification.[5] Undeclared charsets in HTML are also assumed to be Windows-1252.[20][21]

Although Windows NT supported Unicode and attempted to encourage programs to use it, it only provided the 16-bit code units of UCS-2/UTF-16, despite the existing support for other multibyte character encodings. As many applications preferred to use 8-bit strings, Windows-1252 remained the most popular encoding on Windows even after it added support for UTF-16. Unicode support in Windows has improved over time, with UTF-8 support available starting in Windows 10.

Codepage layout

[edit]

The following table shows Windows-1252. Differences from ISO-8859-1 have the Unicode code point number below the character, based on the Unicode.org mapping of Windows-1252 with "best fit". A tooltip, generally available only when one points to the immediate right of the character, shows the Unicode code point name and the decimal Alt code.

Windows-1252 (CP1252)[22][23][24][25][26]
0 1 2 3 4 5 6 7 8 9 A B C D E F
0_ NUL SOH STX ETX EOT ENQ ACK BEL BS HT LF VT FF CR SO SI
1_ DLE DC1 DC2 DC3 DC4 NAK SYN ETB CAN EM SUB ESC FS GS RS US
2_  SP  ! " # $ % & ' ( ) * + , - . /
3_ 0 1 2 3 4 5 6 7 8 9 : ; < = > ?
4_ @ A B C D E F G H I J K L M N O
5_ P Q R S T U V W X Y Z [ \ ] ^ _
6_ ` a b c d e f g h i j k l m n o
7_ p q r s t u v w x y z { | } ~ DEL
8_ €
20AC 		‚
201A 		ƒ
0192 		„
201E 		…
2026 		†
2020 		‡
2021 		ˆ
02C6 		‰
2030 		Š
0160 		‹
2039 		Œ
0152 		Ž
017D
9_ ‘
2018 		’
2019 		“
201C 		”
201D 		•
2022 		–
2013 		—
2014 		˜
02DC 		™
2122 		š
0161 		›
203A 		œ
0153 		ž
017E 		Ÿ
0178
A_ NBSP ¡ ¢ £ ¤ ¥ ¦ § ¨ © ª « ¬ SHY ® ¯
B_ ° ± ² ³ ´ µ · ¸ ¹ º » ¼ ½ ¾ ¿
C_ À Á Â Ã Ä Å Æ Ç È É Ê Ë Ì Í Î Ï
D_ Ð Ñ Ò Ó Ô Õ Ö × Ø Ù Ú Û Ü Ý Þ ß
E_ à á â ã ä å æ ç è é ê ë ì í î ï
F_ ð ñ ò ó ô õ ö ÷ ø ù ú û ü ý þ ÿ

  According to the information on Microsoft's and the Unicode Consortium's websites, positions 81, 8D, 8F, 90, and 9D are unused; however, the Windows API MultiByteToWideChar maps these to the corresponding C1 control codes. The "best fit" mapping documents this behavior, too.[22]

[edit]

OS/2 extensions

[edit]

The OS/2 operating system supports an encoding by the name of Code page 1004 (CCSID 1004) or "Windows Extended".[27][28] This mostly matches code page 1252, with the exception of certain C0 control characters being replaced by diacritic characters.

Code page 1004 (differing rows only)[29][30][31][32]
0 1 2 3 4 5 6 7 8 9 A B C D E F
0_ NUL SOH STX ETX ˉ
02C9 		˘
02D8 		˙
02D9 		BEL ˚
02DA 		HT ˝
02DD 		˛
02DB 		ˇ
02C7 		CR SO SI

MS-DOS extensions (rare)

[edit]

There is a rarely used, but useful, graphics extended code page 1252 where codes 0x00 to 0x1f allow for box drawing as used in applications such as MSDOS Edit and Codeview. One of the applications to use this code page was an Intel Corporation Install/Recovery disk image utility from mid/late 1995. These programs were written for its P6 User Test Program machines (US example[33]). It was used exclusively in its then EMEA region (Europe, Middle East & Africa). In time the programs were changed to use code page 850.

Graphics Extended Code Page 1252[citation needed]
0 1 2 3 4 5 6 7 8 9 A B C D E F
0_ ○ ■ ↑ ↓ → ← ║ ═ ╔ ╗ ╚ ╝ ░ ▒ ► ◄
1_ │ ─ ┌ ┐ └ ┘ ├ ┤ ┴ ┬ ♦ ┼ █ ▄ ▀ ▬

Palm OS variant

[edit]

Each Palm OS device supports a single language and a single character encoding, depending on its locale.[34]

For languages such as English and French, Palm OS uses a custom character encoding based on Windows-1252. For Japanese, it instead uses a multibyte character encoding based on code page 932. Regardless of the system locale, all characters in the range 0x00 to 0x7F are guaranteed to be the same, except 0x5D which is the Yen sign in Japanese and a backslash on all others.[34]

Palm OS 3.1 introduced several changes to the character encoding to better align with Windows-1252:[35]

  • The special Palm OS glyphs "shortcut stroke" (0x9D) and "command stroke" (0x9E) were copied to 0x16 and 0x17, to ensure they were in the range guaranteed to be consistent between locales.[35] Starting in Palm OS 3.3, 0x16 and 0x17 are the only code points for those characters,[36] leaving 0x9D and 0x9E undefined.[37]
  • The numeric space (0x80) and horizontal ellipsis (0x85) were copied to 0x19 and 0x18 (respectively), to ensure they were in the range guaranteed to be consistent between locales.[35][36]
  • The Euro sign was added at 0x80, replacing what was previously the numeric space.[36]
  • The playing card suits were copied to the font Symbol 9,[35] although their original code points remain valid.[36][37]

The following is the variant of Windows-1252 used by Palm OS 3.3 onward for English and several other locales.[36] Python gives it the palmos label, describing it as the encoding for Palm OS 3.5.[38][39] Differences from Windows-1252 have their Unicode code point.

Palm OS 3.3 character encoding[37][39]
0 1 2 3 4 5 6 7 8 9 A B C D E F
8_ €[a] ‚ ƒ „ …[b] † ‡ ˆ ‰ Š ‹ Œ ♦
2666 		♣
2663 		♥
2665
9_ ♠
2660 		‘ ’ “ ” • – — ˜  ™ š › œ [c] [d] Ÿ

See also

[edit]

Notes

[edit]
  1. ^ Prior to Palm OS 3.1, the character at code point 0x80 was U+2007 NUMERIC SPACE; starting in Palm OS 3.1, 0x80 is the Euro sign and 0x19 is U+2007 NUMERIC SPACE instead.[36]
  2. ^ Starting in Palm OS 3.1, this character is also duplicated at 0x18.[35][36]
  3. ^ Prior to Palm OS 3.3, this code point was the Palm OS-exclusive character "shortcut stroke"; starting in Palm OS 3.3, this code point is undefined.[35][36]
  4. ^ Prior to Palm OS 3.3, this code point was the Palm OS-exclusive character "command stroke"; starting in Palm OS 3.3, this code point is undefined.[35][36]

References

[edit]
  1. ^ Character Sets, Internet Assigned Numbers Authority (IANA), 2018-12-12
  2. ^ "Encoding. Living Standard". WHATWG. 13 June 2024. § 9. Legacy single-byte encodings. Retrieved 2024-06-28.
  3. ^ Karl-Bridge-Microsoft (2021-10-26). "Code Pages - Win32 apps". learn.microsoft.com. Retrieved 2024-10-09.
  4. ^ a b "Historical trends in the usage statistics of character encodings for websites, December 2023". w3techs.com. Retrieved 2024-07-19.
  5. ^ a b "Encoding". WHATWG. 27 January 2015. sec. 5.2 Names and labels. Archived from the original on 4 February 2015. Retrieved 4 February 2015.
  6. ^ "Frequenty Asked Questions". w3techs.com.
  7. ^ "Distribution of Character Encodings among websites that use Brazil". W3Techs. Archived from the original on 4 April 2024. Retrieved 2024-07-19.
  8. ^ "Distribution of Character Encodings among websites that use .de". W3Techs. Archived from the original on 4 April 2024. Retrieved 2024-07-19.
  9. ^ "Distribution of Character Encodings among websites that use German". w3techs.com. Retrieved 2023-01-16.
  10. ^ Wissink, Cathy (5 April 2002). "Unicode and Windows XP" (PDF). Microsoft. p. 1. Archived from the original (PDF) on 4 February 2015. Retrieved 4 February 2015.
  11. ^ "LaTeX News, Issue 28" (PDF; 379 KB). The LaTeX Project. Apr 2018. Retrieved 2024-07-27.
  12. ^ "Inputenc – Accept different input encodings". The LaTeX Project. 2024-02-08. Retrieved 2024-07-27.
  13. ^ "Code page 1252 information document". IBM. 30 September 1997. Archived from the original on 2016-03-03.
  14. ^ "CCSID 1252 information document". IBM. Archived from the original on 2016-03-26.
  15. ^ "CCSID 5348 information document". IBM. Archived from the original on 2014-11-29.
  16. ^ "Database Client Installation Guide". Oracle. Retrieved 2021-02-14.
  17. ^ Texin, Tex. "Comparing Characters in Windows-1252, ISO-8859-1, ISO-8859-15". I18nQA.com.
  18. ^ van Emden, Eva (28 January 2011). "How to make typographers' quotes in HTML". vancouvereditor.com. Retrieved 7 January 2024. If you use typographers' quotes without specifying the right character encoding for your HTML file, some of your viewers are going to see question marks, boxes, or other crazy symbols instead of the beautiful curly quotes you intended them to see.
  19. ^ "Smart quotes in Word". Microsoft Support. Microsoft. Retrieved 7 January 2024.
  20. ^ "NetWare Web Search: Understanding Character Set Encodings". Novell Documentation. Novell. if a document does not contain a CHARSET encoding value, the default encoding for HTML documents is ISO-8859-1, also known as Latin1. The default encoding for plain text documents is US-ASCII.
  21. ^ Observed behavior in Chrome, this may be UTF-8 in some browsers.[original research?]
  22. ^ a b "Unicode mappings of Windows-1252 with 'Best Fit'". Unicode. Archived from the original on 4 February 2015. Retrieved 4 February 2015.
  23. ^ Code Page 01252 (PDF), IBM, 1998, archived (PDF) from the original on 27 October 2023
  24. ^ Code Page (CPGID) 01252 (txt), IBM, 1998, archived from the original on 8 April 2023
  25. ^ International Components for Unicode (ICU), ibm-1252_P100-2000.ucm, 2002-12-03
  26. ^ International Components for Unicode (ICU), ibm-5348_P100-1997.ucm, 2002-12-03
  27. ^ "Code page 1004 information document". Archived from the original on 2015-06-25.
  28. ^ "CCSID 1004 information document". Archived from the original on 2016-03-26.
  29. ^ "Code Page 01004" (PDF). IBM. Archived (PDF) from the original on 2015-07-08. (version based on Windows 3.1 version of Windows-1252)
  30. ^ Code Page CPGID 01004 (pdf) (PDF), IBM
  31. ^ Code Page CPGID 01004 (txt), IBM
  32. ^ Borgendale, Ken (2001). "Codepage 1004 - Windows Extended". OS/2 codepages by number. Archived from the original on 2018-05-13. Retrieved 2018-05-13. (version based on current version of Windows-1252)
  33. ^ Storaasli, Olaf (1996). "Performance of the NASA equation solvers on computational mechanics applications" (PDF). Performance of NASA Equation Solvers on Computational Mechanics Applications. NASA. doi:10.2514/6.1996-1505. S2CID 15711051. Archived from the original (PDF) on 2019-05-03.
  34. ^ a b "Chapter 13: Localized Applications". Palm OS Programmer's Companion (PDF). Palm Computing Platform. March 16, 2000. p. 321.
  35. ^ a b c d e f g "Appendix B: Compatibility Guide". Palm OS SDK Reference (PDF). Palm Computing Platform. March 16, 2000. pp. 1181–1182.
  36. ^ a b c d e f g h i Walleij, Linus. "Palm Pilot Character Sets And Unicode Mappings". GNU Recode. Datorföreningen vid Lunds Universitet och Lunds Tekniska Högskola. Retrieved 10 October 2023.
  37. ^ a b c Parker, Greg. "Palm OS Built-in Fonts". Sealie Software. Retrieved 10 October 2023.
  38. ^ "codecs—Codec registry and base classes (§ Text Encodings)". The Python Standard Library—Python 3.9.4 Documentation. Python Software Foundation.
  39. ^ a b Mullender, Sjoerd (13 July 2002). "Python Character Mapping Codec for Palm OS 3.5". CPython source tree. Python Software Foundation. Retrieved 9 December 2021.
[edit]
Retrieved from "https://wiki.riteme.site/w/index.php?title=Windows-1252&oldid=1254983515"