ietf-xml-mime
[Top] [All Lists]

Re: UTF-16, the BOM, and media types

2000-03-22 14:51:10
At 04:34 PM 3/22/00 -0500, John Cowan wrote:
Section 4.3.3 of XML 1.0 says
 "Entities encoded in UTF-16 must begin with the Byte Order Mark described
  by ISO/IEC 10646 Annex E and Unicode Appendix B (the ZERO WIDTH NO-BREAK
  SPACE character, #xFEFF)."

That describes entities encoded in the charset called "UTF-16".  It says
nothing about entities encoded in the charsets "UTF-16BE" and "UTF-16LE"
or for that matter charset "x-focs".

Yep, if you hold your head at just the right angle, and don't think of
the word "rhinocerous", you can convince yourself that the 16[BL]E 
encodings are really different things entirely, just happen to share
a few characters with That Other Encoding's name, just close personal
friends, etc...

But I just don't get it.  This feels perverse.  I repeat, anyone using
any flavor of UTF-16 can (and usually does) put in a BOM, if only on a
belt-and-suspenders basis; and for this reason, de facto, the 16[BL]E
media types, which forbid this practice, are simply not in practical terms 
usable for XML.

I'm not denying that these things exist.  Just asserting that the RFC is
correct in saying they don't work with XML. -Tim

<Prev in Thread] Current Thread [Next in Thread>