2008/11/6 Colin Paul Adams <colin(_at_)colina(_dot_)demon(_dot_)co(_dot_)uk>:
"Andrew" == Andrew Welch
<andrew(_dot_)j(_dot_)welch(_at_)gmail(_dot_)com> writes:
>> You've lost me - we were talking about integer division, I
>> thought.
Andrew> 1000000000000000000000000000000001 is just too big for an
Andrew> 32 bit integer... (I think that's why DC chose it)
There is nothing that says you have to use a 32-bit integer.
No but I think that's the reason for the Saxon result of 10, 9, 10
(the reason DC chose that number)
>> If you are talking about xs:double, compared with xs:decimal,
>> then yes. But I don't see how that comes into the problem.
Andrew> I think it's the problem of representing a decimal:
Andrew> http://speleotrove.com/decimal/decifaq1.html#inexact
That's talking about representing decimals in floating-point binary -
but you can't do that for xs:decimal -it's not allowed.
oh ok, as a CS graduate I should know the different between double,
floating point and decimal... that lecture must have been on a Friday
afternoon.
--
Andrew Welch
http://andrewjwelch.com
Kernow: http://kernowforsaxon.sf.net/
--~------------------------------------------------------------------
XSL-List info and archive: http://www.mulberrytech.com/xsl/xsl-list
To unsubscribe, go to: http://lists.mulberrytech.com/xsl-list/
or e-mail: <mailto:xsl-list-unsubscribe(_at_)lists(_dot_)mulberrytech(_dot_)com>
--~--