At 2015-01-19 15:46 +0000, Mailing Lists Mail daktapaal(_at_)gmail(_dot_)com
wrote:
I have a value 9.88 , I use the div to do an operation
Pseudo code:
var num = 9.88
var result = $num div 100
I expect 0.0988 .. I get 0.09880000000000001
I am using Saxon-EE-9.5.1-5.jar
What is happening?
What is happening is that doing the arithmetic with the binary
representations of 9.88 and 100 create a result in binary that when
precisely converted to decimal give you the result you see.
As Martin suggests, if you are using XSLT 2 then you can use decimal
representations of your values and do arithmetic with those.
I hope this helps understand the issue.
. . . . . . Ken
--
Check our site for free XML, XSLT, XSL-FO and UBL developer resources |
Free 5-hour lecture: http://www.CraneSoftwrights.com/links/video.htm |
Crane Softwrights Ltd. http://www.CraneSoftwrights.com/s/ |
G. Ken Holman
mailto:gkholman(_at_)CraneSoftwrights(_dot_)com |
Google+ profile: http://plus.google.com/+GKenHolman-Crane/about |
Legal business disclaimers: http://www.CraneSoftwrights.com/legal |
---
This email has been checked for viruses by Avast antivirus software.
http://www.avast.com
--~----------------------------------------------------------------
XSL-List info and archive: http://www.mulberrytech.com/xsl/xsl-list
EasyUnsubscribe: http://lists.mulberrytech.com/unsub/xsl-list/1167547
or by email: xsl-list-unsub(_at_)lists(_dot_)mulberrytech(_dot_)com
--~--