xsl-list
[Top] [All Lists]

Re: [xsl] Saxon Div Issue

2015-01-19 10:06:17
I wouldn't know if it will be a double that I will be a decimal.
Ignore the above inebriated statement.. All I meant was, I wouldnt
know if it will be a decimal.


On Mon, Jan 19, 2015 at 11:03 AM, Mailing Lists Mail
daktapaal(_at_)gmail(_dot_)com 
<xsl-list-service(_at_)lists(_dot_)mulberrytech(_dot_)com> wrote:
THe problem is , I dont know what will come in the $num. It is an
xpath. It comes from an XML element.

SO sometimes, the element contains 988, and sometimes it contains 98.8
.. so my pseudo code actually is :"

$num = /xpath/num
var result = $num div 100

I wouldn't know if it will be a double that I will be a decimal.

Dak


On Mon, Jan 19, 2015 at 10:57 AM, G. Ken Holman 
g(_dot_)ken(_dot_)holman(_at_)gmail(_dot_)com
<xsl-list-service(_at_)lists(_dot_)mulberrytech(_dot_)com> wrote:
At 2015-01-19 15:46 +0000, Mailing Lists Mail daktapaal(_at_)gmail(_dot_)com 
wrote:

I have a value 9.88 , I use the div  to do an operation

Pseudo code:

var num = 9.88
var result = $num div 100

I expect 0.0988 .. I get 0.09880000000000001

I am using Saxon-EE-9.5.1-5.jar

What is happening?


What is happening is that doing the arithmetic with the binary
representations of 9.88 and 100 create a result in binary that when
precisely converted to decimal give you the result you see.

As Martin suggests, if you are using XSLT 2 then you can use decimal
representations of your values and do arithmetic with those.

I hope this helps understand the issue.

. . . . . . Ken

--
Check our site for free XML, XSLT, XSL-FO and UBL developer resources |
Free 5-hour lecture:  http://www.CraneSoftwrights.com/links/video.htm |
Crane Softwrights Ltd.             http://www.CraneSoftwrights.com/s/ |
G. Ken Holman                    
mailto:gkholman(_at_)CraneSoftwrights(_dot_)com |
Google+ profile:       http://plus.google.com/+GKenHolman-Crane/about |
Legal business disclaimers:     http://www.CraneSoftwrights.com/legal |


---
This email has been checked for viruses by Avast antivirus software.
http://www.avast.com



--~----------------------------------------------------------------
XSL-List info and archive: http://www.mulberrytech.com/xsl/xsl-list
EasyUnsubscribe: http://lists.mulberrytech.com/unsub/xsl-list/1167547
or by email: xsl-list-unsub(_at_)lists(_dot_)mulberrytech(_dot_)com
--~--

<Prev in Thread] Current Thread [Next in Thread>