xsl-list
[Top] [All Lists]

Re: coping with huge xml-saxon

2003-06-17 14:04:00
On Mon, Jun 16, 2003 at 06:01:15PM +0200, Johannes Döbler wrote:

600 MB will most probably kill every classic XSLT processor, since they all 
try to load the document into memory.
You can do the following:

So what exactly is the memory limit for XSLT transformations? I know
that Michale Kay in his book mentions that documents larger than 1 or 2
MB cannot be processed by an XSLT processor, because, as you say, the
processor loads them into memory.

However, why his this limit so low? On my box I have 256 MB of memory.
It is not uncommon for a new machine to have 500 MB of memory--or even
double that amount.

It seem that if you have 256 MB of memory, you ought to be able to
handle a document of around 50 MB. (I think the processor actually
requires something like 4 times the size of the document--or was it 10?)

I see the memory as the only drawback for xslt transformations. After
all, I have documents that are around 1 MB in size, and I can easily see
real documents being many times that size

thanks

Paul


Write a SAX-ContentHandler to transform your document

Use STX (Streaming Transformations: http://stx.sourceforge.net/) instead of 
XSLT

Try jd.bigxml (http://www.aztecrider.com/bigxml/): It is a XPath model 
implementation for huge XML documents and can be used with the
XSLT Processor jd.xslt to transform such documents. If you give it at try 
then please let me know whether it worked.

regards,
Johannes


Dear all,
I have a problem which i cant figure out how to get round. I have an XML
that is as big as 600 Mg and everything fails!!!
I am using saxon and running this under win2k Machine. It reports of memory
out of stack and i tried increasing the memory to the JVM with the JVM
parameter and apparently we  can not increase the memory to more than a
certain limit.I would appreciate if someone can please let me know how we
can solve this
Thanks


XSL-List info and archive:  http://www.mulberrytech.com/xsl/xsl-list


XSL-List info and archive:  http://www.mulberrytech.com/xsl/xsl-list

-- 

************************
*Paul Tremblay         *
*phthenry(_at_)earthlink(_dot_)net*
************************

 XSL-List info and archive:  http://www.mulberrytech.com/xsl/xsl-list