xsl-list
[Top] [All Lists]

RE: [xsl] Transforming large XML docs in small amounts of memory

2007-04-30 04:23:16

It depends very much on the nature of the transformation.

Some transformations are amenable to the approach described at

http://www.saxonica.com/documentation/sourcedocs/serial.html

Some can benefit from inserting a SAX filter into the pipeline before the
transformation proper, simply to remove the parts of the input document that
aren't needed. 

Be aware also that there are considerable differences between different tree
models in the amount of space they use. The Saxon TinyTree is generally 4-5
times raw data size whereas a DOM is often 10 times raw data size.

Michael Kay
http://www.saxonica.com/


-----Original Message-----
From: Ronan Klyne [mailto:ronan(_dot_)klyne(_at_)groupbc(_dot_)com] 
Sent: 30 April 2007 10:19
To: xsl-list(_at_)lists(_dot_)mulberrytech(_dot_)com
Subject: [xsl] Transforming large XML docs in small amounts of memory

Hi all,

I am trying to find ways of reducing the memory requirements 
of our transforms.
The main factor driving the memory usage up is the size of 
the input document (upto about 150Mb), but this is out of our 
control at this point.
So, the question: Is there anything which can be done (or 
avoided) in the XSL to decrease the amount of memory used in 
the transform?

(I appreciate that this question is very abstract, and I 
apologise - I'm mostly fishing for ideas, or a confirmation 
of my suspicion that not much can be done...)

      # r

--
Ronan Klyne
Business Collaborator Developer
Tel: +44 (0)870 163 2555
ronan(_dot_)klyne(_at_)groupbc(_dot_)com
www.groupbc.com

--~------------------------------------------------------------------
XSL-List info and archive:  http://www.mulberrytech.com/xsl/xsl-list
To unsubscribe, go to: http://lists.mulberrytech.com/xsl-list/
or e-mail: 
<mailto:xsl-list-unsubscribe(_at_)lists(_dot_)mulberrytech(_dot_)com>
--~--



--~------------------------------------------------------------------
XSL-List info and archive:  http://www.mulberrytech.com/xsl/xsl-list
To unsubscribe, go to: http://lists.mulberrytech.com/xsl-list/
or e-mail: <mailto:xsl-list-unsubscribe(_at_)lists(_dot_)mulberrytech(_dot_)com>
--~--