xsl-list
[Top] [All Lists]

RE: [xsl] Performance tips to speed up multiple transforms

2010-11-07 09:35:28
I'm transforming around 500 individual XML log files - ~250MB worth
- into 4 output
files.  Each log file contributes to all 4 output files.  At present,
I'm running a Saxon
transform within VBScript with one XSLT file for each log file.  It
processes around 2
log files per second.  I guess it's slow 'cos I'm shelling out to a
hidden command box
every time I transform a log file(open a shell, start java, open the
Saxon .jar file, run
the transform, append the 4 results to the 4 'master' output files,
close everything,
repeat ).  It works, but I guess it could be significantly more
efficient.

What would the smart person be looking at to speed up the process?
Write the
whole script in Java?  .NET?  C++... Or just make a Transform 'do' the
whole thing?

What you are describing sounds like a perfect use case for an XProc
pipeline (that would loop over the input XML documents, transform them,
and generate the output files.)

Regards,
Vojtech

--
Vojtech Toman
Consultant Software Engineer
EMC | Information Intelligence Group
vojtech(_dot_)toman(_at_)emc(_dot_)com
http://developer.emc.com/xmltech


--~------------------------------------------------------------------
XSL-List info and archive:  http://www.mulberrytech.com/xsl/xsl-list
To unsubscribe, go to: http://lists.mulberrytech.com/xsl-list/
or e-mail: <mailto:xsl-list-unsubscribe(_at_)lists(_dot_)mulberrytech(_dot_)com>
--~--