Hi,
I agree with Andrew. These projects are fun, and XSLT pipelines are
well suited to them, because they are capable of exposing the semantic
issues and keeping syntax out of the way. This is even true when the
first step is a rendering of a non-XML format into an XML
representation, and the last step is serializing the data in a form
optimized for something else (such as your query engine of choice).
And no, streaming is not necessary, although it can help.
Plus, the biggest problem isn't scale anyway: it's the semantic
integrity of the data or (more likely) the lack thereof. This can be
compounded by non-technical issues such as data owners not seeing the
information they actually have because they are blinded by their
expectations of what it is "supposed" to be.
Cheers, Wendell
Wendell Piez | http://www.wendellpiez.com
XML | XSLT | electronic publishing
Eat Your Vegetables
_____oo_________o_o___ooooo____ooooooo_^
On Tue, Nov 5, 2013 at 5:26 AM, Andrew Welch
<andrew(_dot_)j(_dot_)welch(_at_)gmail(_dot_)com> wrote:
XSLT streaming is all about processing large amounts of (XML-formatted) data.
So XSLT streaming should fit in the "data science" and "data analytics"
categories.
Broad Question: Would you provide a scenario/example of doing data
science/data analytics using XSLT streaming please?
Typically the data is held in multiple files rather than 1 big one, so
you don't necessarily need streaming, just a set of steps that process
directories of xml into various intermediate formats, then into the
final presentation view (such as a table with the data grouped,
sorted, with counts)
I've done this sort of thing a few times now and I always enjoy it.
--
Andrew Welch
http://andrewjwelch.com
--~------------------------------------------------------------------
XSL-List info and archive: http://www.mulberrytech.com/xsl/xsl-list
To unsubscribe, go to: http://lists.mulberrytech.com/xsl-list/
or e-mail:
<mailto:xsl-list-unsubscribe(_at_)lists(_dot_)mulberrytech(_dot_)com>
--~--
--~------------------------------------------------------------------
XSL-List info and archive: http://www.mulberrytech.com/xsl/xsl-list
To unsubscribe, go to: http://lists.mulberrytech.com/xsl-list/
or e-mail: <mailto:xsl-list-unsubscribe(_at_)lists(_dot_)mulberrytech(_dot_)com>
--~--