How to transform large XML file? using .net

Thread view:

Enable EMail Alerts

Start New Thread

Thread rating:

raj@aol.com - 12 Mar 2008 01:21 GMT

we have a 3 gig of xml data. we need to transform this data using our XSL
file.
when i use the regular transform methods of course i run out of memeory.

the XSL file has quite bit of rules so i really cannot move them in to my
code.
is there way to transform the file streamingly?

thanks.

Reply to this Message

John Saunders [MVP] - 12 Mar 2008 03:00 GMT

> we have a 3 gig of xml data. we need to transform this data using our XSL
> file.
[quoted text clipped - 3 lines]
> code.
> is there way to transform the file streamingly?

Not using XSL. You can, of course, read the file using an XmlReader, and
write it using an XmlWriter. This will work, no matter how large the file
is.

Also, if you're aware of the structure of the data in the file, you may find
that you don't need the full generality of XSL. Among other things, there
may be large sections of the file that would not have been modified. You can
read and write those without having to touch them.

Signature

--------------------------------------------------------------------------------
John Saunders | MVP - Windows Server System - Connected System Developer

Reply to this Message

Martin Honnen - 12 Mar 2008 13:42 GMT

> we have a 3 gig of xml data. we need to transform this data using our XSL
> file.
[quoted text clipped - 3 lines]
> code.
> is there way to transform the file streamingly?

Not with .NET's XslCompiledTransform. However the commercial version of
Saxon (currently version 9) <URL:http://www.saxonica.com/> has a
streaming mode
<URL:http://www.saxonica.com/documentation/sourcedocs/serial.html>.
And you have already been pointed to XmlReader and XmlWriter as an
alternative to XSLT.

Signature

Martin Honnen --- MVP XML
http://JavaScript.FAQTs.com/

Reply to this Message

How to transform large XML file? using .net

Free Magazines