javaxmlstreamingxom

How to stream XML data using XOM?


Say I want to output a huge set of search results, as XML, into a PrintWriter or an OutputStream, using XOM. The resulting XML would look like this:

<?xml version="1.0" encoding="UTF-8"?>
<resultset>
    <result>
       [child elements and data]
    </result>
    ...
    ...
    [1000s of result elements more]
</resultset>

Because the resulting XML document could be big (hundreds of megabytes, perhaps), I want to output it in a streaming fashion (instead of creating the whole Document in memory and then writing that).

The granularity of outputting one <result> at a time is fine, so I want to generate one <result> after another, and write it into the stream. In other words, I'd simply like to do something like this pseudocode (automatic flushing enabled, so don't worry about that):

open stream/writer
write declaration
write start tag for <resultset>
while more results:
    write next <result> element
write end tag for <resultset> 
close stream/writer

I've been looking at Serializer, but the necessary methods, writeStartTag(Element), writeEndTag(Element), write(DocType) are protected, not public! Is there no other way than to subclass Serializer to be able to use those methods, or to manually write the start and end tags directly into the stream as Strings, bypassing XOM altogether? (The latter wouldn't be too bad in this simple example, but in the general case it would get quite ugly.)

Am I missing something or is XOM just not made for this?

With dom4j I could do this easily using XMLWriter - it has constructors that take a Writer or OutputStream, and methods writeOpen(Element), writeClose(Element), writeDocType(DocumentType) etc. Compare to XOM's Serializer where the only public write method is the one that takes a whole Document.

(This is related to my question about the best dom4j replacement where XOM is a strong contender.)


Solution

  • I ran in to the same issue, but found it's pretty simple to do what you mentioned as an option and subclass Serializer as follows:

    public class StreamSerializer extends Serializer {
    
        public StreamSerializer(OutputStream out) {
            super(out);
        }
    
        @Override
        public void write(Element element) throws IOException {
            super.write(element);
        }
    
        @Override
        public void writeXMLDeclaration() throws IOException {
            super.writeXMLDeclaration();
        }
    
        @Override
        public void writeEndTag(Element element) throws IOException {
            super.writeEndTag(element);
        }
    
        @Override
        public void writeStartTag(Element element) throws IOException {
            super.writeStartTag(element);
        }
    
    }
    

    Then you can still take advantage of the various XOM config like setIdent, etc. but use it like this:

    Element rootElement = new Element("resultset");
    StreamSerializer serializer = new StreamSerializer(out);
    serializer.setIndent(4);
    serializer.writeXMLDeclaration();
    serializer.writeStartTag(rootElement);
    while(hasNextElement()) {
        serializer.write(nextElement());
    }
    serializer.writeEndTag(rootElement);
    serializer.flush();