javadatabasedata-visualizationprefusegraphml

Load very large file in prefuse

I have a huge XML file (measuring nearly 2GB) formatted in the Graphml XML format for a social graph. While creating a new graph via 

    graph = new GraphMLReader().readGraph("socialgraph.xml");

I get a "java.lang.OutOfMemoryError: Java heap space" exception Is there a way in prefuse to read the file, node by node. If not, can you recommend me some visualization toolkits that can handle such large sizes via XML or SQL databases.

Solution

  • First thing I would suggest trying is increasing the amount of memory you are allocating the JVM. Add this JVM argument when you run the program:

    -Xmx4g

    See this related question for more information: Increase heap size in java

    If you still have problems and want to try out a different visualization I would try gephi first.