[greenstone-users] Re: JAVA heap space problem with large collections

From Anupama of Greenstone Team
DateFri Jan 7 14:43:40 2011
Subject [greenstone-users] Re: JAVA heap space problem with large collections
In-Reply-To (518858597-61721291382089598-OPEN-XCHANGE-WebMail-tomcat-pegasus-polytechnic-edu-na)
Renate Morgenstern wrote:
> Good day,
> I have a collection of more than 5000 photos. It always took some time
> to open the collection (with 2048 M Xmx) , but after installing
> candidate 2.84 of October 2010, I get a Java heap error. I increased the
> size from 128 to 2048, but still a problem. Small collections open
> I am using MAC OSX.
> See error message below:
> Any suggestion what to do.
> Thanks
> Renate

Hi Renate,

Your e-mail dated 4 December 2010 speaks of a 2.84 release candidate of
October 2010. Does this mean that you obtained a Mac binary of
Greenstone from the "Caveat-emptor" page (greenstone.org/caveat-emptor)?

The binaries on that page are generally untested, being work-in-progress
versions. They are daily binaries of the code as it is at midnight.

More recently, you wrote an e-mail containing the following:

Renate Morgenstern wrote:
> Hi Katherine,
> I am working in MAc os. I have installed a new version of GS 2.
> Seemed that all went ok, but it will not open. In the java option I
> increased the Java heap stack memory, and in the past I could then open
> large collections. Because of the propblem I ran it with the debug
> option. I am sending you the error log.
> What should I do? Please advise.
> Thanks
> Renate
> ========================

We haven't yet released a 2.84 release candidate for the Mac OS. Is the
one you tried out (mentioned above) from the caveat-emptor page as well?
Is it the same as the one you recall obtaining on October 2010?

Last evening, I tried out the Mac binary of the current code and have so
far been unable to reproduce the more recent problem you mentioned.
While in my case it successfully re-opens the collection that was left
open during the last session, the collections I am dealing with, such as
Greenstone Demo, may not be as large as the ones you tried out.

Is it only larger collections that give you this problem, or does it
occur consistently, including with smaller collections?

Also, just to be sure, which MacOS binary did you try out (where did you
download it from)? Is it indeed from the caveat-emptor page?

We hope to shortly have a release candidate binary for MacOS that will
have undergone some preliminary testing. (However, the ones on the
caveat-emptor page are not it, and they are not for production work. But
thank you so much for testing them and reporting back with the issues
you have been having.)


> User cache dir: /Users/Renate/.gli/cache/
> Exception in thread "Thread-6" java.lang.OutOfMemoryError: Java heap
> space
> at java.util.regex.Pattern$BnM.optimize(Pattern.java:5394)
> at java.util.regex.Pattern.compile(Pattern.java:1410)
> at java.util.regex.Pattern.<init>(Pattern.java:1124)
> at java.util.regex.Pattern.compile(Pattern.java:817)
> at java.lang.String.replaceAll(String.java:2000)
> at
> org.greenstone.gatherer.metadata.MetadataXMLFile.skimFile(MetadataXMLFile.java:630)
> at
> org.greenstone.gatherer.metadata.MetadataXMLFileManager.loadMetadataXMLFile(MetadataXMLFileManager.java:268)
> at
> org.greenstone.gatherer.metadata.MetadataXMLFileManager.loadMetadataXMLFiles(MetadataXMLFileManager.java:254)
> at
> org.greenstone.gatherer.metadata.MetadataXMLFileManager.loadMetadataXMLFiles(MetadataXMLFileManager.java:251)
> at
> org.greenstone.gatherer.collection.CollectionManager.loadCollectionInternal(CollectionManager.java:1425)
> at
> org.greenstone.gatherer.collection.CollectionManager.access$200(CollectionManager.java:84)
> at
> org.greenstone.gatherer.collection.CollectionManager$LoadCollectionTask.run(CollectionManager.java:1186)