[greenstone-users] Unable to gather & create test collection with Remote Librarian

From H.M. Gladney
DateTue, 19 Jun 2007 17:31:44 -0700
Subject [greenstone-users] Unable to gather & create test collection with Remote Librarian

(1) I am experiencing repeated failures of the GSDL Remote Librarian service during the "Gather" phase, with this GLI running in a Win/XP machine and the server in an Linux Ubuntu platform.  For two of these, the tail end console output listing is copied below (note: these listings might contain typographical errors resulting from screen scraping followed by OCR).

The collection involved is not particularly large.  In the first test, I tried gathering it all with a single copy/paste.  In the second test, I copied/pasted portions sequentially, waiting with each until its predecessor was complete.

In both cases, there is an apparent OutofMemory error.  However the server memory usage is consistently less than 60% and no swapping is occurring.  In one case, I noticed that the failure occurred during the uploading of an Excel file; however the failure did not repeat when I built a new collection consisting just of *.xls files.

(2) In another test (test4) with the same collection, I managed to gather it by adding file groups in a different sequence.  After this seemed to complete (system activity monitoring on both the client and server), I tried to create the collection.  These seems to stall, with a message "Uploading files into collection…" in the progress indicator and a cycling progress indicator.  All tabs were grayed out, so that I could not call for "Cancel build".  So I forced termination by closing the terminal window, and opened the test collection.  The Collection window did not show the final folder that I had added before (called "History of Computing", it had shown correctly and completely in the GLI Collection window before the forced termination.)  So I copied/pasted it again, and this time waited for 30 minutes, during which "No action requested" showed in the progress indicator, "Uploading files into collection…" showed continually in the Remote Greenstone Server Progress subwindow, and a cursor cycled continually in each of these two windows.  Looking at the "…/gsdl/collect/test4/import" directory with Konquerer, the expected "History of Computing" was absent.

What's happening & why?  How can I proceed?  (If not solved, it is likely to be a "show-stopper" for CHM usage of Greenstone.)

Henry
=========
First example:
WARNING: In event dispatch thread, returning immediately...
gliserver args: cmd=upload-collection-file&c=test2&file=test2-11.82295599218.zip& directory=&zip=true
gliserver args: cmd=upload-collection-file&c=test2&file=test2-1182295636609.zip& Iirectory=import&zip=true
Exception in thread "Thread-3" java.lang.OutOfMemoryError: Java heap space at java.util.Arrays.copy0f(Unknown Source)

      at java.io.ByteArrayOutputStream.write(Unknown Source)
      at sun.net.www.http.PosterOutputStream.write(Unknown Source) at java.io.DataOutputStream.write(Unknown Source)

at org.greenstone.gatherer.remote.RemoteGreenstoneServer.uploadFileInter al(RemoteGreenstoneServer.java:1106)
at org.greenstone.gatherer.remote.RemoteGreenstoneServer.uploadFile(Remo eGreenstoneServer.java:944)
at org.greenstone.gatherer.remote.RemoteGreenstoneServer.access$400(Remo eGreenstoneServer.java:46)
at org.greenstone.gatherer.remote.RemoteGreenstoneServer$RemoteGreenston ServerUploadFilesIntoCollectionAction.perform(RemoteGreenstoneServer.java:769)

at org.greenstone.gatherer.remote.RemoteGreenstoneServer$RemoteGreenston ServerActionQueue.run(lemoteGreenstoneServer.java:229)

Second example:
WARNING: In event dispatch thread, returning immediately...
WARNING: In event dispatch thread, returning immediately...
gliserver args: cmd=upload-collection-file&c=test2&file=test2-1182269455015.zip& I irectory=import&zip=true
Exception in thread "Thread-3" java.lang.OutOfMemoryError: Java heap space at java.util.Arrays.copy0f<Unknown Source)

      at java.io.ByteArrayOutputStream.write<Unknown Source)
      at sun.net.www.http.PosterOutputStream.write(Unknown Source) at java.io.DataOutputStream.write(Unknown Source)

at org.greenstone.gatherer.remote.RemoteGreenstoneServer.uploadFileInter al(RemoteGreenstoneServer.java:1106)
at org.greenstone.gatherer.remote.RemoteGreenstoneServer.uploadFile(Remo eGreenstoneServer.java:944)
at org.greenstone.gatherer.remote.RemoteGreenstoneServer.access$400(Remo eGreenstoneServer.java:46)
at org.greenstone.gatherer.remote.RemoteGreenstoneServer$RemoteGreenston ServerUploadFilesIntoCollectionAction.perform(RemoteGreenstoneServer.java:769)

at org.greenstone.gatherer.remote.RemoteGreenstoneServer$RemoteGreenston ServerActionQueue.run(RemoteGreenstoneServer.java:229)

WARNING: In event dispatch thread, returning immediately...
WARNING: In event dispatch thread, returning immediately...
Script name: import.pl
Collection name: test2
Script args: &gli=&language=en&removeold=
WARNING: In event dispatch thread, returning immediately...
Exiting, number of jobs on queue: 7



Cheerio, Henry
 
H.M. Gladney, Ph.D.  http://home.pacbell.net/hgladney