Re: [greenstone-devel] Re: Collection at GSDLCollectabcabc.col can not be opened

From Michael Dewsnip
DateFri, 01 Dec 2006 14:38:55 +1300
Subject Re: [greenstone-devel] Re: Collection at GSDLCollectabcabc.col can not be opened
In-Reply-To (3006-137-186-144-52-1164775136-squirrel-webmail-uleth-ca)
Hi Wendy,

Thank you for your detailed problem report -- it really helps a lot. It
seems the error is due to the collection missing the "extracted
metadata set", ie. no "ex.mds" file in the collection's "metadata"
directory. I'm not exactly sure how the collection got into this state,
but I've made these two changes to the code:

- The GLI will now automatically load the extracted metadata set if it
doesn't exist in the collection

- Errors reading the doc.xml files no longer cause the GLI to stop
loading/building the collection

These will be available in Greenstone v2.72, due before Christmas. Until
then, you should be able to fix the problem by copying the ex.mds file
from the GLI's "metadata" directory into the collection's "metadata"
directory.

Hope Lethbridge is treating you well!

All the best,

Michael

Wendy Osborn wrote:

>Hi Michael!
>
>Sorry I didn't get to this sooner.
>
>With one collection, I've managed to reproduce the error consistently.
>Unfortunately, not with others. Along with the info below, I've attached
>two files - one for Java exceptions from the gli applet, and one
>exceptions from the gli client.
>
>Info:
>
>-The operating system of the server machine:
>Linux - Fedora Core 5
>
>-The version of Greenstone installed on the server machine:
>2.71
>
>-The version of Java installed on the server machine:
>1.4.2
>
>The operating system of the client machine
>-Windows XP
>
>Whether you are using the client or applet version of the GLI:
>-We usually use the applet, but I tested both.
>
>-The actions you performed leading up to where the error or problem occurs:
>In both cases, I logged into the GLI (no problem), opened the list of
>collections (the applet raised an exception, the client did not, but in
>either case the list did appear), and selected the SAIR collection (both
>produced exceptions, but the applet threw 2 of them while the client only
>threw 1). I also got the "c:documents and setting.... SAIR.col could not
>be opened" dialog after the exceptions were thrown.
>
>-The complete text of any popup GLI error messages, exceptions or errors
>in the webserver log file:
>I've also attached this. I'm not sure any of it is specifically caused by
>the GLI. But you can have a look.
>
>Let me know if you need any other info.
>
>Later!
>
>Wendy
>
>On Thu, November 16, 2006 8:08 pm, Michael Dewsnip wrote:
>
>
>>Hi Wendy,
>>
>>Good to hear from you again, and thanks for investigating this further.
>>I think there is a bug here to do with loading collections between
>>operating systems, but I haven't had time to track it down yet.
>>Hopefully I'll have time to investigate late next week, but please let
>>me know if you figure out how to reproduce it consistently!
>>
>>All the best,
>>
>>Michael
>>
>>
>>
>>Wendy Osborn wrote:
>>
>>
>>
>>>Hi everyone,
>>>
>>>I didn't see what i'm about to describe any message so far, but
>>>(hopefully) it will reveal more of what's going on. And i'm not sure
>>>this
>>>is exactly the same problem - depends on if your running a remote gli
>>>(such as the gli applet) or running the gli locally.
>>>
>>>I got the same error message tonight. This was the first time since 2.71
>>>came out that I have had time to set%2
>>>
>>>------------------------------------------------------------------------
>>>
>>>Java(TM) Plug-in: Version 1.4.2_11
>>>Using JRE version 1.4.2_11 Java HotSpot(TM) Client VM
>>>User home directory = C:Documents and SettingsAdministrator
>>>Proxy Configuration: No proxy
>>>----------------------------------------------------
>>>c: clear console window
>>>f: finalize objects on finalization queue
>>>g: garbage collect
>>>h: display this help message
>>>l: dump classloader list
>>>m: print memory usage
>>>o: trigger logging
>>>p: reload proxy configuration
>>>q: hide console
>>>r: reload policy configuration
>>>s: dump system properties
>>>t: dump thread list
>>>v: dump thread stack
>>>x: clear classloader cache
>>>0-5: set trace level to <n>
>>>----------------------------------------------------
>>>Version: v2.71
>>>Setting library_url to http://www.sadl.uleth.ca/gsdl/cgi-bin/library...
>>>Setting gliserver_url to http://www.sadl.uleth.ca/gsdl/cgi-bin/gliserver.pl...
>>>Deleting user's local collect directory...Done.
>>>
>>>gliserver args: cmd=get-script-options&script=classinfo.pl&xml=&language=en&listall
>>>gliserver args: cmd=get-script-options&script=pluginfo.pl&xml=&language=en&listall
>>>Start called
>>>gliserver args: cmd=download-collection-configurations
>>>
>>>java.lang.NullPointerException
>>>at javax.swing.plaf.basic.BasicProgressBarUI.updateSizes(Unknown Source)
>>>at javax.swing.plaf.basic.BasicProgressBarUI.getBox(Unknown Source)
>>>at com.sun.java.swing.plaf.windows.WindowsProgressBarUI.paintIndeterminate(Unknown Source)
>>>at javax.swing.plaf.basic.BasicProgressBarUI.paint(Unknown Source)
>>>at javax.swing.plaf.ComponentUI.update(Unknown Source)
>>>at javax.swing.JComponent.paintComponent(Unknown Source)
>>>at javax.swing.JComponent.paint(Unknown Source)at javax.swing.JComponent.paintChildren(Unknown Source)
>>>at javax.swing.JComponent.paint(Unknown Source)
>>>at javax.swing.JComponent.paintWithOffscreenBuffer(Unknown Source)
>>>at javax.swing.JComponent.paintDoubleBuffered(Unknown Source)
>>>at javax.swing.JComponent._paintImmediately(Unknown Source)
>>>at javax.swing.JComponent.paintImmediately(Unknown Source)
>>>at javax.swing.RepaintManager.paintDirtyRegions(Unknown Source)
>>>at javax.swing.SystemEventQueueUtilities$ComponentWorkRequest.run(Unknown Source)
>>>at java.awt.event.InvocationEvent.dispatch(Unknown Source)
>>>at java.awt.EventQueue.dispatchEvent(Unknown Source)
>>>at java.awt.EventDispatchThread.pumpOneEventForHierarchy(Unknown Source)
>>>at java.awt.EventDispatchThread.pumpEventsForHierarchy(Unknown Source)
>>>at java.awt.EventDispatchThread.pumpEvents(Unknown Source)
>>>at java.awt.EventDispatchThread.pumpEvents(Unknown Source)
>>>at java.awt.EventDispatchThread.run(Unknown Source)
>>>
>>>gliserver args: cmd=download-collection&c=SAIR
>>>java.lang.NullPointerException
>>>at javax.swing.plaf.basic.BasicProgressBarUI.updateSizes(Unknown Source)
>>>at javax.swing.plaf.basic.BasicProgressBarUI.getBox(Unknown Source)
>>>at com.sun.java.swing.plaf.windows.WindowsProgressBarUI.paintIndeterminate(Unknown Source)
>>>at javax.swing.plaf.basic.BasicProgressBarUI.paint(Unknown Source)
>>>at javax.swing.plaf.ComponentUI.update(Unknown Source)
>>>at javax.swing.JComponent.paintComponent(Unknown Source)
>>>at javax.swing.JComponent.paint(Unknown Source)
>>>at javax.swing.JComponent.paintChildren(Unknown Source)
>>>at javax.swing.JComponent.paint(Unknown Source)
>>>at javax.swing.JComponent.paintChildren(Unknown Source)
>>>at javax.swing.JComponent.paint(Unknown Source)
>>>at javax.swing.JComponent.paintChildren(Unknown Source)
>>>at javax.swing.JComponent.paint(Unknown Source)
>>>at javax.swing.JLayeredPane.paint(Unknown Source)
>>>at javax.swing.JComponent.paintChildren(Unknown Source)
>>>at javax.swing.JComponent.paint(Unknown Source)
>>>at javax.swing.JComponent.paintWithOffscreenBuffer(Unknown Source)
>>>at javax.swing.JComponent.paintDoubleBuffered(Unknown Source)
>>>at javax.swing.JComponent._paintImmediately(Unknown Source)
>>>at javax.swing.JComponent.paintImmediately(Unknown Source)
>>>at javax.swing.RepaintManager.paintDirtyRegions(Unknown Source)
>>>at javax.swing.SystemEventQueueUtilities$ComponentWorkRequest.run(Unknown Source)
>>>at java.awt.event.InvocationEvent.dispatch(Unknown Source)
>>>at java.awt.EventQueue.dispatchEvent(Unknown Source)
>>>at java.awt.EventDispatchThread.pumpOneEventForHierarchy(Unknown Source)
>>>at java.awt.EventDispatchThread.pumpEventsForHierarchy(Unknown Source)
>>>at java.awt.EventDispatchThread.pumpEvents(Unknown Source)
>>>at java.awt.EventDispatchThread.pumpEvents(Unknown Source)
>>>at java.awt.EventDispatchThread.run(Unknown Source)
>>>java.lang.NullPointerException
>>>at org.greenstone.gatherer.metadata.DocXMLFile.skimFile(DocXMLFile.java:263)
>>>at org.greenstone.gatherer.metadata.DocXMLFileManager.loadDocXMLFile(DocXMLFileManager.java:85)
>>>at org.greenstone.gatherer.metadata.DocXMLFileManager.loadDocXMLFiles(DocXMLFileManager.java:76)
>>>at org.greenstone.gatherer.metadata.DocXMLFileManager.loadDocXMLFiles(DocXMLFileManager.java:73)
>>>at org.greenstone.gatherer.collection.CollectionManager.loadCollectionInternal(CollectionManager.java:977)
>>>at org.greenstone.gatherer.collection.CollectionManager.access$200(CollectionManager.java:82)
>>>at org.greenstone.gatherer.collection.CollectionManager$LoadCollectionTask.run(CollectionManager.java:835)
>>>
>>>------------------------------------------------------------------------
>>>
>>>C:Documents and SettingsAdministratorDesktopgli>client-gli.bat
>>>
>>>Greenstone Librarian Interface (GLI)
>>>Copyright (C) 2006, New Zealand Digital Library Project, University Of Waikato
>>>GLI comes with ABSOLUTELY NO WARRANTY; for details see LICENSE.txt
>>>This is free software, and you are welcome to redistribute it
>>>Checking Java: C:WINDOWSsystem32
>>>
>>>Running the Greenstone Librarian Interface...
>>>Version: v2.71
>>>
>>>Deleting user's local collect directory...
>>>Done.
>>>gliserver args: cmd=get-script-options&script=classinfo.pl&xml=&language=en&list
>>>all
>>>gliserver args: cmd=get-script-options&script=pluginfo.pl&xml=&language=en&lista
>>>ll
>>>gliserver args: cmd=download-collection-configurations
>>>gliserver args: cmd=download-collection&c=SAIR
>>>java.lang.NullPointerException
>>> at org.greenstone.gatherer.metadata.DocXMLFile.skimFile(DocXMLFile.java:
>>>263)
>>> at org.greenstone.gatherer.metadata.DocXMLFileManager.loadDocXMLFile(DocXMLFileManager.java:85)
>>> at org.greenstone.gatherer.metadata.DocXMLFileManager.loadDocXMLFiles(DocXMLFileManager.java:76)
>>> at org.greenstone.gatherer.metadata.DocXMLFileManager.loadDocXMLFiles(DocXMLFileManager.java:73)
>>> at org.greenstone.gatherer.collection.CollectionManager.loadCollectionInternal(CollectionManager.java:977)
>>> at org.greenstone.gatherer.collection.CollectionManager.access$200(CollectionManager.java:82)
>>> at org.greenstone.gatherer.collection.CollectionManager$LoadCollectionTask.run(CollectionManager.java:835)
>>>
>>>------------------------------------------------------------------------
>>>
>>>[Tue Nov 28 21:37:46 2006] [error] [client 137.186.144.52] File /home2/gsdl/play
>>>box/gsdl/collect/modelcol/metadata does not exist!
>>>[Tue Nov 28 21:37:46 2006] [error] [client 137.186.144.52] File /home2/gsdl/play
>>>box/gsdl/collect/psasraw2/metadata does not exist!
>>>[Tue Nov 28 21:37:46 2006] [error] [client 137.186.144.52] File /home2/gsdl/play
>>>box/gsdl/collect/psassum2/metadata does not exist!
>>>[Tue Nov 28 21:38:39 2006] [error] [client 137.186.144.52] File /home2/gsdl/gsdl
>>>/collect/modelcol/metadata does not exist!
>>>[Tue Nov 28 21:38:39 2006] [error] [client 137.186.144.52]
>>>[Tue Nov 28 21:38:39 2006] [error] [client 137.186.144.52] File /home2/gsdl/gsdl
>>>/collect/cyber/metadata does not exist!
>>>[Tue Nov 28 21:38:39 2006] [error] [client 137.186.144.52]
>>>[Tue Nov 28 21:38:39 2006] [error] [client 137.186.144.52] File /home2/gsdl/gsdl
>>>/collect/sabhist/metadata does not exist!
>>>[Tue Nov 28 21:38:39 2006] [error] [client 137.186.144.52]
>>>[Tue Nov 28 21:44:35 2006] [error] [client 137.186.144.52] File /home2/gsdl/gsdl
>>>/collect/modelcol/metadata does not exist!
>>>[Tue Nov 28 21:44:35 2006] [error] [client 137.186.144.52]
>>>[Tue Nov 28 21:44:35 2006] [error] [client 137.186.144.52] File /home2/gsdl/gsdl
>>>/collect/cyber/metadata does not exist!
>>>[Tue Nov 28 21:44:35 2006] [error] [client 137.186.144.52]
>>>[Tue Nov 28 21:44:35 2006] [error] [client 137.186.144.52] File /home2/gsdl/gsdl
>>>/collect/sabhist/metadata does not exist!
>>>[Tue Nov 28 21:44:35 2006] [error] [client 137.186.144.52]
>>>[Tue Nov 28 21:47:14 2006] [error] [client 137.186.144.52] File /home2/gsdl/gsdl
>>>/collect/modelcol/metadata does not exist!
>>>[Tue Nov 28 21:47:14 2006] [error] [client 137.186.144.52]
>>>[Tue Nov 28 21:47:14 2006] [error] [client 137.186.144.52] File /home2/gsdl/gsdl
>>>/collect/cyber/metadata does not exist!
>>>[Tue Nov 28 21:47:14 2006] [error] [client 137.186.144.52]
>>>[Tue Nov 28 21:47:14 2006] [error] [client 137.186.144.52] File /home2/gsdl/gsdl
>>>/collect/sabhist/metadata does not exist!
>>>[Tue Nov 28 21:47:14 2006] [error] [client 137.186.144.52]
>>>[Tue Nov 28 21:50:41 2006] [error] [client 137.186.144.52] script not found or u
>>>nable to stat: /home2/gsdl/gsdl/cgi-bin/dictionary.class
>>>[Tue Nov 28 21:50:41 2006] [error] [client 137.186.144.52] script not found or u
>>>nable to stat: /home2/gsdl/gsdl/cgi-bin/dictionary_en.class
>>>[Tue Nov 28 21:50:42 2006] [error] [client 137.186.144.52] script not found or u
>>>nable to stat: /home2/gsdl/gsdl/cgi-bin/dictionary_en.properties
>>>[Tue Nov 28 21:50:42 2006] [error] [client 137.186.144.52] script not found or u
>>>nable to stat: /home2/gsdl/gsdl/cgi-bin/dictionary_en_US.class
>>>[Tue Nov 28 21:50:42 2006] [error] [client 137.186.144.52] script not found or u
>>>nable to stat: /home2/gsdl/gsdl/cgi-bin/dictionary_en_US.properties
>>>[Tue Nov 28 21:50:42 2006] [error] [client 137.186.144.52] script not found or u
>>>nable to stat: /home2/gsdl/gsdl/cgi-bin/dictionary_en_NZ.class
>>>[Tue Nov 28 21:50:42 2006] [error] [client 137.186.144.52] script not found or u
>>>nable to stat: /home2/gsdl/gsdl/cgi-bin/dictionary_en_NZ.properties
>>>[Tue Nov 28 21:51:05 2006] [error] [client 137.186.144.52] File /home2/gsdl/gsdl
>>>/collect/modelcol/metadata does not exist!
>>>[Tue Nov 28 21:51:05 2006] [error] [client 137.186.144.52]
>>>[Tue Nov 28 21:51:05 2006] [error] [client 137.186.144.52] File /home2/gsdl/gsdl
>>>/collect/cyber/metadata does not exist!
>>>[Tue Nov 28 21:51:05 2006] [error] [client 137.186.144.52]
>>>[Tue Nov 28 21:51:05 2006] [error] [client 137.186.144.52] File /home2/gsdl/gsdl
>>>/collect/sabhist/metadata does not exist!
>>>[Tue Nov 28 21:51:05 2006] [error] [client 137.186.144.52]
>>>[Tue Nov 28 21:53:40 2006] [error] [client 137.186.144.52] script not found or u
>>>nable to stat: /home2/gsdl/gsdl/cgi-bin/dictionary.class
>>>[Tue Nov 28 21:53:40 2006] [error] [client 137.186.144.52] script not found or u
>>>nable to stat: /home2/gsdl/gsdl/cgi-bin/dictionary_en.class
>>>[Tue Nov 28 21:53:40 2006] [error] [client 137.186.144.52] script not found or u
>>>nable to stat: /home2/gsdl/gsdl/cgi-bin/dictionary_en.properties
>>>[Tue Nov 28 21:53:40 2006] [error] [client 137.186.144.52] script not found or u
>>>nable to stat: /home2/gsdl/gsdl/cgi-bin/dictionary_en_US.class
>>>[Tue Nov 28 21:53:41 2006] [error] [client 137.186.144.52] script not found or u
>>>nable to stat: /home2/gsdl/gsdl/cgi-bin/dictionary_en_US.properties
>>>[Tue Nov 28 21:53:41 2006] [error] [client 137.186.144.52] script not found or u
>>>nable to stat: /home2/gsdl/gsdl/cgi-bin/dictionary_en_NZ.class
>>>[Tue Nov 28 21:53:41 2006] [error] [client 137.186.144.52] script not found or u
>>>nable to stat: /home2/gsdl/gsdl/cgi-bin/dictionary_en_NZ.properties
>>>[Tue Nov 28 21:54:01 2006] [error] [client 137.186.144.52] File /home2/gsdl/gsdl
>>>/collect/modelcol/metadata does not exist!
>>>[Tue Nov 28 21:54:01 2006] [error] [client 137.186.144.52]
>>>[Tue Nov 28 21:54:01 2006] [error] [client 137.186.144.52] File /home2/gsdl/gsdl
>>>/collect/cyber/metadata does not exist!
>>>[Tue Nov 28 21:54:01 2006] [error] [client 137.186.144.52]
>>>[Tue Nov 28 21:54:01 2006] [error] [client 137.186.144.52] File /home2/gsdl/gsdl
>>>/collect/sabhist/metadata does not exist!
>>>[Tue Nov 28 21:54:01 2006] [error] [client 137.186.144.52]
>>>[Tue Nov 28 21:57:50 2006] [error] [client 137.186.144.52] script not found or u
>>>nable to stat: /home2/gsdl/gsdl/cgi-bin/dictionary.class
>>>[Tue Nov 28 21:57:50 2006] [error] [client 137.186.144.52] script not found or u
>>>nable to stat: /home2/gsdl/gsdl/cgi-bin/dictionary_en.class
>>>[Tue Nov 28 21:57:51 2006] [error] [client 137.186.144.52] script not found or u
>>>nable to stat: /home2/gsdl/gsdl/cgi-bin/dictionary_en.properties
>>>[Tue Nov 28 21:57:51 2006] [error] [client 137.186.144.52] script not found or u
>>>nable to stat: /home2/gsdl/gsdl/cgi-bin/dictionary_en_US.class
>>>[Tue Nov 28 21:57:51 2006] [error] [client 137.186.144.52] script not found or u
>>>nable to stat: /home2/gsdl/gsdl/cgi-bin/dictionary_en_US.properties
>>>[Tue Nov 28 21:57:51 2006] [error] [client 137.186.144.52] script not found or u
>>>nable to stat: /home2/gsdl/gsdl/cgi-bin/dictionary_en_NZ.class
>>>[Tue Nov 28 21:57:51 2006] [error] [client 137.186.144.52] script not found or u
>>>nable to stat: /home2/gsdl/gsdl/cgi-bin/dictionary_en_NZ.properties
>>>[Tue Nov 28 21:58:06 2006] [error] [client 137.186.144.52] File /home2/gsdl/gsdl
>>>/collect/modelcol/metadata does not exist!
>>>[Tue Nov 28 21:58:06 2006] [error] [client 137.186.144.52]
>>>[Tue Nov 28 21:58:06 2006] [error] [client 137.186.144.52] File /home2/gsdl/gsdl
>>>/collect/cyber/metadata does not exist!
>>>[Tue Nov 28 21:58:06 2006] [error] [client 137.186.144.52]
>>>[Tue Nov 28 21:58:06 2006] [error] [client 137.186.144.52] File /home2/gsdl/gsdl
>>>/collect/sabhist/metadata does not exist!
>>>[Tue Nov 28 21:58:06 2006] [error] [client 137.186.144.52]
>>>[Tue Nov 28 22:01:07 2006] [error] [client 137.186.144.52] File /home2/gsdl/gsdl
>>>/collect/modelcol/metadata does not exist!
>>>[Tue Nov 28 22:01:07 2006] [error] [client 137.186.144.52]
>>>[Tue Nov 28 22:01:07 2006] [error] [client 137.186.144.52] File /home2/gsdl/gsdl
>>>/collect/cyber/metadata does not exist!
>>>[Tue Nov 28 22:01:07 2006] [error] [client 137.186.144.52]
>>>[Tue Nov 28 22:01:07 2006] [error] [client 137.186.144.52] File /home2/gsdl/gsdl
>>>/collect/sabhist/metadata does not exist!
>>>[Tue Nov 28 22:01:07 2006] [error] [client 137.186.144.52]
>>>