Re: Greenstone Install problem

From Stefan Boddie
DateThu, 6 Feb 2003 14:30:35 +1300
Subject Re: Greenstone Install problem
In-Reply-To (1044492019-2787-19-camel-garfield)
Hi Don,

It looks like everything was installed successfully.

The 'character in "c" format ...' messages from import.pl are caused by the
incompatibilities I mentioned between perl 5.8 and gsdl-2.38. For
collections (like the demo collection) that contain only latin characters
these messages can be ignored.

The problem you have with buildcol.pl is caused by a missing file in the
demo collection included with the linux distribution of gsdl-2.38. I noticed
this the other day while testing the errors you reported but forgot to
mention it (I'm amazed no one has reported this problem previously). To work
around it you should comment out (by placing a '#' character at the start of
the line) the line of gsdl/collect/demo/etc/collect.cfg that looks something
like "classify Hierarchy -hfile AZList.txt ... ". buildcol.pl should then
run successfully.

Sorry about that, it's rather an embarrassing bug, even more so since
gsdl-2.38 has been around so long and I've only just discovered it.

Good luck.
Stefan.


----- Original Message -----
From: "Don Dollberg" <dond@spsp.net>
To: "Stefan Boddie" <sjboddie@cs.waikato.ac.nz>
Cc: "Greenstone Development List" <greenstone_devl@tripath.colosys.net>
Sent: Thursday, February 06, 2003 1:40 PM
Subject: Re: Greenstone Install problem


> Stefan,
>
> Thank you for your response to my install problem of Greenstone on a
> SuSE 8.1 system. First, you are correct that my initial install was
> from the binaries. Following your notes I did a re-install and
> compliled the source code after editing the file. It would appear that
> all went well as I did not see Error messages along the way.
>
> At this point, I made the assumption that the best way to test the
> install was to use the demo collection and follow the basic build
> process outlined in the manual. Since I am new to Greenstone it is not
> immediately clear from the output that the problem is due to the install
> or configuration, I do suspect the latter. However, I am including the
> output from running at the command line import.pl and buildcol.pl on the
> demo files.
>
> Running import.pl produced the following partial output:
>
> import.pl demo.
>
> Numerous lines as shown below appeared for each of the 11 documents
>
>
> RecPlug: getting directory /usr/local/gsdl/collect/demo/import/wb34te
> Character in "c" format wrapped at /usr/local/gsdl/perllib/ghtml.pm line
> 164.
> Character in "c" format wrapped at /usr/local/gsdl/perllib/ghtml.pm line
> 164.
> Character in "c" format wrapped at /usr/local/gsdl/perllib/ghtml.pm line
> 164.
> Character in "c" format wrapped at /usr/local/gsdl/perllib/ghtml.pm line
> 164.
> Character in "c" format wrapped at /usr/local/gsdl/perllib/ghtml.pm line
> 164.
> Character in "c" format wrapped at /usr/local/gsdl/perllib/ghtml.pm line
> 164.
> Character in "c" format wrapped at /usr/local/gsdl/perllib/ghtml.pm line
> 164.
> ...
> ...
> HTMLPlug: processing wb34te/wb34te.htm
>
> *********************************************
> Import Complete
> *********************************************
> * 11 documents were considered for processing
> * 11 were processed and included in the collection.
>
> The final lines of import.pl suggest to me that import ran as it should
> but I don't understand the lines above.
>
> --------------------------------------------------------------------------
--------
> I then proceeded to try the next step, build.pl and the following is the
> result:
>
> don@garfield:/usr/local/gsdl/collect> buildcol.pl demo
>
> usage: classify Hierarchy [options]
> options:
>
> -buttonname X Title field for this classification.
> Defaults to metadata name.
>
> -metadata X Metadata field used for classification,
> list will be sorted by this element.
>
> -hfile X The classification structure file
>
> -sort X Metadata field to sort by (defaults to none)
>
> -hlist_at_top Display the first level of the classification
> horizontally.
>
> Hierarchy Error: Can't locate subject file AZList.txt
> This file should be in /usr/local/gsdl/collect/demo/etc/AZList.txt or
> /usr/local/gsdl/etc/AZList.txt
> Uncaught exception from user code:
>
> buildcol::main() called at /usr/local/gsdl/bin/script/buildcol.pl line
> 43
>
>
>
> SO, DO I HAVE A WORKING SYSTEM AND JUST NEED TO DO SOME HOMEWORK WITH
> THE DOCS OR ARE THERE STILL INSTALL PROBLEMS. I WOULD HAVE EXPECTED
> THESE PROGS TO WORK WITH THE DEMO COLLECTION BUT, AGAIN, I HAVE SOME
> LEARNING TO DO HERE.
>
> Thanks again for the help
> Don Dollberg
>
>
>
> On Mon, 2003-02-03 at 02:54, Stefan Boddie wrote:
> > Hi Don,
> >
> > It seems we have some issues with Greenstone under some of the newer
> > linux distributions. I just installed the linux binary release of
> > gsdl-2.38 under Debian Sid (perl 5.8.0, gcc 3.2.2) and had the same
> > problem you described. I assume that you installed the linux binaries?
> >
> > Problem number 1: The pre-compiled copy of the XML-Parser perl module
> > that we distribute with Greenstone doesn't work with perl 5.8.0. It
> > would seem that modules compiled for older perl's are not binary
> > compatible with 5.8. I'm not sure yet what we'll do with the next
> > Greenstone release but the best solution for now is to install and
> > compile the Greenstone source instead of the binary version. Do that in
Now for buildcol.pl
>
> don@garfield:/usr/local/gsdl/collect> buildcol.pl demo
>
> usage: classify Hierarchy [options]
> options:
>
> -buttonname X Title field for this classification.
> Defaults to metadata name.
>
> -metadata X Metadata field used for classification,
> list will be sorted by this element.
>
> -hfile X The classification structure file
>
> -sort X Metadata field to sort by (defaults to none)
>
> -hlist_at_top Display the first level of the classification
> horizontally.
>
> Hierarchy Error: Can't locate subject file AZList.txt
> This file should be in /usr/local/gsdl/collect/demo/etc/AZList.txt or
> /usr/local/gsdl/etc/AZList.txt
> Uncaught exception from user code:
>
> buildcol::main() called at /usr/local/gsdl/bin/script/buildcol.pl line
> 43
> > the same way you installed the binaries (by running Install.sh and
> > following the instructions) but choose the [c]ompile option instead of
> > the default [b]inary option when given the choice. Before doing this see
> > problem number 2 below.
> >
> > Problem number 2: As discussed between Gordon and John McP on this list
> > a week or two ago there's a problem compiling the Greenstone source with
> > gcc-3.2. According to the SuSE website SuSE linux 8.1 includes gcc-3.2
> > so you'll have this problem if you go ahead and try to compile from
> > source. To work around this problem you should do the following:
> >
> > * Extract the gsdl-2.38-linux.tgz archive to create the gsdl-2.38-linux
> > directory (as I'm sure you've already done).
> >
> > * Edit gsdl-2.38-linux/src/src/mgpp/lib/sysfuncs.h to comment out line
> > 341 (the line reads -- #define textdomain(Domain) --).
> >
> > * Go to gsdl-2.38-linux/Unix and run the ./Install.sh script as before
> > (but this time selecting the [c]ompile option).
> >
> > If possible (and if they're still reading this :-) could John and/or
> > Gordon let me know what they think the best solution to this bug is? We
> > need to get a fix committed to CVS soon as I'm just in the process of
> > creating the gsdl-2.39 release.
> >
> > Problem number 3: I've been aware for a while that there might be some
> > problems with Greenstone under perl 5.8 with the low level way we handle
> > non-ascii character sets. If you find that these characters are being
> > converted to junk by the Greenstone build process this is likely to be
> > the culprit. You might also notice lots of warning messages from perl
Now for buildcol.pl
>
> don@garfield:/usr/local/gsdl/collect> buildcol.pl demo
>
> usage: classify Hierarchy [options]
> options:
>
> -buttonname X Title field for this classification.
> Defaults to metadata name.
>
> -metadata X Metadata field used for classification,
> list will be sorted by this element.
>
> -hfile X The classification structure file
>
> -sort X Metadata field to sort by (defaults to none)
>
> -hlist_at_top Display the first level of the classification
> horizontally.
>
> Hierarchy Error: Can't locate subject file AZList.txt
> This file should be in /usr/local/gsdl/collect/demo/etc/AZList.txt or
> /usr/local/gsdl/etc/AZList.txt
> Uncaught exception from user code:
>
> buildcol::main() called at /usr/local/gsdl/bin/script/buildcol.pl line
> 43
> > while importing a collection with perl 5.8 (though in many cases these
> > are harmless). I'm working on fixing this for the next release and will
> > probably be able to provide a patch for gsdl-2.38 soon if anyone wants
it.
> >
> > regards,
> > Stefan.
> >
> > Don Dollberg wrote:
> > > I have installed Greenstone on a SuSE LINUX 8.1 system which is
running
> > > PERL 5.8.0 and Apache 1.3.X. While it would appear that all went well
I
> > > am having problems running the Collector or the equivalent command
line
> > > import.pl.
> > >
> > > I have run source setup.bash and the environemnt variable GSDLHOME is
> > > set to the install tree at /usr/local/gsdl GSDL_OS is set to LINUX
and
> > > the entire gsdl tree is full read, write and execute (chmod 777).
> > >
> > > When I run import.pl demo (demo collection provided with greenstone)
> > > with the collect.cfg provided, even as root, the following errors
> > > appear:
> > >
> > > -------------------------------------------
> > >
> > > garfield:/usr/local/gsdl/bin/script # ./import.pl demo
> > >
> > > Uncaught exception from user code:
> > > Can't load
> > > '/usr/local/gsdl/perllib/cpan/auto/XML/Parser/Expat/Expat.so' for
module
> > > XML::Parser::Expat:
> > > /usr/local/gsdl/perllib/cpan/auto/XML/Parser/Expat/Expat.so: undefined
> > > symbol: PL_sv_undef at
> > > /usr/lib/perl5/5.8.0/i586-linux-thread-multi/DynaLoader.pm line 229.
> > > at /usr/local/gsdl/perllib/cpan/XML/Parser.pm line 15
> > > Compilation failed in require at
> > > /usr/local/gsdl/perllib/cpan/XML/Parser.pm line 15.
> > > BEGIN failed--compilation aborted at
> > > /usr/local/gsdl/perllib/cpan/XML/Parser.pm line 19.
> > > Compilation failed in require at
> > > /usr/local/gsdl/perllib/plugins/XMLPlug.pm line 36.
> > > BEGIN failed--compilation aborted at
> > > /usr/local/gsdl/perllib/plugins/XMLPlug.pm line 36.
> > > Compilation failed in require at
> > > /usr/local/gsdl/perllib/plugins/GAPlug.pm line 32.
> > > BEGIN failed--compilation aborted at
> > > /usr/local/gsdl/perllib/plugins/GAPlug.pm line 32.
> > > Compilation failed in require at /usr/local/gsdl/perllib/plugin.pm
line
> > > 55.
> > > plugin::load_plugins('ARRAY(0x82fd594)',2,'STDERR','import::FAILLOG')
> > > called at ./import.pl line 247
> > > import::main() called at ./import.pl line 94
> > >
> > > ----------------------------------------------
> > >
> > > Am I missing a PERL module other than provided by Greenstone or is
this
> > > a confi problem with the original install? Afte looking through the
> > > archives I noticed a problem in an earlier version of greenstone
related
> > > to the module XML::parser but the answer did not seem to address this
> > > problem which susggests a PERL problem. BTW PERL and the standard
> > > libraries are in the usual directories as installed by SuSE,
> > > /usr/bin/perl and /usr/lib/perl etc.
> > >
> > > Thoughts? Ideas? on how to resolve the problem.
> > >
> > > Thank you
> > > Don Dollberg
> > > dond@spsp.net
> > >
> >
> >
>
>
>