Re: [greenstone-users] problem with building "large" collections [SOLVED! - not really]

From jens wille
DateWed, 16 Aug 2006 08:38:30 +0200
Subject Re: [greenstone-users] problem with building "large" collections [SOLVED! - not really]
In-Reply-To (44E24F61-2020601-cs-waikato-ac-nz)
hi michael!

Michael Dewsnip [16.08.2006 00:49]:
> What type of classifiers do you have in the collection? I've had
> a report in the past that the Hierarchy classifier uses an
> unreasonable amount of memory, and other classifiers might too.
i have 6 AZCompactList's and 1 Hierarchy - you can find my
collect.cfg here:
<http://linux2.fbi.fh-koeln.de/gsdl/collect/rdk-dev2/etc/collect.cfg>

> - Run buildcol.pl -mode infodb, just to make sure stuff isn't
> being left in memory from previous phases
ok. i tried that some time ago (before it turned out to be a memory
problem), but will do again soon.

> - Comment out the classifiers in the collection -- does it build
> successfully now?
i will try that, too - thanks for your suggestions.

> Also, what is the size of the index/text/<collection>.ldb file in
> the largest collection you've been able to build successfully?
330M (in the collection i built with v2.70w it's 406M)

cheers
jens