Re: [greenstone-users] large collection v.2.7

From Katherine Don
DateMon, 28 Aug 2006 16:06:51 +1200
Subject Re: [greenstone-users] large collection v.2.7
In-Reply-To (000001c6c7a9$fe46c890$7cd36281-DJJSP581)
Hi Heather

Large collections shouldn't have a problem in importing - each document
is processed individually.
The important size is the amount of text that can be extracted from the
PDFs, which is likely to be much less than 55GB.
There is some info here:
http://greenstone.sourceforge.net/wiki/index.php/Building_Greenstone_collections#Are_there_any_limits_to_the_size of collections.3F

I would try and create just one collection first, then look at splitting
it up if it doesn't work.

Greenstone 3 is currently using greenstone 2 style collection building,
so won't handle large collections any differently.

Regards,
Katherine

Heather Rolen wrote:
> Hi,
>
> I have a collection of around 800 PDFs totaling 55 GB or so. How can I
> know the amount of virtual memory that will be required to import a
> collection of this size? Would it be advisable to create several
> smaller collections and search across? Will version 3 be more suited to
> handle a collection this large versus version 2.7?
>
>
>
> Thanks!
>
> Heather
>
>
>
>
> ------------------------------------------------------------------------
>
> _______________________________________________
> greenstone-users mailing list
> greenstone-users@list.scms.waikato.ac.nz
> https://list.scms.waikato.ac.nz/mailman/listinfo/greenstone-users