[greenstone-users] RE: [greenstone-devel] distributed storage for objects?

From Diego Spano
DateFri Aug 14 03:06:49 2009
Subject [greenstone-users] RE: [greenstone-devel] distributed storage for objects?
In-Reply-To (6291FA526EA64B42B54BEF1A889C184E4005C555-NEUBOS3ES816CLS-nunet-neu-edu)

In GS2 you have 3 folders that requieres disk space: import, archive and
index. The index folder MUST be inside the collection?s root folder. You
can?t separate it.

But the other two yes. The import process has two important options:

-importdir: indicates from where to take the source documents. It can be
another disk or another machine.

-archivedir: indicates the path to archive folder where to save the
converted documents. It can be another disk or another machine.

The build process has the option ?archivedir too, and shoul be set to the
same path that you use in import process.

Let me comment you about a digital library I set here:

GS was on installed on a linux server and I mounted a Windows file system
over a linux filesystem.

The server has 2 disks (not two partitions but two separate disks). When I
run the import process the source documents are read from the windows file
system mounted locally (so, no space wasted on linux disk) and the archives
are generated on the second disk.

Then the buildprocess take documents from that disk and generates indexes on
the maind hard disk. This way you vae separate the 3 parts of the process,
and even more, having the archives and indexes in differents disks is a way
to get a better performance.

Hope this helps you.

Diego Spano

De: greenstone-devel-bounces@list.scms.waikato.ac.nz
[mailto:greenstone-devel-bounces@list.scms.waikato.ac.nz] En nombre de
Mehrling, Martin
Enviado el: Jueves, 13 de Agosto de 2009 10:49 a.m.
Para: greenstone-users@list.scms.waikato.ac.nz;
Asunto: [greenstone-devel] distributed storage for objects?

Hi Folks,

We are running out of space on our Greenstone server and were wondering how
other Greenstone sites deal with this problem. I know Greenstone3 has a
more distributed model, but we aren?t ready to move to that version just
yet. Have any of you figured out a way to store objects in multiple

Thanks a lot for any ideas!



Martin Mehrling

Digital Systems Specialist




301 Snell Library

Northeastern University

Boston, Massachusetts 02115

-------------- next part --------------
An HTML attachment was scrubbed...
URL: https://list.scms.waikato.ac.nz/mailman/private/greenstone-users/attachments/20090813/cdc71f25/attachment.html