[greenstone-users] Re: Request

From Greenstone Team
DateWed Jun 8 20:50:38 2011
Subject [greenstone-users] Re: Request
In-Reply-To (BANLkTim3mHWL-CUQXgu-p9Xbw0mTgrTXww-mail-gmail-com)
Hi Ashok,

> and one more thing, if i want to add some more file in existing
collection folder, why software will take all files to build once again.

If you're using Greenstone 2.83 or Greenstone 2.84, then just above the
"Build Collection" button in the Create panel of GLI, you will see radio
buttons called "Complete Rebuild" and "Minimal Rebuild". Select the
"Minimal Rebuild" radio button and press the Build Collection now to
build just the documents added (deleted or changed) since the last build.


> How many files i can upload in one collection folder and i have
multiple forms of files to upload.
the thing is i have to upload 3k files in each collection,
please let me know how to plugin the documents, because i can only
select one plugin to build the collection at one time.

I am not entirely sure I understood the questions correctly. Assuming I
did, you should be able to use multiple plugins at any point: each will
process a different type of document. For instance, the WordPlugin will
process Word docs and the PDFPlugin will process PDF docs. Restrict the
list of plugins to just those needed to process the range of documents
in your collection.

When you speak of "uploading" to a collection, do you mean you are
connecting to a remote Greenstone server (far away from the machine
you're on) and uploading over a distance. Or is your Greenstone server
and GLI located on the same machine and you are referring to the process
of adding ("Gathering") documents into your collection?

If the machine you use to put documents into a collection is the same as
the machine running the Greenstone server, the upper limit for the
number of documents you have is quite high. If you're connecting to a
remote machine, you will be limited by bandwidth and speed.

You can speed things up a little by selecting the Plugins for the
collection in GLI's Design panel before you (re)build your collection.
Or if you're starting a new collection, set up the list of plugins you
want first.

> please let me know how to plugin the documents,

Do you mean to know which plugins you need to work on the documents in
your collection? This depends on the range of document types in your
collection. Include those Plugins needed to process the various file
extensions you are dealing with.

Since you're working with many documents, I think the best way to make
sure everything will get processed as you wish them to be, is to create
a small test collection of a few sample documents that are
representative of your larger collection. Then tweak GLI's processing
and the Greenstone server's display of them until things look and work
as you desire them to. Once things work as desired with your smaller
collection, try it on your full-sized one.

For instance, if your full collection includes Word, PDF and Text files
only, then create a test collection of just 3 or 6 documents with 1 or 2
of each type of file. Then choose the appropriate Document Plugins in
GLI and configure them in the manner you want them to work on your
documents. (Refer to
http://wiki.greenstone.org/wiki/index.php/Tutorial_exercises for
examples on how to do this). Then build your test collection and tweak
your setup some more until you are satisfied with how the handful of
sample documents are processed and how the results look in the browser.
Finally, once you think everything is as you wish, create a new
collection with all the same settings, add in all your documents for
that collection and build and check that things look now as in the
smaller collection, but with more documents this time. Read through the
tutorials
http://wiki.greenstone.org/wiki/gsdoc/tutorial/en/multimedia_collection_explore.htm
and
http://wiki.greenstone.org/wiki/gsdoc/tutorial/en/multimedia_collection_build.htm

and if you can, attempt them as well.

Regards,
Anupama


ashok dharani kumar wrote:
> Dear Sir/Madam,
>
> I have 10k files in my repositories in the form of pdf, word, ppt, excels.
>
> I need some information
>
> How many files i can upload in one collection folder and i have
> multiple forms of files to upload.
> the thing is i have to upload 3k files in each collection,
> please let me know how to plugin the documents, because i can only
> select one plugin to build the collection at one time.
>
> and one more thing, if i want to add some more file in existing
> collection folder, why software will take all files to build once again.
>
> Thanks
>
> Regards
> Ashok D
>