[greenstone-users] benchmarking festival proposal

From Anson Parker
DateWed, 25 Apr 2007 11:06:04 -0400
Subject [greenstone-users] benchmarking festival proposal
Hi All,
Recently met with some state and national librarians - we were reviewing
technologies and the subject of benchmarks came up. The state officials
have roughly 100 million documents in their collections. Lucene's
benchmarks http://lucene.apache.org/java/docs/benchmarks.html are around,
however having some benchmarks for greenstone in the 2xx series and the 3.xx
series would be very helpful. How many of you would be interested in having
your collections merged on to a single server and tested, with results to be
shared with whole greenstone community.

I've got ~4 terabytes of storage available online w/ ~5mbit connection and a
dedicated dual core, 64 bit, 4gb ram box to develop on... currently fedora
core 6 is loaded, I can set up a group ftp account, everyone interested
uploads their documents, and we have a benchmark festival.


PS the 3.xx series with its mysql capability might also be an opportunity to
test www.sphinxsearch.com (an open source full-text search engine capable of
indexing 100 million+ docs) --

PPSS recently upgraded from 2.63 to 2.72 - effortless, nice work everyone.

Aloha ya'll

Download Messenger. Join the i?m Initiative. Help make a difference today.