Re: [greenstone-devel] Greenstone Processing 1 out of 761 documents (was RE: Missing HTML documents)

From Katherine Don
DateWed, 17 Nov 2004 10:59:33 +1300
Subject Re: [greenstone-devel] Greenstone Processing 1 out of 761 documents (was RE: Missing HTML documents)
In-Reply-To (71E37EF6B7DCC1499CEA0316A256832801D4BB11-loki-wc-globexplorer-net)
hi greg

have you looked in the archives directory? there should be one directory
per original file. (some may be subdirectories).

check some of the doc.xml files (in archives) - do they look sensible,
eg is there text inside the <Content> tags?

are you using command line building or GLI or collector? if you are
using the collector, try using command line building. if teh archives
look fine, try running buildcol.pl with verbosity 4. do you get 761
lines of "GAPLug processing HASHxxx/doc.xml" type entries?

when you say only the last document is showing, what do you mean? a
titles list only has one document? a search only gives you one document?
what about a source classifier?

I would recommend upgrading to the latest version of Greenstone. And use
the Librarian Interface for collection building, or command line
building. we don't support the collector any more.

regards,
katherine

PS, if you are having trouble with collection building, details about
how you have built the collection and the collection config file are
helpful to send with your questions.


Gregory S. Williamson wrote:
> Sorry for the report but this is a serious show stopper and I haven't heard anything since posting this 3 days ago ... any help would be welcome.
>
> Thanks
>
> -----Original Message-----
> From:Gregory S. Williamson
> Sent:Sat 11/13/2004 6:59 PM
> To:greenstone-devel&#64;list.scms.waikato.ac.nz
> Cc:
> Subject:Missing HTML documents
> Dear long-suffering developers & list lurkers,
>
> I have recently built a collection from HTML documents (this is on a red hat linux using gsdl 2.40); the build summary shows 761 documents were considered for and processed into the collection.
>
> When I look in the build log I see all of the HTML files being copied and then processed (with an occasional complaint telling me that the language could not be extracted and it has assumed "en" as the encoding, which is fine).
>
> But only the last document processed by HTMLPlug seems to be showing; the subsequent steps in all import all show only some 4700 words (and some warnings for not having any data or very little data).
>
> I don't see any warnings elsewhere save perhaps a clue in the apache warning log:
> [Sat Nov 13 17:49:21 2004] [error] [client 127.0/0/1] (70007) The timeout specified has expired: ap

oops

The requested page could not be found. Please use your browsers 'back' button or the above home button to return to the Greenstone Digital Library.length_filter: apr_bucket_read() failed,
> referrer: http://127.0.0.1/gsdl/cgi-bin/library
>
> (the server is not connected to a network yet so this is a hand transcription; the time stamnp puts it about 2 minutes before then of the build process, so after most of the copying is done, I think)
>
> Any suggestions as to what might be the wrong ? I sort of had my heart set on doing the other 760 files in the same collection ;-}
>
> Thanks,
>
> Greg Williamson
>
>
>
> _______________________________________________
> greenstone-devel mailing list
> greenstone-devel@list.scms.waikato.ac.nz
> https://list.scms.waikato.ac.nz/mailman/listinfo/greenstone-devel
>