[OAI-implementers] Re: OAI-implementers Digest, Vol 38, Issue 7

zorica babic zoricababic1 at gmail.com
Mon Nov 26 12:09:12 EST 2007 

2007/11/26, oai-implementers-request at openarchives.org <
oai-implementers-request at openarchives.org>:
>
> Send OAI-implementers mailing list submissions to
>         oai-implementers at openarchives.org
>
> To subscribe or unsubscribe via the World Wide Web, visit
>         http://www.openarchives.org/mailman/listinfo/oai-implementers
> or, via email, send a message with subject or body 'help' to
>         oai-implementers-request at openarchives.org
>
> You can reach the person managing the list at
>         oai-implementers-owner at openarchives.org
>
> When replying, please edit your Subject line so it is more specific
> than "Re: Contents of OAI-implementers digest..."
>
>
> Today's Topics:
>
>    1. Re: Do you have instruction for ad hoc harvesters? (Caroline Arms)
>    2. Re: Do you have instruction for ad hoc harvesters? (Ed Summers)
>
>
> ----------------------------------------------------------------------
>
> Message: 1
> Date: Sun, 25 Nov 2007 12:29:29 -0500
> From: "Caroline Arms" <caar at loc.gov>
> Subject: Re: [OAI-implementers] Do you have instruction for ad hoc
>         harvesters?
> To: <oai-implementers at openarchives.org>
> Message-ID: <47496AA90200003500029730 at ntgwgate.loc.gov>
> Content-Type: text/plain; charset=US-ASCII
>
> Conal,
>
> Thanks for your suggestion about hiding the resumption token complexity
> from a user via an HTML front end.  Unfortunately, it's not that simple for
> a variety of reasons, one of which is scale.  A popular set has almost
> 200,000 records.   When the harvester has to use the resumption token
> process, that can be done without affecting performance on the applications
> that are on the same server and using the same data.  We don't want to
> create a short cut that causes problems for our regular users and
> harvesters, just to help a few requesters (who are already looking for
> records to batchload into a local database and are assumed to be savvy about
> data wrangling in their local environment) through steps that get them the
> records they want in the format they want.
>
>     But thanks again for your suggestion.
>
>     Caroline Arms             caar at loc.gov
>
> >>> Conal Tuohy <conal.tuohy at vuw.ac.nz> 11/22/07 9:19 PM >>>
> On Thu, 2007-11-22 at 12:38 -0500, Caroline Arms wrote:
> > At the Library of Congress we quite often get requests for the records
> for a collection of digitized historical materials from entities outside the
> library or digital repository community.    Typically, these are
> organizations that want to integrate a collection of photographs into an
> internal system for a particular project.  An example would be the
> production team for a TV documentary assembling an internal collection of
> records and images relevant to the topic to use as the basis for selection
> for use in the production and tracking of associated workflow.  When pointed
> at the OAI site, they are mystified.
> >
> > I am wondering whether we can create a quick how-to document tailored to
> this particular task that makes no assumptions about the technology at the
> other end.
> >
> > Does anyone have or know of a brief introduction aimed at someone who
> only needs to know enough about OAI-PMH to get the records for an entire set
> given its setSpec (having to deal with resumption tokens), but may need to
> be told soem other things, such as:
> >   *  they will have to understand enough about the semantics of the
> metadata formats available to select the right metadata prefix
> >   *  they will probably need XML tools to transform the records into
> something compatible with their local system
> >   *   etc., etc.
> >
> > If you have something like this written that has been used successfully,
> and would be prepared to share it, we would love to see it.
>
> This is perhaps a bit tangential, but might be worth considering...
>
> I've seen some OAI repositories which serve up their content with
> <Xxml-stylesheet?> processing instructions referring to XSLT stylesheets
> which convert the XML into nice HTML pages which provide a nice friendly
> user interface. You don't know you're dealing with an OAI server at all!
> These XML processing instructions are ignored by real OAI harvesters,
> but they are respected by ordinary web browsers, and they could provide
> users with a simple way to select metadata formats, navigate through
> sets, follow resumption tokens, etc, etc.
>
> For instance, here's one here:
>
> http://info-uri.info/registry/OAIHandler?verb=ListRecords&metadataPrefix=oai_dc
>
> Cheers
>
> Conal
>
> --
> Conal Tuohy
> New Zealand Electronic Text Centre
> www.nzetc.org
>
>
> _______________________________________________
> OAI-implementers mailing list
> List information, archives, preferences and to unsubscribe:
> http://www.openarchives.org/mailman/listinfo/oai-implementers
>
>
>
>
>
> ------------------------------
>
> Message: 2
> Date: Mon, 26 Nov 2007 10:19:57 -0500
> From: "Ed Summers" <ehs at pobox.com>
> Subject: Re: [OAI-implementers] Do you have instruction for ad hoc
>         harvesters?
> To: oai-implementers at openarchives.org
> Message-ID:
>         <f032cc060711260719se702e46j474873fd6d589ff at mail.gmail.com>
> Content-Type: text/plain; charset=ISO-8859-1
>
> I wrote an article for Ariadne a few years ago that aimed to
> demonstrate how to easily harvest records from an OAI-PMH provider
> with Perl [1]. The examples used a Perl module called
> Net::OAI::Harvester which supports the 6 verbs, and adds a couple
> more: listAllRecords and listAllIdentifiers which automatically handle
> resumption tokens.
>
> That being said, perhaps you could make a static repository [2]
> available? You could periodically generate a static file from your
> dynamic service and make the big file available as needed. Just out of
> curiosity has anyone written a program that will generate a static
> repository given the base URL for a data provider? It seems like a
> generally useful utility that may have already been written.
>
> //Ed
>
> [1] http://www.ariadne.ac.uk/issue38/summers/
> [2] http://www.openarchives.org/OAI/2.0/guidelines-static-repository.htm
>
>
>
> ------------------------------
>
> _______________________________________________
> OAI-implementers mailing list
> OAI-implementers at openarchives.org
> http://www.openarchives.org/mailman/listinfo/oai-implementers
>
>
> End of OAI-implementers Digest, Vol 38, Issue 7
> ***********************************************
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://www.openarchives.org/pipermail/oai-implementers/attachments/20071126/bea12db5/attachment.htm

More information about the OAI-implementers mailing list