[OAI-implementers] deep nesting problem in DP9

[Young,Jeff]

I'd hate to see DP9 get too elaborate with it's caching. Here's an idea for
a simple solution. You could have a directory somewhere that contained a
subdirectory for each registered repository. Then, you could transform each
ListIdentifiers response into HTML as you harvest them and save them as
separate HTML files in that directory (perhaps gzip'd to save space). When
the time comes to refresh the cache, you could delete the contents of the
subdirectory and start over. After the harvest, it should be fairly simple
to generate an HTML cover page to cover the lot.

Jeff

> -----Original Message-----
> From: Xiaoming Liu [mailto:liu_x@cs.odu.edu]
> Sent: Thursday, November 14, 2002 12:16 PM
> To: Michael Nelson
> Cc: oai-implementers@oaisrv.nsdl.cornell.edu
> Subject: Re: [OAI-implementers] deep nesting problem in DP9
> 
> 
> On Tue, 12 Nov 2002, Michael Nelson wrote:
> 
> > 
> > [deletia]
> > 
> > > (snippet from Jeff's email)
> > > 2) Create a new verb named ListResumptionTokens that
> > > returns a complete set of stateless resumptionTokens.
> > >   pro) easy to implement in DP9 side.
> > >   con) requires modification of the OAI spec.
> > > 
> > 
> > have a "pre-crawler" that creates html page(s) filled with 
> the pre-built
> > ListRecord requests with stateless rT's.
> 
> This will work for the repository with statelss rT 
> implementations, but
> not all repositories use stateless rT.
> 
> I think Jeff's suggestion of caching all listidentifiers is a 
> good way,
> so I can manipulate whatever way I prefer. But This will make 
> DP9 a bit
> complicated (with a harvester and caching mechanism).
> 
> regards,
> liu
> 
> 
> 
> > 
> > this is similar to your #1 suggestion, but uses the rT's 
> themselves to
> > create the bins.  
> > 
> > regards,
> > 
> > Michael
> > 
> > > 
> > > best regards,
> > > liu
> > > 
> > > 
> > > 
> > > 
> > > 
> > > _______________________________________________
> > > OAI-implementers mailing list
> > > OAI-implementers@oaisrv.nsdl.cornell.edu
> > > http://oaisrv.nsdl.cornell.edu/mailman/listinfo/oai-implementers
> > > 
> > 
> > ----
> > Michael L. Nelson mln@cs.odu.edu http://www.cs.odu.edu/~mln/
> > Dept of Computer Science, Old Dominion University, Norfolk VA 23529
> > +1 757 683 6393 +1 757 683 4900 (f)
> > 
> > 
> > 
> > _______________________________________________
> > OAI-implementers mailing list
> > OAI-implementers@oaisrv.nsdl.cornell.edu
> > http://oaisrv.nsdl.cornell.edu/mailman/listinfo/oai-implementers
> > 
> 
> _______________________________________________
> OAI-implementers mailing list
> OAI-implementers@oaisrv.nsdl.cornell.edu
> http://oaisrv.nsdl.cornell.edu/mailman/listinfo/oai-implementers
>