Re: Requesting URLs

Roy T. Fielding (fielding@avron.ICS.UCI.EDU)
Fri, 16 Dec 1994 19:36:35 -0800

> Currently surfing the net in search of (WWW)URLs which will be compiled into
> a publication early next year. Can you help me? My guess is that there are
> thousands avaiable and I need as many as I can get. Please feel encouraged
> to send me your favorites (or maybe your not so favorites.) Any and all will
> be appreciated.

Ummmmmm, perhaps you should place a few more restrictions on what
you are looking for. My conservative estimate is that there are currently
at least 1 million different URLs out there right now (and that's just HTTP),
and it'll probably be 2 million by June (end of the school year).
My site alone has 2168 unique URLs reachable from server root (not including
many private sub-webs).

Even if you cut it down to just "the top of distinct infostructures",
you are still looking at a minimum of 50,000 (5/server on avg) and
more likely 200,000.

If you want a quick start on what URLs are worth following, see Yahoo
<http://akebono.stanford.edu/yahoo/> which currently contains 22,837
entries.

......Roy Fielding ICS Grad Student, University of California, Irvine USA
<fielding@ics.uci.edu>
<URL:http://www.ics.uci.edu/dir/grad/Software/fielding>