Re: More benchmarking stuff

Brian Behlendorf (brian@wired.com)
Fri, 22 Jul 1994 18:01:23 -0700 (PDT)


On Sat, 23 Jul 1994, Simon E Spero wrote:
> Although I haven't had enough time to do a full set of benchmarks, the results
> are still kind of interesting. These tests were run using web-whacker.
>
...
>
> 1500 repetitions, avg 20 queries per second, exponential distribution
> ---------------------------------------------------------------------
> NONE ONE TWO FOUR EIGHT TWELVE LOADERS
> ------------------------------------------------------------------
> MDMA 0.10 0.12 0.36 0.54 2.66 15.65
> CERN 11.4 25.08 52.28 -- -- --
> NCSA 47.16 76.34 106.91 -- -- --
> PLEXUS did not finish (daemon crashed)
> -------------------------------------------------------------------
> Plexus had difficulties even when the query rates were halved. Plexus was
> the only daemon to fail castastrophically in this test.

What do the table values mean? Amount of time it took each server to return
1500 accesses or each access?

I'd also like to see some benchmarks for servers using user authentication.
I did some simple stuff the other day with NCSA httpd on our Indigo which
suggested that for sites that expect their heavy load to be around 3
accesses per second, a user database of about 10,000 is as high as one
should go, though I think that could be improved by a daemon that keeps
the user database in memory (an option only as long as the user database
is the same for the whole system, I suppose).

Brian