> Warp wrote:
>> 
>>   1. It has more than one scene file, each one benchmarking its own important
>> area in rendering, for example one for raw raytracing speed, one
>> which takes long to parse, one which uses lots of memory, etc.
>
> Then, you would have multiple metrics. IMNSHO, it's a bad thing,

No, it's a good thing, because benchmarks with only a single metric are
almost useless in comparing systems.

> because everyone will wants soon it's own test scene.

The number of test scenes should be small enough that a reasonable
number of systems will be tested with each. But there should be enough
to highlight different aspects of systems, and having several scenes
also makes it easier to replace them over time without invalidating all
results.

	hp

-- 
   _  | Peter J. Holzer    | Oder glaubst du "Bugtraq" waere eine
|_|_) | Sysadmin WSR       | Science-Fiction TV-Serie ueber Schaben
| |   | hjp### [at] hjpat         | im Weltall?
__/   | http://www.hjp.at/ |	-- Juergen P. Meier in dcsm

Post a reply to this message