The challenges of PC benchmark development
One of our goals here in CNET Labs is to keep PC benchmark testing current. This does not come without its challenges. One good example of the process is our recent work on a new Photoshop CS5 benchmark.
First, a little background. We are sometimes asked why we don't use off-the-shelf benchmark apps such as 3DMark or Sysmark. These software packages are popular benchmarking tools, but they're synthetic benchmarks, in that they represent performance in a series of proprietary tasks, not commonly used consumer software. Those kinds of tests certainly have value--for example, we currently use Cinebench 11.… Read more