• On GameSpot: So-called 'Halo killer' gets 23 to life
February 13, 2008 10:00 AM PST

Inside CNET Labs: Windows Vista SP1 performance

by Daniel A. Begun

The long-awaited Service Pack 1 update for Windows Vista brings with it a number of significant bug fixes and other improvements. Microsoft says that with it you will also see a number of noticeable performance improvements as well. In our initial round of testing, we saw a mixed bag of results: we saw a few notable performance improvements under some conditions as well as significant performance degradations in others. For the most part, however, we saw little difference in performance between Vista and the Vista SP1 update.

As we dug a little deeper into Microsoft's claims, we discovered that many of the performance improvements being touted aren't actually directly attributable to SP1. Many of the claimed performance improvements, such as improved boot-time, are actually more a function of improved third-party drivers and applications that are benefiting from a year's worth of programming for Vista, and from the programmers getting continued feedback and guidance from Microsoft. As long as you have been diligent about keeping your Vista system current with the latest Windows updates and third-party drivers, you likely already have many of the potentially performance improving enhancements.

That's not to say that there aren't any potential performance benefits in SP1. An area of Vista the Microsoft developers spent a great deal of time trying to improve was file copying. Under some scenarios, copying files with Vista took longer than with XP. Under other scenarios, Vista, gave the impression that Vista was taking longer to copy files than XP, by not dismissing the copy dialog box sooner. Much of this has to do with the mode in which these file copies are taking place. XP uses a cached I/O mode; Vista uses a predominantly un-cached I/O mode; and Vista SP1 is back to almost always using a cached I/O mode for file transfers. (For an in-depth, under-the-hood discussion of all this, see Microsoft employee Mark Russinovich's blog entry titled Inside Vista SP1 File Copy Improvements. Among other things, Mark is credited with discovering the rootkit on Sony BMG audio CDs in 2005.)

Desktop system - file copy: internal drive to internal drive (in seconds)
(Shorter bars indicate better performance)
Windows Vista Ultimate SP1  
Windows Vista Ultimate  
Copy from drive #1 to drive #2
21 
26 
Copy from drive #2 to drive #1
23 
26 

File copy: folder-to-folder on the same drive (in seconds)
(Shorter bars indicate better performance)
Windows Vista Ultimate SP1  
Windows Vista Ultimate  
CNET Labs test bed desktop system
34 
37 
Dell XPS M1530 laptop
61 
65 

In our file copy tests of approximately 1GB worth of files of varying size, we saw noticeable performance improvements with Vista SP1 over Vista in several scenarios. Scenarios such as copying a folder from one location to another on the same disk, or when copying a folder from one internal drive to another.

File copy: internal drive to USB 2.0 drive (in seconds)
(Shorter bars indicate better performance)
Windows Vista Ultimate SP1  
Windows Vista Ultimate  
Desktop - write to USB disk
66 
43 
Desktop - read from USB disk
46 
45 
Laptop - write to USB disk
75 
52 
Laptop - read from USB disk
52 
51 

The one area where we saw a significant performance degradation with SP1 was when writing the folder to a USB 2.0 hard drive. We saw between a 44- and 54-percent degradation on Vista SP1 versus Vista. It's difficult say exactly what is causing this performance drop. In Mark Russinovich's blog, he mentions a number of scenarios where Vista SP1's file transfer performance can be potentially slower than with Vista. While this particular scenario was not one of the ones he outlined, it is possible that the same factors apply. We will continue to investigate this issue and will report back with any new findings.

For the most part, we have not seen significant performance difference between Vista and Vista SP1 in terms of application performance, boot time, shutdown time, and laptop battery life. In our initial round of testing with a Dell XPS M1530 laptop, we did see a significant improvement with Adobe Photoshop CS3 performance, which we initially speculated was because of the reintroduction of cached I/O into SP1. However, we have not been able to recreate this performance boost on other systems. We are still looking into this issue as well.

So does Vista SP1 deliver all the performance benefits it promises? So far the answer is both yes and no. We didn't look at every claim Microsoft is making about SP1's performance improvements--for instance, Microsoft says that you should also see significant performance improvements with many types of network file transfers. However, At the end of the day, updating your system to SP1 is not really about the performance improvements--it's primarily about having a more bug-free, stable operating system. Of course, having a better performing operating system is always a plus.

For more about Windows Vista, see CNET's Windows Vista resource guide.

Find out more about how we test laptops and desktops.

System configurations:

CNET Labs testbed desktop system
2.2GHz AMD Phenon 9500; 2048MB DDR2 SDRAM 800MHz; 512MB ATI Radeon HD2900XT; 74GB Western Digital 10,000rpm; 250GB Maxtor 7,200rpm

Dell XPS M1530
2.4GHz Intel Core 2 Duo T7700; 2048MB DDR2 SDRAM 667MHz; 256MB Nvidia Geforce 8600M GT; 160GB Hitachi 5,400rpm

Recent posts from Crave
New pre-orders of Nook get later shipping date
Beamer, the iPhone case for night owls
This week in Crave: Day of the Droid edition
Verizon's LG Chocolate Touch is nice but nothing new
Popular iPhone movie app flops on BlackBerry
Top 5 most popular products for November
Ridiculous new Peeks inspired by TwitterPeek
Hands-on with the Nokia Booklet 3G
Add a Comment (Log in or register) (12 Comments)
  • prev
  • 1
  • next
Why wasn't this compared to XP
by Venture February 13, 2008 11:39 AM PST
I appreciate the benchmarking but it would be great to show how it compares on that same system using XP. I see a lot of threads comparing Vista SP1 to Vista but it would be great to also have Windows XP for those considering moving from Vista to XP or vice versa.
Reply to this comment
Agreed -- XP comparison would be nice
by scythie February 13, 2008 11:51 AM PST
Many of Vista vehement defenders [aka: fanboys] claim that Vista SP1 would decisively fix everything that Vista was hated for, but it seems it's not the case. Maybe an XP comparison would create for a more diverse and useful discussion.
Reply to this comment
Only one fix I care about
by ravyn007 February 13, 2008 12:11 PM PST
The only fix that I actually care about that Microsoft should make immediately is fixing the stupid UAP (User Account Protection). I don't want to be asked a million times if I want to change my screen resolution, put a file in the C drive or on an external hard drive, open a program or any number of stupid popup messages warning me of supposed impending doom. I'm an admin on my system so let me be an admin!!! Stop asking me asinine questions. It only causes every message to be ignored and then one day someone goes and actually does something stupid because they ignored the first important warning of a 1000 that meant nothing. Microsoft has to let the user decide how many warnings they want their system to give and for what reasons. Geesshhhh, if I can't be trusted by my own OS...
Reply to this comment
Vista File Permissions
by Xandergrampy February 14, 2008 5:36 AM PST
I've had problems deleting files because of the permissions, and it's a hassle to have to change the permissions just to get rid of something when it's under the administrator's account.

George
Crazy? 33778 days and 6 hours
by planetlowyat February 13, 2008 4:51 PM PST
Shall I wait for 33778 days and 6 hours for copy 18.8GB data from external disk to Microsoft Windows Vista SP1 machine?
Reply to this comment
Crazy? 33778 days and 6 hours
by planetlowyat February 13, 2008 4:51 PM PST
Shall I wait for 33778 days and 6 hours for copy 18.8GB data from external disk to Microsoft Windows Vista SP1 machine?
http://www.planetlowyat.com/blog/windows-vista-suck/
Reply to this comment
Turn on your cache
by eric0116 February 13, 2008 8:44 PM PST
Hey planetlowyat, this is the kind of thing that is giving Vista a bad name without a reason. Turn on the write cache for your external device. It was the can in XP, it is the case now. In order to enable quick removal of a USb device, it disables write caching in order to avoid data loss. If you are doing bog transfer, say to an external hard disk, you need to turn it on in Device Manager. By the way, for all those who can't find what your looking for, just type it in the search box when you click start. Sheesh, don't be so ties to your old habits.
Reply to this comment
Performance
by fasnsane February 16, 2008 4:15 AM PST
why are you benchmarking copy performance... no one cares about that what people really want to know is game performance between Vista, SP1 and XP..
Reply to this comment
by happyholycow November 17, 2008 5:05 PM PST
Yeah... UAC is also a pain.
What about the defragmenter and UAC?
by slipplane February 17, 2008 8:01 AM PST
So, have they fixed Vista's buggy defragmenter in SP1? The last time I checked, it had no display for fragmentation levels or progress indication. A pretty useless 'utility' if you ask me! I installed Diskeeper on both my Vista machines, and it's been smooth sailing since- Diskeeper is miles ahead of Vista's defragger in functionality, features and performance.

I hope they atleast fixed the ridiculously annoying UAC popups in SP1. This intrusive and irritating security 'feature' of Vista is enough to drive a man insane.
Reply to this comment
usb drive?
by simbee February 18, 2008 10:45 AM PST
Did I miss something?... What USB drive did you use?... and if it is the Buffalo Ministation Turbo, was turbo turned on? What usb chip are in these test computers? did you try more than one usb drive? Please let us know how you "tested" these drives?
Reply to this comment
large folder copy issue
by srikanth_janga February 21, 2008 10:53 AM PST
the biggest issue i saw in vista was the amount of time it took me to cut and paste a 16GB mp3 music folder from the "My Pictures" folder to my external hard-drive (both through USB and ESata). it took me 3.5 hours to move this information. copying however took only 2.5 hours. I tried doing this on a different hard drive and saw the same issue. With XP SP2, it took me a little over 25 minutes for the same thing. I hope this is one of the things they fixed.
Reply to this comment
(12 Comments)
  • prev
  • 1
  • next
advertisement

About Crave

The name says it all. Crave is our blog about gorgeous gadgets and other crushworthy stuff. If you would like to contact Crave with a tip or comment, please write to: crave@cnet.com

Add this feed to your online news reader

Crave topics

FAQ: Buying the right Windows 7 upgrade

Readers still have lots of questions on just which version of the software they need to buy in order to upgrade their PC. CNET News tries to offer some answers.

N.Y. lawsuit details Intel's 'largesse' toward Dell

Attorney General Andrew Cuomo's federal antitrust case filed Wednesday alleges a longstanding symbiotic relationship between Intel and Dell.