Webware

Around this time last year we put together a comparison of various video sites to determine which ones had the best overall quality and user experience. Since then, high-definition-capable digital cameras and camcorders have taken off, and several major video hosts have rolled out official support for wide-screen, super high-quality Flash video in response. So we think the time has come to take another look at what these sites are offering now and crown a new leader in the realm of HD video.

The six sites we're putting head to head are: YouTube, Vimeo, Facebook, DailyMotion, SmugMug and Blip.tv.

What's being tested

Quality. For our tests, we looked at detail on two levels--both still and in motion. For the still, we used a shot of our corner Italian restaurant. From our test footage you should be able to read everything on the front awning.

For the motion element, there were plenty of cars and pedestrians outside our offices that would have made good test subjects. In this case, we went with a bicycle since it falls somewhere in between the two.

In last year's tests, we were able to do a neat mouseover trick to show you each site's original quality from the same part of a clip. We've done that again this time, but since the videos are too wide for this page, we're only doing it with a portion of the clip. While the player size on each service was different, we viewed each video at the maximum full-screen resolution (1280 pixels wide), in order to preserve the original quality.

Value. Some of these services aren't free. So what we wanted to find out is: for those that cost money, is the charge worth it?

What's NOT being tested

Unlike the last time we did this, we're not taking upload times into account, since everyone's connection is a little different. Likewise, we're not quantifying processing times, since the clip you're uploading at 4 a.m. on a Tuesday night will probably get processed faster than the same clip at 9 a.m. on a Monday morning. We have, however, noted the respective size limits at each site, which can be incredibly important. HD video files are big, even if you're talking about a relatively short clip.

All the services we used processed our videos within about 10 minutes. The one exception was Vimeo, which took nearly three hours from the time it finished uploading to show up live on the site. This could have just been a bad time to upload, and keep in mind that paying users of Vimeo's Plus service get their videos sent to the front of the queue.

About the test footage

Click to play the sample video

To get a decent test shot, we went with a consumer-friendly, pocket-sized capture device. In this case it's the recently released Flip Mino HD (CNET review). It captures really good-looking video in 1280x720 resolution at 30 frames per second. It doesn't shoot in 1900x1080, also known as "full HD," but we're assuming that most folks are going to be using devices that shoot 720p anyway.

The footage is just a hair over three minutes long, which is about the standard for Web video, and has not been changed from its original camera formatting. It encompasses fast motion (the cars whizzing by), fine detail (local restaurant signage), and plenty of ambient sound.

You can find each version of the video at each site: Blip, DailyMotion, Facebook, SmugMug, Vimeo and YouTube.

The results

One of our biggest complaints with the Apple TV was the dearth of HD video content. The product is capable of streaming 720p high-definition video, but to date, all of the movies and TV shows at Apple's iTunes Store are encoded at a "near DVD" resolution of 480p. But HD content has finally arrived on iTunes--and it's free. The Washington Post announced today that its online HD video podcast--which is shot in 720p high-definition--will now be available through iTunes.

We downloaded the two most recent episodes of the podcast--Edwards Family Values as well as Contamination and a Crusade--to evaluate the video quality. Overall, it was a big step up from previous iTunes fare, but critical viewers will find it falls short of HD broadcasts and even most DVDs. When viewed on a 42-inch Panasonic plasma TV, the improved resolution was evident on the images of John Edwards speaking to an auditorium full of students, but false contouring and solarization artifacts were easy to pick out in the background (white walls were a prime culprit). Close-ups of Edwards' face also exhibited some swimming pixels. Likewise, the depth of field offered was good, but not comparable to what you'd find on an HD broadcast (let alone a Blu-ray or HD DVD movie).

The problem here isn't resolution but bitrate--4,061Kbps with a mono soundtrack. That's a big improvement over the 1,516Kbps encoding found on a purchased episode of The Office, but merely 40 percent of the 10Mb capacity found on a standard-definition DVD. (Apple TV maxes out at 5Mbps, or about 5,000Kbps.) Of course, the better video quality comes at the expense of file size: the Edwards video was a mere 8.5 minutes long, but the file was a rather meaty 250MB--the same size as the aforementioned 21-minute episode of The Office. In addition to the increased download time, the large file size and bitrate affects streaming performance as well. Live streaming from an 802.11g laptop to the Apple TV (via an 802.11n Belkin N1 router) did produce the occasional buffering hiccup--the source PC would need to be wired or upgraded to 11n wireless to guarantee smooth streaming--but once we synced to the Apple TV's hard drive, play was perfect.

Of course, iTunes and the Apple TV were always capable of HD streaming, but the big news here is that the HD content is available through the iTunes Store. (Previously, you needed to download the HD file--say, a high-definition trailer at Apple's Quicktime site--and then manually import it into iTunes.) Video podcasts are a nice first step, and the fact that they're free is always welcome. But we're hopeful this is a trial balloon that will signal the availability of high-definition movies and TV shows from the iTunes Store in the not too distant future.

Note: Since originally published, this blog post has been updated with hands-on analysis of the HD video performance on Apple TV.