• On GameSpot: So-called 'Halo killer' gets 23 to life
June 22, 2009 7:30 AM PDT

Google's vision improving for image search

by Tom Krazit
  • Font size
  • Print
  • 2 comments

Google thinks it has made a breakthrough in "computer vision."

Google's new landmark search research uses clustering techniques to match similar photos of famous landmarks, such as the Acropolis. (Click for larger image)

(Credit: Google)

Imagine stumbling upon a picture of a beautiful site in Europe filled with ancient ruins, one you didn't recognize at first glance while searching for vacation destinations online. Google has developed a way to let a person provide Google with the URL for that image and search a database of over 40 million geotagged photos to match that image to verified landmarks, giving you a destination for that next trip.

The project is still very much in the research stage, said Jay Yagnik, Google's head of computer vision research. The company plans to present a paper Monday at the Computer Vision and Pattern Recognition Conference in Miami detailing its work in proving that large, scattered sets of data can be used to make accurate assessments of individual images.

"This is a fundamental advancement in how we look at computer vision," Yagnik said.

To create the "landmark recognition engine," Google took advantage of the 40 million or so images in Picasa and Panoromio that were geotagged with the locations of famous landmarks, like the Eiffel Tower. It also assembled images from travel guide sites such as Wikitravel as a base of landmark photos that had been verified by experts.

With all that data as a backdrop, researchers figured out a way to find the most representative pictures of a landmark using a clustering technique to group images taken from similar perspectives, as well as toss out "noisy" images such as a picture of your family on the street in front of the Eiffel Tower that doesn't really show the landmark.

Then, when given a fresh image to analyze, the system uses pixel-matching techniques to find small patterns within that image and look for similar patterns within verified photos of landmarks. Google said it has been able to return an accurate result 80 percent of the time, not only naming the landmark but allowing it to supply additional information about the place.

Google is by no means certain when, or if, this research will turn into a product. It is excited, however, that it has found a way to use computers to process large sets of data available on the Internet and return accurate information about images; doing this with text, of course, is what has made Google Google.

Tom Krazit writes about the ever-expanding world of Internet search, including Google, Yahoo, online advertising, and portals, as well as the evolution of mobile computing. He has written about traditional PC companies, chip manufacturers, and mobile computers, spending the last three years covering Apple. E-mail Tom.
Add a Comment (Log in or register)
by smile_heart June 22, 2009 8:45 AM PDT
Is this PhotoSynth in a way ??? ...


Tooooo Late.
Reply to this comment
by TV James June 24, 2009 12:07 PM PDT
Well, cobble that with their own street view and perhaps soon they'll be able to tell you where you took every photo that you've taken outdoors (or where a street is visible in the background) through a window and/or use your photos to fill in gaps in street view. Interesting potential. Start with the landmarks and work outwards.
Reply to this comment
advertisement

About Webware

Say No to boxed software! The future of applications is online delivery and access. Software is passé. Webware is the new way to get things done.

Add this feed to your online news reader

Webware topics

Inside the Apple, er, Microsoft Store

Although Redmond's foray into retail bears a big resemblance to Apple's approach, Microsoft has added some distinctive features to draw casual PC buyers and techies alike.

Big marketing budget drives Moto Droid sales

Verizon and Motorola are spending big bucks--$100 million--on marketing the new smartphone, and it looks like it will pay off with 1 million devices sold by year's end.

Inside CNET News

Scroll Left Scroll Right