• On TechRepublic: FREE download: Social networking policy
November 14, 2007 4:00 AM PST

Up next: Cameras that know who you photographed

by Stephen Shankland
  • Font size
  • Print
  • 8 comments

MONTEREY, Calif.--Get ready for a new era in which your camera knows not just when you took a picture but who's in it, too.

Many cameras today can detect the faces of those being photographed, which is handy for guiding the camera to set its exposure, focus, and color balance properly. But the more difficult challenge of face recognition is more useful after the photo has been taken.

University of California-San Diego researchers have turned expression-recognition technology into an art exhibit showing the increasingly strained efforts by models to maintain a chipper smile for more than an hour. A buzzer goes off when a waning smile sends a monitor into the red zone.

(Credit: Stephen Shankland/CNET Networks)

That's because of a concept called autotagging, one of a number of technologies that make digital photography qualitatively different from the film photography of the past.

Tags of descriptive data can be attached to digital photos, and they help people find and organize pictures. The only problem is that tagging your photos, today a laborious manual task, is like eating your vegetables. It's good for you but a lot of people don't like it.

With autotagging, the camera attaches tags as the pictures are taken. Today, cameras embed timestamps in photos, which makes it possible to sift through pictures by date. But be honest here--how reliably can you remember exactly when you took that picture of your darling daughter a year or two ago that you'd like to e-mail to her grandparents? Being able to screen for photos only of a particular person could dramatically speed up the search process.

Face recognition requires computational horsepower that is hard to fit into the confines of a digital camera, but one company likely to help make it a reality is Fotonation, which already supplies face-detection software for dozens of camera models from Samsung, Pentax, and others.

The computational challenge is reduced by the fact that most folks tend to photograph the same set of 25 or 30 people, Eric Zarakov, Fotonation's vice president of marketing, said in an interview here at the 6sight digital imaging conference. A camera could be "trained" to recognize just those particular people.

He wouldn't comment on whether Fotonation plans to sell such software to camera makers, but it sure looks likely. "We're looking at a lot of stuff. That would be a natural extension" of today's product lines, Zarakov said.

One camera maker willing to mention its interest in autotagging is Panasonic. "A lot of thought is going into how to tag photos so you can retrieve them at a moment's notice," said Alex Fried, national marketing manager for imaging at Panasonic's Consumer Electronics Co. But he wouldn't go into specifics: "There are things we have in the works that will help benefit consumers going forward."

And faces aren't the only aspect of autotagging that's likely to show up in cameras. Location, too, is another useful attribute that can be attached to photos through a process called geotagging. Geotagging can be used both to look for photos whose location you know and to figure out what exactly is in a photo you already have at hand.

Today, geotagging is generally a laborious manual task that requires geographic data to be merged with photos after the fact using a computer. But more power-efficient approaches will lead to in-camera GPS systems that will enable automatic geotagging, predicted Kanwar Chadha, founder of GPS chip designer SiRF Technology.

"A location stamp is much more important than a time stamp in most cases. A year down the road, you have no idea where those pictures were taken and no way to search for location," Chadha said.

Face recognition is an area of active research and some commercialization. Start-up Riya is working on technology to search through online photo albums to try to identify individuals. Polar Rose is trying to improve recognition by generating 3D models of faces. And 3VR wants to apply face recognition to what's become a highly lucrative market, security.

Software from University of California-San Diego researchers, shown here at the 6sight digital imaging conference, can identify facial expressions. This shot shows the nose-wrinkling detector in action, which Marian Stewart Bartlett believes could be useful for market researchers.

(Credit: Stephen Shankland/CNET Networks)
But that's not the only research going on.

At the 6sight conference, Marian Stewart Bartlett showed results of her research into not just face detection, but expression detection. Her work at the Machine Perception Lab at the University of California-San Diego lets a computer monitor 30 of the 46 codified components of facial expressions. That includes movements such as raised eyebrows and wrinkled noses.

In the demonstration, software tracked Stewart's face from a video camera and recorded expression parameters. Analyzing the data, the computer can draw conclusions about people. For example, when comparing a video of a man's face as he experienced actual pain from immersing his hand in cold water to another in which he faked the pain, people had about an even chance guessing which showed the authentic pain. The computer, though, had 72 percent accuracy, she said.

That level of sophistication is beyond a camera's abilities today, requiring a full-fledged computer run by people with Ph.D. degrees. But particularly given that Sony already has introduced a camera with smile detection, it's not hard to imagine a day when your photos could also some day be tagged "delighted" or "disgusted," too.

Stephen Shankland writes about a wide range of technology and products, but has a particular focus on browsers and digital photography. He joined CNET News in 1998 and since then also has covered Google, Yahoo, servers, supercomputing, Linux and open-source software, and science. E-mail Stephen, or follow him on Twitter at http://www.twitter.com/stshank.
Recent posts from Underexposed
Nikon app teaches photography on the fly
Smile! Flickr has an official iPhone app
Corel Digital Studio 2010 opens up to consumers
Adobe tests raw support for Olympus E-P1, new Nikons
Adobe's next Lightroom to forsake PowerPC Macs
How Flickr needs to change
Adobe kills low-end Photoshop, urges users online
Toshiba plans 64GB SDXC memory cards for 2010
Add a Comment (Log in or register) (8 Comments)
  • prev
  • 1
  • next
Profiling - Sign me up!
by Mike_in_Florida November 14, 2007 4:46 AM PST
This is great! I can't wait till I can be profiled by anyone, anywhere. Who needs to go to the airport - I can be profiled right in my neighborhood 7-11 store, or Barber shop, oil change place. I love how all of my privacy and rights are being tightened more and more! Soon I can go grocery shopping and the store can tell me what I will be eating based on my face recognition. Mexicans are whisked to the taco aisle, Jewish to the Matzo balls, etc.
Reply to this comment
You're an idiot.
by mriffon November 18, 2007 6:35 AM PST
This is in now way even touching your freedom/rights. You've got to remember that the system can only tag pictures of people who are on file (in the camera). The 25-30 people who you photograph most.
Violates a Google principle
by chassoto--2008 November 14, 2007 5:27 AM PST
They say "save everything, depend on SEARCH to find things when
you need them." Spending time "organizing" data as it's created is
often not worth the effort. Instead, intelligent search can find the
items more effectively when you need to find something. Cameras
should just get cheaper and produce better quality images. Let the
silicon in the storage/retrieval system (Grandma's Mac) do the
search/indexing.
Reply to this comment
How do you search without tags?
by Blargosaurus November 14, 2007 6:32 AM PST
If the images don't have any reference data on who, what, where, or when how were you planning on searching to find the images you need.

If Grandma's Mac has software to automatically insert tags as images are imported, that's fine. I don't know that it has to be on the camera, but that would be handy if you download from the camera to multiple computers.
more robots
by bewoofy1 November 14, 2007 8:20 PM PST
Just read a book in the humor section called 'are you ready for the robot uprising"

It told all about their sensors, face recognition, gait recognition, etc. This is 'robotics' technology as far as I can tell. But robotics looks really hot. Then who knows where rfid will go?

Any Narcissists out there? You are about to have your dream come true. All these fuzzy devices with robotics will be watching. Stick around long enough, might even get your ideal mate. LOL
Reply to this comment
Ya'll can HAVE all this Big Brother C.R.A.P.!!!...
by btljooz November 15, 2007 11:33 AM PST
I will [b]NEVER[/b] buy a camera equipped with such male bovine fecal matter[b]!!!!![/b]...at least NOT until I can no longer use REGULAR film X-( :( ...
Reply to this comment
Cameras that Know who you photographed
by JCipo November 15, 2007 2:42 PM PST
When cloning came out people started (and still respond) to fear that human clones would be the result. What the real issue is is making quality body parts. Well, these responses I have read about this article show the same fear response.
I have been using face recognition (primitive at this time) in my Fuji camera for over 6 months.
This allows the camera to concentrate on the exposure which makes the face stand out, of the person you are taking the picture of.
If advanced face recognition is made to recognize a person yes it sounds like big brother but what happens if it this technology can spot illegals that may want to attack our country. Technology can be used for good and bad. If we start to panic over these advancements then we may end up in another dark age where we begin to believe superstition over science.

John Cipo
Reply to this comment
Great
by GGGlen November 18, 2007 5:01 AM PST
Just try convincing the natives that we AREN'T stealing their souls
now!
:-)
Reply to this comment
(8 Comments)
  • prev
  • 1
  • next

The browser battles go on and on

roundup From Firefox to IE and from Chrome to Opera and Safari, there's no sitting still for browser makers looking to keep their products fresh and competitive.

3G wireless still holds promise

The next generation of 4G wireless may get all the headlines, but advanced 3G technology will likely dominate services for the next few years.

About Underexposed

This blog sheds light on digital photography subjects such as cameras, photo editing, and Web sites. Shankland joined CNET News in 1998 after a five-year stint as a science writer. He's a lab rat who grew up in Los Alamos, N.M., and graduated from Harvard.

Contact Stephen at Stephen.Shankland@cnet.com

Add this feed to your online news reader

Underexposed topics

advertisement
advertisement

Inside CNET News

Scroll Left Scroll Right