Apple patent application blends touch, voice, face

A new Apple patent application could provide ways to control a computer with a combination of input technologies.

(Credit: U.S. PTO)

Apple may be thinking about adding new ways to improve the multitouch interface work that is central to the company's plan for the future.

Unwired View unearthed a patent application filed by Apple (thanks, Gizmodo) containing ideas for a user interface system that builds on the multitouch input used on the iPhone by adding technology for voice recognition and even facial recognition.

Wayne Westerman and John Elias, the brains behind a multitouch interface company called Fingerworks, acquired by Apple in 2005, are listed as inventors on the patent application, as they have been for several other multitouch patents coming out of Apple.

The idea behind the latest patent application is to combine input from different sources, whether that's the now-familiar iPhone multitouch concept, voice recognition, or facial expressions.

Systems may have multiple input means. However, each input means is typically operated independently...in a nonseamless way. There is no synergy between them. They do not work together or cooperate for a common goal such as improving the input experience.

That's what Apple hopes to do with the system it's trying to patent--combine multiple forms of input in order to more efficiently control a computer. For example, you could select an object with a finger gesture, order the computer with a voice command to change that object's color to blue, and then tell the computer where you want to place the object by staring at the lower right-hand corner of the screen.

Patent applications, as a rule, are designed to cover as wide an array of possible applications for the technology as the author can think of, so don't expect to see a Mac or iPhone with all of that stuff just yet. Still, it does seem that Apple is putting an awful lot of time into user interface design these days.

[dascha1]

As I understand it, MMM provided a surface in conjunction with speech tech on a PC in 1996 for the Pentagon Renovation Phase. This doesn't appear to be anything new under the sun except that from a military stand-point, the elderly, low vision and disabled folks (provided a parking spot was available for them) were able to use the 'virtual bulletin board' way back then, prior to this anyway...

[Vegaman_Dan]

These features are already part of Microsoft's Surface which is running Vista underneath that. Could be interesting to see who has the patent on this since Microsoft already has a product out with this. Apple might be able to sue Dell and Microsoft for the technology.

[joetesta70]

Now if they could just blend in the GREED then $teve Job$ will be all set.

[vonBeelzebub]

Steve Jobs is a genius, as is Bill Gates. I keep reading blog entries from Mr. Testa, who seems to hate the former. I wonder what Mr. Jobs has done to you, sir? Everyone knows Microsoft Windows is a complete ripoff of the Macintosh system and that Mr. Gates made a deal with Mr. Jobs when he returned to Apple in the mid-90's which helped keep them afloat until the iMac & iPod were released which brought them to success Apple is building on now. There is so much jealousy and hatred towards successful individuals and corporations. Men like Mr. Jobs and Mr. Gates can do what they want with their money. They obviously see competition as a good thing and don't hold the grudge that you hold, Mr. Testa.