New computer interface: Blow on the screen

Different sound frequencies indicate where on the screen a user is blowing.

(Credit: Georgia Tech)

Perhaps huffing at your computer might get you somewhere if research at the Georgia Institute of Technology comes to fruition.

Shwetak Patel and Gregory Abowd from Georgia Tech have published a paper that describes how to use a computer microphone to determine where on a screen a person is blowing. The technique, which they call BLUI for Blowable and Localized User Interaction, can distinguish between the different sounds air makes depending on where the breath is directed.

"BLUI supports blowing at a laptop or computer screen to directly control specific parts of an interactive application, such as blowing at a button to activate it," the researchers said in their paper (click for PDF). The technique requires a period of "training" to calibrate the system--blowing on each region of the screen for 3 to 5 seconds.

The hands-free user interface approach could be useful for situations where a person's hands are busy, or for people who can't control computers with their hands or arms in situations where speech control is impractical. Although speech "is reasonable for complicated or command-based tasks, it is not well-suited for direct, low-level controls such as scrolling, button pressing, or selection," the researchers said.

Of course, the resolution isn't as fine as a mouse pointer.

The accuracy was 100 percent when dividing a laptop screen in to a nine-rectangle region. It dropped to 96 percent for 16 regions, 80 percent for 25 regions, and 62 percent for 36 regions.

The technique also could be used for games such as a basic one in which users blow out virtual candles, shown in the YouTube video above.

(Via John Nack.)

[whizkid454]

We already waste enough air...

Why waste it by blowing on a screen!?

[yaZULU]

Could be interesting

I think this has applications for situations like doctors working
surgery where using fingers is unfeasible, but mind you it would
be difficult to breath through a mask, so kinda negates that one,
but Ive worked with disabled children who lack fine motor skills,
this would be perfect, or at least a great step up.

[Shannon Michael]

Could Become Trendy... Air Jordan

On the lighter side, I think a lot of
young people are going to blow away
those things they don't want to see.

Something so simple could become trendy.

Gives a new meaning to the name, Air Jordan.