April 4, 2006 12:20 PM PDT

MIT group develops 'mind-reading' device

CAMBRIDGE, Mass.--Three researchers at the MIT Media Lab have developed a device that "reads minds" and alerts wearers to the emotional state of the person they're conversing with.

The device, called the Emotional Social Intelligence Prosthetic, or ESP, was presented by Rana El Kaliouby on Tuesday at the 2006 Body Sensor Network Conference at the MIT Media Lab. The research team hopes the device will help people with autism learn to better read the social cues of others.

"Mind-reading" is a psychology term for the subconscious notice and analysis of nonverbal cues, such as facial expressions and head movements, which humans regularly use to determine the emotional states of others.

"Mind-reading is something we do all the time subconsciously," El Kaliouby told CNET News.com. "We use behavior and nonverbal cues to analyze the state of those you are speaking with to modify your own actions and those of others by trying to motivate them," she said.

Click for images

El Kaliouby is developing the ESP device for her postdoctoral project as part of the Affective Computing research group at the MIT Media Lab under Rosalind Picard. Alea Teeters, also a member of the group and the ESP project, demonstrated the device. The project stems from El Kaliouby's doctoral work at the University of Cambridge, in which she developed the computational model on which the device is based. Like humans, the system determines emotional states by analyzing hierarchical combinations of subtle facial movements and gestures, such as eyebrow raising, lip pursing and head nodding.

The ESP consists of an OQO handheld, a tiny wearable video camera, an earphone and a small vibrating device that can be worn on a belt. The camera can be attached to a baseball hat, or worn around the neck on a stand akin to a harmonica holder.

The ESP camera can be worn facing outward by the speaker, or as a self-cam by the listener. As conversation ensues, the device "mind-reads" for the wearer. When the listener, whom the camera is focused on, begins to exhibit signs of boredom, the speaker is signaled so that she can readjust her behavior to bring the listener back into the conversation.

The device is especially useful to those with Autism Spectrum Condition (ASC). people with ASC often lack the ability to evaluate others' emotions on their own. The result is that high-functioning autistics, who might otherwise fair reasonably well in the world on their own, are hampered by a tendency toward misunderstanding and boring others.

The ESP device can prompt autistic people, who are prone to monologues or repetitive behavior, to ask questions, or give the listener a chance to participate in conversation. The hope is that with long-term use of the device as a self-teaching tool, ASC patients will eventually learn how to read for themselves the emotional responses in others.

According to data released by the Centers for Disease Control and Prevention, one in 166 children have some form of autism. These cases range from mild to severe, and the prevalence of the disorder among the population has been on the rise since the 1980s.

The computer data-sets of the ESP, which are currently programmed to detect six emotional state standards, can be readjusted for cultural differences in facial expression patterns, or updated with new information personalized to the wearer.

However, there are some challenges. The ESP computer does not yet take eye movement into account, and a better digital camera is needed so that the device could more easily fit inside a baseball cap or clip to a pair of glasses.

According to Picard, the Affective Computing group has received human subject approval and will be teaming up with another MIT research group that works with high-functioning teenagers suffering from milder forms of autism such as Asberger's syndrome to further test the device. These teens will wear the ESP when working with therapists, and eventually out in the world, to improve their social interaction, communication and repetitive patterns.

The ESP is exciting in that the technology has multiple possibilities in terms of use.

"People keep asking me if it can detect flirting," El Kaliouby joked. "I could program it to do that. Maybe it could be used for dating."

See more CNET content tagged:
conversation, state, behavior, researcher, camera

8 comments

Join the conversation!
Add your comment
Since its from MIT...
Maybe they could strap one to Negroponte so he can figure out they we are all absolutely stunned at his device?
Posted by KsprayDad (375 comments )
Reply Link Flag
Could be taken further
This application could be taken further-

You don't need a mcahine to tell you what mood someone is in or what their intentions are. People send out "vibes". Ever felt like someone is staring at you in your car while sitting in traffic? You turn around and someone is staring in a car next to you or behind you.

It's a subconscious feeling that we can all get used to feeling for.
Posted by wxman1995 (3 comments )
Reply Link Flag
pay attention
For people like ourselves, we don't need a machine like that, but you completely missed out at who this is going towards - autismic people. Take another read and you'll see what I mean.

Cheers
Posted by drummerclint (1 comment )
Link Flag
Go for it!
<i>"People keep asking me if it can detect flirting," El Kaliouby joked. "I could program it to do that. Maybe it could be used for dating."</i>

This would be so helpful to my very insecure nephew who is so clueless about how gorgeous he is (which is all that more indearing to girls).

A typical scenario:

"She was flirting with you, Ryan," I'll say.

"No she wasn't, Aunt Cheryl."

. . . so it goes, another missed opportunity for him. But this device could change all that for people like him and others who suffer from social inadequacies.
Posted by oOCherylOo (1 comment )
Reply Link Flag
good for autistics
I really hope this works. I am autistic, high functioning,
and anything like this that would help to allert me when I
am rambeling would be nice, as that is one of my biggest
problems. I have actually been yelled at by college
counselors/advisors for rambeling. :/
Posted by Sahyinepu (2 comments )
Reply Link Flag
good for autistics
I really hope this works. I am autistic, high functioning,
and anything like this that would help to allert me when I
am rambling would be nice, as that is one of my biggest
problems. I have actually been yelled at by college
counselors/advisors for rambling. :/
Posted by Sahyinepu (2 comments )
Reply Link Flag
bishopblu
Posted by bishopblu (2 comments )
Reply Link Flag
i wanted to know who to talk to about government about mind reading
Posted by bishopblu (2 comments )
Reply Link Flag
 

Join the conversation

Add your comment

The posting of advertisements, profanity, or personal attacks is prohibited. Click here to review our Terms of Use.

What's Hot

Discussions

Shared

RSS Feeds

Add headlines from CNET News to your homepage or feedreader.