- Today Siliconera (linked above) has uncovered an SCEA patent application which reveals that Sony is experimenting with laugh detection and emotional tracking software.
According to the documentation, the application picks up metadata, including laughter recorded by the microphone and a user's expression from the camera.
Apparently the software isn't limited to video games, and can be used for TV shows and films along with other media presentations.
To quote: Both devices are linked to a "game console", shown as a PlayStation 3 in the diagram, which identifies the user, notes emotions, and transfers the data over a network.
How will Sony identify emotions? The patent mentions identifying body gestures and tracking group interactions "such as when two individuals give each other a 'High Five.'"
Sony also developed smile detecting software for their Cyber Shot W120 camera which could be used too.
While the patent focuses on laugher it can identify other emotions such as sadness, excitement, anger, joy, interest, and boredom. For example, boredom may be detected if a user is "looking away from the presentation, yawning, or talking over the presentation."