Communications of the ACM
U Mad Bro? Researchers Measure Emotion with Your Mouse Clicks
Deviations in cursor movement can indicate a user's emotional state, says BYU Professor Jeffrey Jenkins.
Credit: Jaren S. Wilkey / BYU
Most people can tell if you're angry based on the way you're acting. Professor Jeffrey Jenkins can tell if you're angry by the way you move a computer mouse.
The Brigham Young University information systems expert says people experiencing anger (and other negative emotions — frustration, confusion, sadness) become less precise in their mouse movements and move the cursor at different speeds.
Thanks to advances in modern technology, Jenkins can now gather and process enough data points from your cursor movement to measure those deviations and indicate your emotional state.
"Using this technology, websites will no longer be dumb," Jenkins says. "Websites can go beyond just presenting information, but they can sense you. They can understand not just what you're providing, but what you're feeling."
According to his research, when users are upset or confused, the mouse no longer follows a straight or gently curving path. Instead, movements become jagged and sudden. Additionally, someone exhibiting negative emotions moves a mouse slower.
"It's counterintuitive; people might think, 'When I'm frustrated, I start moving the mouse faster," Jenkins says. "Well, no, you actually start moving slower."
Jenkins believes the greatest application of his research (and resulting technology that measures mouse movements) is that web developers will be able to adapt or fix sore points in websites that bring out negative emotions.
In other words, now the folks running the online ticket website that drives you bonkers will know exactly when you throw up your hands and scream.
"Traditionally it has been very difficult to pinpoint when a user becomes frustrated, leading them to not come back to a site," Jenkins says. "Being able to sense a negative emotional response, we can adjust the website experience to eliminate stress or to offer help."
Jenkins' technology has been patented and spun off to a local startup company, Neuro-ID Inc., that holds the license. The startup will use the technology to track suspicious behavior.
Now Jenkins is in the process of refining the technology, with details of his latest research described in "Inferring Negative Emotion from Mouse Cursor Movements," in the information systems journal MIS Quarterly. The article is co-authored by Martin Hibbeln, Jeffrey L. Jenkins, Christoph Schneider, Joseph S. Valacich, and Markus Weinmann.
Jenkins says the concept can also be applied to mobile devices, where swipes and taps replace mouse movement. Although he is still in the early stages of looking at mobile devices, he is encouraged by the massive amounts of data phones and tablets are providing.
No entries found