Affective Haptics: communicating emotion through touch

 

At Bell Lab’s internship program (summer 2019) , my team was given the following challenge:

Can we go beyond the limitations of spoken and written word in emotional communication?

We addressed this question by combining three key concepts:  

  • Music is the language of sharing emotion 

  • the principles of neuroplasticity can enable us to investigate extrasensory emotional communication

  • Haptics may be the sensory input which enables a new layer to emotion-sharing

 

reserch

neuroplasticity

Music Theory

Haptic technology

 

mapping

Haptics to emotions and emotions to music:

Through the mapping  process of integrating music and haptics, we created a set of haptic messages, each with a specific emotional signature.


 

haptic cuff

We used the haptic cuff developed by our colleagues at Nokia Bell Labs, Cambridge. 

This specific cuff consists of a 2x2 matrix of individually addressable piezo actuators that we programmed to play the haptic messages.


 

user testing

We tested haptic messages to measure the accuracy of emotions evoked/felt by the users.

 

The result indicated that users were able to identify the emotion presented by the haptic message. However, unlike music, the haptic feedback failed to evoke those emotions.

We concluded that in order to successfully communicate emotions via tactile feedback, we need to design technologies that integrate pressure and temperature output to replicate the power of communication via touch.