Emotional Context Analysis
Enhancing communication through AR spectacles.
Members: Arnav Kharbanda*, Arpit Kumar*, Dr. Abhinav Dhall, Dr. Sudeepta Mishra
We developed a project titled Emotional Context Analysis in collaboration with Professors Dr. Abhinav Dhall and Dr. Sudeepta Mishra. The project uses AR spectacles to suggest conversational responses based on the desired interaction style, such as funny or romantic.
How It Works:
-
The system processes audio and video inputs from the conversation, analyzing body language, the transcript, and the tone of voice to understand the emotional context.
-
It then uses this multimodal data to provide suggestions for guiding the conversation, ensuring it matches the preferred interaction style.
-
The system was trained using the IEMOCAP dataset, which is widely used for emotion recognition tasks, to improve its ability to detect emotions and suggest contextually appropriate responses.
Conclusion:
This project combines augmented reality with emotion recognition, offering a novel way to enhance communication by personalizing interactions based on emotional context. It adapts the conversation style, making interactions more engaging and contextually relevant.
