MELD: A Multimodal Multi-Party Dataset for Emotion Recognition in Conversation

This repository contains various models targetting multimodal representation learning, multimodal fusion for downstream tasks such as multimodal sentiment analysis.

MMSA is a unified framework for Multimodal Sentiment Analysis.

An official implementation for " UniVL: A Unified Video and Language Pre-Training Model for Multimodal Understanding and Generation"

多模态情感分析——基于BERT+ResNet的多种融合方法

This repository contains the official implementation code of the paper Improving Multimodal Fusion with Hierarchical Mutual Information Maximization for Multimodal Sentiment Analysis, accepted at EMNLP 2021.

A Tool for extracting multimodal features from videos.

Context-Dependent Sentiment Analysis in User-Generated Videos

The code for our IEEE ACCESS (2020) paper Multimodal Emotion Recognition with Transformer-Based Self Supervised Feature Fusion.

CM-BERT: Cross-Modal BERT for Text-Audio Sentiment Analysis（MM2020）

Code for the paper "VistaNet: Visual Aspect Attention Network for Multimodal Sentiment Analysis", AAAI'19

Learning Language-guided Adaptive Hyper-modality Representation for Multimodal Sentiment Analysis

Offical implementation of paper "MSAF: Multimodal Split Attention Fusion"

😎 Awesome lists about Speech Emotion Recognition

This repository contains the implementation of the paper -- Bi-Bimodal Modality Fusion for Correlation-Controlled Multimodal Sentiment Analysis

A Facial Expression-Aware Multimodal Multi-task Learning Framework for Emotion Recognition in Multi-party Conversations (ACL 2023)

A survey of deep multimodal emotion recognition.

Multimodal sentiment analysis using hierarchical fusion with context modeling

Towards Robust Multimodal Sentiment Analysis with Incomplete Data

Code and Data for the ACL22 main conference paper "MSCTD: A Multimodal Sentiment Chat Translation Dataset"