File size: 1,272 Bytes
9449419 a56c9f4 9449419 a9f95ad a56c9f4 a9f95ad 30d9b76 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 |
---
license: gpl-3.0
tags:
- emotion
- emotion-recognition
- sentiment-analysis
- roberta
language:
- en
pipeline_tag: text-classification
---
## FacialMMT
This repo contains the data and pretrained models for FacialMMT, a framework that uses facial sequences of real speaker to help multimodal emotion recognition.
The model performance on MELD test set is:
| Release | W-F1(%) |
|:-------------:|:--------------:|
| 23-07-10 | 66.73 |
It is currently ranked third on [paperswithcode](https://paperswithcode.com/sota/emotion-recognition-in-conversation-on-meld?p=a-facial-expression-aware-multimodal-multi).
If you're interested, please check out this [repo](https://github.com/NUSTM/FacialMMT) for more in-detail explanation of how to use our model.
### Citation
Please consider citing the following if this repo is helpful to your research.
```
@inproceedings{zheng2023facial,
title={A Facial Expression-Aware Multimodal Multi-task Learning Framework for Emotion Recognition in Multi-party Conversations},
author={Zheng, Wenjie and Yu, Jianfei and Xia, Rui and Wang, Shijin},
booktitle={Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)},
pages={15445--15459},
year={2023}
}
``` |