Spaces:
Running
Running
| title: README | |
| emoji: 🚀 | |
| colorFrom: gray | |
| colorTo: green | |
| sdk: static | |
| pinned: false | |
| # Guides | |
| ### emotion2vec: universal speech emotion representation model | |
| emotion2vec is the first universal speech emotion representation model. Through self-supervised pre-training, emotion2vec has the ability to extract emotion representation across different tasks, languages, and scenarios. | |
| ### emotion2vec+: speech emotion recognition foundation model | |
| emotion2vec+ is a series of foundational models for speech emotion recognition (SER). We aim to train a "whisper" in the field of speech emotion recognition, overcoming the effects of language and recording environments through data-driven methods to achieve universal, robust emotion recognition capabilities. The performance of emotion2vec+ significantly exceeds other highly downloaded open-source models on Hugging Face. | |
| # News | |
| - [Jun. 2024] 🔧 We fix a bug in emotion2vec+. Please re-pull the latest code. | |
| - [May. 2024] 🔥 Speech emotion recognition foundation model: **emotion2vec+**, with 9-class emotions has been released on [Model Scope](https://modelscope.cn/models/iic/emotion2vec_plus_large/summary) and [Hugging Face](https://huggingface.co./emotion2vec). Check out a series of emotion2vec+ (seed, base, large) models for SER with high performance **(We recommend this release instead of the Jan. 2024 release)**. | |
| - [Jan. 2024] 9-class emotion recognition model with iterative fine-tuning from emotion2vec has been released in [modelscope](https://www.modelscope.cn/models/iic/emotion2vec_base_finetuned/summary) and [FunASR](https://github.com/alibaba-damo-academy/FunASR/tree/main/examples/industrial_data_pretraining/emotion2vec). | |
| - [Jan. 2024] **emotion2vec** has been integrated into [modelscope](https://www.modelscope.cn/models/iic/emotion2vec_base/summary) and [FunASR](https://github.com/alibaba-damo-academy/FunASR/tree/main/examples/industrial_data_pretraining/emotion2vec). | |
| - [Dec. 2023] We release the [paper](https://arxiv.org/abs/2312.15185), and create a [WeChat group](./src/Wechat.jpg) for emotion2vec. | |
| - [Nov. 2023] We release code, checkpoints, and extracted features for emotion2vec. | |
| # Model Card | |
| |Model|⭐Model Scope|🤗Hugging Face|Fine-tuning Data (Hours)| | |
| |:---:|:-------------:|:-----------:|:-------------:| | |
| |emotion2vec|[Link](https://www.modelscope.cn/models/iic/emotion2vec_base/summary)|[Link](https://huggingface.co./emotion2vec/emotion2vec_base)|/| | |
| emotion2vec+ seed|[Link](https://modelscope.cn/models/iic/emotion2vec_plus_seed/summary)|[Link](https://huggingface.co./emotion2vec/emotion2vec_plus_seed)|201| | |
| emotion2vec+ base|[Link](https://modelscope.cn/models/iic/emotion2vec_plus_base/summary)|[Link](https://huggingface.co./emotion2vec/emotion2vec_plus_base)|4788| | |
| emotion2vec+ large|[Link](https://modelscope.cn/models/iic/emotion2vec_plus_large/summary)|[Link](https://huggingface.co./emotion2vec/emotion2vec_plus_large)|42526| | |
| Original repository: [https://github.com/ddlBoJack/emotion2vec](https://github.com/ddlBoJack/emotion2vec) | |
| Model Scope repository: [https://www.modelscope.cn/models/iic/emotion2vec_plus_large/summary](https://www.modelscope.cn/models/iic/emotion2vec_plus_large/summary) | |
| Hugging Face repository: [https://huggingface.co./emotion2vec](https://huggingface.co./emotion2vec) | |
| FunASR repository: [https://github.com/alibaba-damo-academy/FunASR](https://github.com/alibaba-damo-academy/FunASR/tree/funasr1.0/examples/industrial_data_pretraining/emotion2vec) |