README.md

metadata

license: cc-by-nc-sa-4.0
datasets:
  - voice-is-cool/voxtube
base_model:
  - openai/whisper-tiny
library_name: transformers
tags:
  - speaker-verification
  - voice
  - audio
  - speaker-recognition
  - speaker-embedding
  - speaker-identification
  - speaker
  - whisper
  - voxtube

Whisper Speaker Identification (WSI)

Whisper Speaker Identification (WSI) is a state-of-the-art speaker identification model designed for multilingual scenarios.The WSI model adapts OpenAI's Whisper encoder and fine-tunes it with a projection head using triplet loss-based metric learning. This approach enhances its ability to generate discriminative, language-agnostic speaker embeddings.WSI demonstrates state-of-the-art performance on multilingual datasets, achieving lower Equal Error Rates (EER) and higher F1 Scores compared to models such as pyannote/wespeaker-voxceleb-resnet34-LM and speechbrain/spkrec-ecapa-voxceleb.

Cite This Work

Comming Soon!

License

This project is licensed under the CC BY-NC-SA 4.0 License.