|
--- |
|
license: apache-2.0 |
|
datasets: |
|
- projectlosangeles/Los-Angeles-MIDI-Dataset |
|
- projectlosangeles/Monster-MIDI-Dataset |
|
library_name: transformers |
|
tags: |
|
- music |
|
- midi |
|
- music generation |
|
- midi generation |
|
--- |
|
# Model Card for midi-model-tv2o-medium |
|
|
|
Midi event transformer for music generation. |
|
|
|
### Model Updates |
|
|
|
- new tv2o-medium model: "tvo" means MidiTokenizerV2 optimised. |
|
|
|
## Model Details |
|
|
|
### Model Description |
|
|
|
- **Developed by:** SkyTNT |
|
- **Trained by:** SkyTNT |
|
- **Model type:** Transformer |
|
- **License:** apache-2.0 |
|
|
|
### Model Sources |
|
|
|
- **Repository:** https://github.com/SkyTNT/midi-model |
|
- **Demo:** https://huggingface.co./spaces/skytnt/midi-composer |
|
|
|
|
|
## Training Details |
|
|
|
### Training Data |
|
|
|
- [projectlosangeles/Los-Angeles-MIDI-Dataset](https://huggingface.co./datasets/projectlosangeles/Los-Angeles-MIDI-Dataset) |
|
- [projectlosangeles/Monster-MIDI-Dataset](https://huggingface.co./datasets/projectlosangeles/Monster-MIDI-Dataset) |
|
- [SymphonyNet MIDI Dataset](https://symphonynet.github.io/) |
|
|
|
#### Training Hyperparameters |
|
|
|
- config: tv2o-medium |
|
- max-len: 2048 then 4096 |
|
- lr: 1e-4 then 2e-4 |
|
- weight-decay: 0.01 |
|
- batch: 2x2x2 |
|
- bfloat16 precision |
|
|
|
#### Loss |
|
- val loss: 0.2159 |
|
|
|
## Files |
|
|
|
- model.ckpt: latest model checkpoint |
|
- onnx/*.onnx: onnx format model |
