|
--- |
|
base_model: yanolja/EEVE-Korean-Instruct-10.8B-v1.0 |
|
license: apache-2.0 |
|
language: |
|
- ko |
|
- en |
|
--- |
|
|
|
# **Jolteon-Instruct-13B-alpha** |
|
|
|
The model was trained based on the [EEVE-Korean-Instruct-10.8B-v1.0](https://huggingface.co./yanolja/EEVE-Korean-Instruct-10.8B-v1.0) model from [yanolja](https://www.yanolja.com), extended to 13.4b (12 layer pass-through) utilizing [mergekit](https://github.com/cg123/mergekit). |
|
|
|
## Methodology |
|
|
|
TBD |
|
|
|
## Training Details |
|
| |Training Data|Parameters|Content Length|Samples Seen|Learning Rate| |
|
|---|---|---|---|---|---| |
|
|Jolteon-Instruct-13B-alpha|*A curated mix of English + Korean Instruction set*|13.4B|4k|>400k|1e<sup>-5</sup>| |
|
|
|
## Example |
|
|
|
## License |
|
|
|
본 모델은 apache-2.0 라이센스를 따릅니다. 모델을 사용하여 생성된 데이터셋을 배포할 경우 모델 사용을 명시해 주시기를 권고드립니다. |
|
|
|
## Thanks to |
|
|
|
- A100 클러스터를 제공해주신, [Sionic AI](https://sionic.ai/) |
|
|
|
## Contact |
|
- [Discord Server Link](https://discord.gg/MrBt3PXdXc) |
