README.md

metadata

base_model: yanolja/EEVE-Korean-Instruct-10.8B-v1.0
license: apache-2.0
language:
  - ko
  - en

Jolteon-Instruct-13B-alpha

The model was trained based on the EEVE-Korean-Instruct-10.8B-v1.0 model from yanolja, extended to 13.4b (12 layer pass-through) utilizing mergekit.

Methodology

TBD

Training Details

	Training Data	Parameters	Content Length	Samples Seen	Learning Rate
Jolteon-Instruct-13B-alpha	A curated mix of English + Korean Instruction set	13.4B	4k	>400k	1e-5

Example

License

본 모델은 apache-2.0 라이센스를 따릅니다. 모델을 사용하여 생성된 데이터셋을 배포할 경우 모델 사용을 명시해 주시기를 권고드립니다.

Thanks to

• A100 클러스터를 제공해주신, Sionic AI

Contact

• Discord Server Link