Thea
Collection
A family of compact reasoning models, based off of the best 2B and 3B models, trained using improved DDP training code, no Unsloth.
•
5 items
•
Updated
•
1
Model Description
An uncensored reasoning EXAONE 3.5 model trained on reasoning data. Now with a full epoch!
It has been trained using improved training code, and gives an improved performance. Here is what inference code you should use:
# DEBUGGING IN PROGRESS, check later
- Trained by: Piotr Zalewski
- License: exaone
- Finetuned from model: LGAI-EXAONE/EXAONE-3.5-2.4B-Instruct
- Dataset used: KingNish/reasoning-base-20k
This Llama model was trained faster than Unsloth using custom training code.
Visit https://www.kaggle.com/code/piotr25691/distributed-hf-training-with-2xt4 to find out how you can finetune your models using BOTH of the Kaggle provided GPUs.
- Downloads last month
- 59
Inference API (serverless) does not yet support model repos that contain custom code.
Model tree for lunahr/thea-pro-2b-100r
Base model
LGAI-EXAONE/EXAONE-3.5-2.4B-Instruct