license: llama3 | |
datasets: | |
- Custom_datasets | |
language: | |
- ko | |
pipeline_tag: text-generation | |
base_model: "meta-llama/Meta-Llama-3-8B" | |
This model is a version of Meta-Llama-3-8B that has been fine-tuned with Our In House CustomData. | |
Train Spec : | |
We utilized an A100x4 * 1 for training our model | |
with DeepSpeed / HuggingFace TRL Trainer / HuggingFace Accelerate |