Deeokay
/

llama3-8B-Instruct-base-GGUF

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

Edit model card

Uploaded model

Developed by: Deeokay
License: apache-2.0
Finetuned from model : unsloth/llama-3-8b-Instruct-bnb-4bit

This llama model was trained 2x faster with Unsloth and Huggingface's TRL library.

Converstion of Base Model

These are models directly converted from the base model without change

Primary for a starting base of future customizations

Downloads last month: 92

GGUF

Model size

8.03B params

Architecture

llama

2-bit

3-bit

4-bit

5-bit

8-bit

16-bit

Inference API

Unable to determine this model’s pipeline type. Check the docs .

Model tree for Deeokay/llama3-8B-Instruct-base-GGUF

Base model

unsloth/llama-3-8b-Instruct-bnb-4bit

Quantized

(378)

this model