iwaitu
/

llama3-70b-chinese-function-calling-4bit

Text Generation

text-generation-inference

Inference Endpoints

4-bit precision

Model card Files Files and versions Community

Edit model card

iwaitu/llama3-70b-chinese-function-calling-4bit

基于 shenzhi-wang/Llama3-70B-Chinese-Chat 进行微调. 使用 bitsandbytes 进行量化到4bit

Downloads last month: 5

Safetensors

Model size

37.4B params

Tensor type

F32

·

BF16

·

U8

·

Inference Examples

Text Generation

Inference API (serverless) is not available, repository is disabled.