PrunaAI
/

winglian-llama-3-8b-256k-PoSE-AWQ-4bit-smashed

Text Generation

text-generation-inference

Inference Endpoints

4-bit precision

Model card Files Files and versions Community

winglian-llama-3-8b-256k-PoSE-AWQ-4bit-smashed / tokenizer.json

Commit History

Upload folder using huggingface_hub (#1)

343a098
verified

sharpenb commited on Jun 30, 2024