Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
SpectraSuite
/
QuantLM_560M_6bit_Unpacked
like
0
Follow
Spectra Suite of Low Bitwdith Models
9
Text Generation
Transformers
Safetensors
llama
text-generation-inference
Inference Endpoints
License:
apache-2.0
Model card
Files
Files and versions
Community
1
Train
Deploy
Use this model
refs/pr/1
QuantLM_560M_6bit_Unpacked
/
generation_config.json
tejasexpress
53bf4e79a7d6dd071c2db3a6aa6c4dd05faec2229ee9e9617ff320bc8d2d5702
44bfd3c
verified
4 months ago
raw
Copy download link
history
blame
Safe
111 Bytes
{
"_from_model_config"
:
true
,
"bos_token_id"
:
0
,
"eos_token_id"
:
0
,
"transformers_version"
:
"4.41.2"
}