Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
vuiseng9
/
ov-opt-350m-8bit-85pc-sparse-kv-cache
like
0
Text Generation
Transformers
PyTorch
OpenVINO
wikitext
opt
Generated from Trainer
Eval Results
text-generation-inference
Inference Endpoints
License:
other
Model card
Files
Files and versions
Community
1
Train
Deploy
Use this model
main
ov-opt-350m-8bit-85pc-sparse-kv-cache
2 contributors
History:
3 commits
vuiseng9
Add tld config and guide
7d6d1c1
over 1 year ago
.gitattributes
Safe
1.52 kB
initial commit
over 1 year ago
README.md
Safe
1.54 kB
Add content
over 1 year ago
all_results.json
Safe
430 Bytes
Add content
over 1 year ago
compressed_graph.dot
Safe
788 kB
Add content
over 1 year ago
config.json
Safe
749 Bytes
Add content
over 1 year ago
eval_results.json
Safe
260 Bytes
Add content
over 1 year ago
generation_config.json
Safe
132 Bytes
Add content
over 1 year ago
merges.txt
Safe
456 kB
Add content
over 1 year ago
nncf_output.log
Safe
190 kB
Add content
over 1 year ago
openvino_config.json
Safe
1.37 kB
Add content
over 1 year ago
openvino_model.bin
Safe
443 MB
LFS
Add content
over 1 year ago
openvino_model.xml
Safe
3.24 MB
Add content
over 1 year ago
original_graph.dot
Safe
466 kB
Add content
over 1 year ago
ov_rt_tld.json
Safe
79 Bytes
Add tld config and guide
over 1 year ago
pytorch_model.bin
Safe
pickle
Detected Pickle imports (4)
"torch.FloatStorage"
,
"torch.IntStorage"
,
"collections.OrderedDict"
,
"torch._utils._rebuild_tensor_v2"
What is a pickle import?
2.54 GB
LFS
Add content
over 1 year ago
special_tokens_map.json
Safe
548 Bytes
Add content
over 1 year ago
tld-notes.txt
Safe
1.97 kB
Add tld config and guide
over 1 year ago
tokenizer.json
Safe
2.11 MB
Add content
over 1 year ago
tokenizer_config.json
Safe
870 Bytes
Add content
over 1 year ago
train_results.json
Safe
190 Bytes
Add content
over 1 year ago
trainer_state.json
Safe
596 Bytes
Add content
over 1 year ago
training_args.bin
pickle
Detected Pickle imports (8)
"transformers.trainer_utils.HubStrategy"
,
"transformers.trainer_utils.IntervalStrategy"
,
"accelerate.state.PartialState"
,
"transformers.training_args.OptimizerNames"
,
"transformers.training_args.TrainingArguments"
,
"transformers.trainer_utils.SchedulerType"
,
"accelerate.utils.dataclasses.DistributedType"
,
"torch.device"
How to fix it?
3.96 kB
LFS
Add content
over 1 year ago
vocab.json
Safe
798 kB
Add content
over 1 year ago