OpenSourceRonin commited on
Commit
01b3454
1 Parent(s): d8f739a

Create README.md

Browse files
Files changed (1) hide show
  1. README.md +31 -0
README.md ADDED
@@ -0,0 +1,31 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: llama3.1
3
+ ---
4
+
5
+ **Disclaimer**:
6
+
7
+ The model is reproduced based on the paper *VPTQ: Extreme Low-bit Vector Post-Training Quantization for Large Language Models* [github](https://github.com/microsoft/vptq) and [arXiv](https://arxiv.org/abs/2409.17066)
8
+
9
+ The model itself is sourced from a community release.
10
+
11
+ It is intended only for experimental purposes.
12
+
13
+ Users are responsible for any consequences arising from the use of this model.
14
+
15
+ **Note**:
16
+
17
+ The PPL test results are for reference only and were collected using GPTQ testing script.
18
+
19
+ ```json
20
+ {
21
+ "ctx_2048": {
22
+ "wikitext2": 10.297412872314453
23
+ },
24
+ "ctx_4096": {
25
+ "wikitext2": 9.73226261138916
26
+ },
27
+ "ctx_8192": {
28
+ "wikitext2": 8.762977600097656
29
+ }
30
+ }
31
+ ```