eduardem commited on
Commit
a4f359f
1 Parent(s): 530b7ef

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +27 -0
README.md CHANGED
@@ -1,3 +1,30 @@
1
  ---
2
  license: apache-2.0
 
 
 
 
3
  ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
  license: apache-2.0
3
+ language:
4
+ - en
5
+ - es
6
+ library_name: transformers
7
  ---
8
+
9
+ # GPTQ 4 bits with 128-Group size and Act Order Quantization
10
+
11
+ ## Introduction
12
+
13
+ This model is a variant of the original [`parrot_en_es`](https://huggingface.co/eduardem/parrot_en_es) model, utilizing 128-Act Order Quantization. It serves as an experiment to study the effects of quantization on language models.
14
+
15
+ ## Warning: Catastrophic Loss Through Quantization
16
+
17
+ Please be advised that the quantization process has resulted in catastrophic loss of functionality. The model is no longer capable of acting as a translator. It has issues with context understanding and exhibits hallucinatory behavior.
18
+
19
+ ## Original Model
20
+
21
+ For detailed usage instructions and prompt formatting, please refer to the [original model card](https://huggingface.co/eduardem/parrot_en_es).
22
+
23
+ ## Usage
24
+
25
+ Given the current limitations, this quantized model is not recommended for translation tasks. However, it may still be of interest for research purposes, specifically in studying the effects of quantization on neural networks.
26
+
27
+ ## Contributing
28
+
29
+ If you have insights or suggestions on how to improve the model or mitigate the issues caused by quantization, please feel free to open an issue or submit a pull request.
30
+