clibrain
/

Llama-2-13b-ft-instruct-es-gptq-4bit

Text Generation

text-generation-inference

4-bit precision

Model card Files Files and versions Community

mrm8488 commited on Aug 30, 2023

Commit

207c7c2

·

1 Parent(s): b1883d9

Update README.md

Files changed (1) hide show

README.md +4 -1

README.md CHANGED Viewed

@@ -134,4 +134,7 @@ def generate(
 instruction = "Dame una lista de lugares a visitar en España."
 print(generate(instruction))
-```

 instruction = "Dame una lista de lugares a visitar en España."
 print(generate(instruction))
+```
+## Benchmark
+Running the model on a Nvidia T4 with 16GB VRAM, it takes aprox 0.15 seconds to generate a token