File size: 2,118 Bytes
0b5aae0 6e8c762 4e0974c 31f8b54 5695767 0b5aae0 4e0974c 6e8c762 97b3799 0e13a98 5695767 6e8c762 0e13a98 6a5d030 544b41e 6a5d030 31f8b54 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 |
---
license: cc-by-sa-4.0
inference: false
pipeline_tag: text-generation
tags:
- gptq
- auto-gptq
- quantization
- sft
- openassistant
language:
- en
---
# Open-Assistant StableLM-7B SFT-7 Model: GPTQ 4-bit
<a href="https://colab.research.google.com/gist/pszemraj/225805c85d0097e570a2fae0eb5f8913/inference-with-stablelm-7b-sft-v7e3-autogptq-4bit-128g.ipynb">
<img src="https://colab.research.google.com/assets/colab-badge.svg" alt="Open In Colab"/>
</a>
A GPTQ version of the [Open-Assistant StableLM-7B SFT-7 Model](https://huggingface.co./OpenAssistant/stablelm-7b-sft-v7-epoch-3) quantized via [AutoGPTQ](https://github.com/PanQiWei/AutoGPTQ)
Will update this more later - take a look at the colab for now to see an inference example, or a [stripped-down version of the notebook here](https://gist.github.com/pszemraj/fc5b03b6bb7386991163eaaa9e0dc14d)
> Note: this model uses special tokens, structured as: `<|prompter|>What's the Earth total population<|endoftext|><|assistant|>`
## Query Example
> I want you to act as an expert linguist. I'm trying to uncover the true meaning of the corporate buzzword 'value'. For example: "I've been furiously delivering value today". What could it really mean?
The corporate buzzword "value" can have a few different meanings, but one possible explanation is that it refers to the perceived worth or significance that is attached to something or someone. In this sense, it could be used to describe the perceived benefits that are associated with a particular product, service, or experience.
For example, if someone were to say "I've been furiously delivering value today," they might be emphasizing the importance of the product or service they are using to make that statement. This could be a way of signaling to the person or company that the value they are delivering is high quality and relevant.
It's worth noting that the meaning of "value" can be subjective and context-dependent, and it can be difficult to pin down. However, in many cases, it can be used to communicate the value or significance that is being attached to something.<|endoftext|> |