TheBloke

/

Qwen-7B-Chat-AWQ

like 6

Hello!
When I run the following code I get the following error:
from transformers import AutoModelForCausalLM, AutoTokenizer, TextStreamer

model_name_or_path = "model"

tokenizer = AutoTokenizer.from_pretrained(model_name_or_path)
model = AutoModelForCausalLM.from_pretrained(
model_name_or_path,
low_cpu_mem_usage=True,
device_map="cuda:0"
)

tokenizer = AutoTokenizer.from_pretrained(model_name_or_path)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
....\Lib\site-packages\transformers\models\auto\tokenization_auto.py", line 733, in from_pretrained
raise ValueError(
ValueError: Tokenizer class QWenTokenizer does not exist or is not currently imported.