KeyError: 'mistral'
KeyError Traceback (most recent call last)
in <cell line: 19>()
17 #device_map={"": 0}
18
---> 19 model = AutoModelForCausalLM.from_pretrained(
20 model_name,
21 quantization_config=bnb_config,
2 frames
/usr/local/lib/python3.10/dist-packages/transformers/models/auto/configuration_auto.py in getitem(self, key)
732 return self._extra_content[key]
733 if key not in self._mapping:
--> 734 raise KeyError(key)
735 value = self._mapping[key]
736 module_name = model_type_to_module_name(key)
how do I fix this error?
Closing as this is indeed the solution. Mistral is now part of Transformers 4.34.0 so pip install "transformers>=4.34.0" is enough.
still its not working for CPU(im using google colab CPU)
i tried all the above mentioned methods,still its giving
KeyError Traceback (most recent call last)
in <cell line: 3>()
1 tokenizer = AutoTokenizer.from_pretrained(model_name)
2
----> 3 model = AutoModelForCausalLM.from_pretrained(model_name,
4 device_map="auto",
5 #device_map = device_map,
2 frames
/usr/local/lib/python3.10/dist-packages/transformers/models/auto/configuration_auto.py in getitem(self, key)
669 ("reformer", "Reformer"),
670 ("regnet", "RegNet"),
--> 671 ("rembert", "RemBERT"),
672 ("resnet", "ResNet"),
673 ("retribert", "RetriBERT"),
KeyError: 'mistral'
this error
File /opt/conda/envs/py39/lib/python3.9/ctypes/__init__.py:382, in CDLL.__init__(self, name, mode, handle, use_errno, use_last_error, winmode)
379 self._FuncPtr = _FuncPtr
381 if handle is None:
--> 382 self._handle = _dlopen(self._name, mode)
383 else:
384 self._handle = handle
OSError: libiomp5.so: cannot open shared object file: No such file or directory
I am getting this error after solving transformers error