Do you know anything about this error?
hello sorry to bother you have some knowledge about a bug that now happens in oobabooga when updating it with bitsandbytes 0.39.0 now i cant use rtx 3090 gpu i thought it was windows installer so i download it again and do a clean install but the error still persists.
bin A:\LLMs_LOCAL\oobabooga_windows\installer_files\env\lib\site-packages\bitsandbytes\libbitsandbytes_cpu.dll
R:\LLMs_LOCAL\oobabooga_windows\installer_files\env\lib\site-packages\bitsandbytes\cextension.py:34: User Warning: The installed version of bitsandbytes was compiled without GPU support. 8-bit optimizers, 8-bit multiply, and GPU quantization are not available.
warn("The installed version of bitsandbytes was compiled without GPU support. "
function 'cadam32bit_grad_fp32' not found
Hmm sorry I'm not quite sure why you're getting that. The text-generation-webui installation should take care of that
Maybe ask on the text-generation-webui Reddit page or Discord? I'm afraid I've never seen that error before
Thank you very much for your answer, I found the problem is an incompatibility of the xformers library that uses pytorch 2.0.1 and is still not compatible with the ui interfaces... solution, do not install it
Ahh thanks for letting me know!
It's working perfectly fine for me on Win 11, RTX4090 and bitsandbytes 0.39.0. @RedXeol : support for Falcon was just merged into main branch. Feel free to git pull ;)
Red try this tutorial. https://agi-sphere.com/text-generation-webui-windows It is highly specific to Windows and text-generation-webui
I nearly pulled my hair out trying to get past it. I got that error every try until I discovered the Windows pre-built wheels for Bits & Bytes.
Good luck!