pip install transformers fork: Permission denied (publickey)
Would be good to know that this all seems for Linux only and immediately throws an error on Windows. (Needs some escaped chars?)
Invalid requirement: "'transformers": Expected package name at the start of dependency specifier 'transformers
Ubuntu 24.04: I checked that the transformers repo is public. Cmd looks exotic. What goes wrong?
Running...
G.
(xlstm) gy@gnu24:~/dl/LinuxSetup$ pip install 'transformers @ git+ssh://[email protected]/NX-AI/transformers.git@integrate_xlstm'
Collecting transformers@ git+ssh://@github.com/NX-AI/transformers.git@integrate_xlstm
Cloning ssh://@github.com/NX-AI/transformers.git (to revision integrate_xlstm) to /tmp/pip-install-2i23szpi/transformers_fa5295df2e654943b16dd5bcf288cbd1
Running command git clone --filter=blob:none --quiet 'ssh://****@github.com/NX-AI/transformers.git' /tmp/pip-install-2i23szpi/transformers_fa5295df2e654943b16dd5bcf288cbd1
The authenticity of host 'github.com (140.82.121.4)' can't be established.
...key fingerprint is SHA256:+...
This key is not known by any other names.
Are you sure you want to continue connecting (yes/no/[fingerprint])? yes
Warning: Permanently added 'github.com' (...) to the list of known hosts.
[email protected]: Permission denied (publickey).
fatal: Could not read from remote repository.
Please make sure you have the correct access rights
and the repository exists.
error: subprocess-exited-with-error
× git clone --filter=blob:none --quiet 'ssh://****@github.com/NX-AI/transformers.git' /tmp/pip-install-2i23szpi/transformers_fa5295df2e654943b16dd5bcf288cbd1 did not run successfully.
│ exit code: 128
╰─> See above for output.
note: This error originates from a subprocess, and is likely not a problem with pip.
error: subprocess-exited-with-error
× git clone --filter=blob:none --quiet 'ssh://****@github.com/NX-AI/transformers.git' /tmp/pip-install-2i23szpi/transformers_fa5295df2e654943b16dd5bcf288cbd1 did not run successfully.
│ exit code: 128
╰─> See above for output.
note: This error originates from a subprocess, and is likely not a problem with pip.
The cause is likely that you do not have a github account or any ssh key in your shell linked to github - so the repo cannot be cloned via ssh.
Please use:
pip install 'transformers @ git+https://github.com/NX-AI/transformers.git@integrate_xlstm'
I will update this also in the main description.
Thanks for the light-speed (Thursday 0213) late-evening response and the immediate HF docs update!
I spent the (Fri 0214) morning to test variants, but the only positive outcome by noon waspip install 'transformers @ git+https://github.com/NX-AI/transformers.git@integrate_xlstm' #DOES work for me, but only on Ubuntu
As I now had the weekend to test further, this is a rewrite and summary of other findings.
Naturally I began with inference and I expected this to work on Windows, but for this the pip needs another twist:pip install git+https://github.com/NX-AI/transformers.git@integrate_xlstm#egg=transformers #DOES work on Windows 11 AND Ubuntu
Please update the docs once more to make it future-proof!
Also: The native PyTorch example is a very incomplete fragment. It lacks the AutoConfig import, etc.
Interestingly: On Windows Torch-only throws a Triton error. Please ask if interested. I got an xlstm-fork for test-results. (py subdir)
So far no luck to split / auto-span (the model layers) between my 2 x 20GB RTX 4000 Ada.
Any chance to see a model quantization?
Success: I got inference working in Ubuntu w/o Triton on CPU! (see AI-bits/xlstm GitHub page )
G.