If one person is waiting for GPU allocation and another person loads a different model, the model used by the first person will switch to the newly loaded model.
Hi @reifbk , I made some changes so it should work most of the time.
· Sign up or log in to comment