如何实现多线程部署呢？TEI不支持这个模型吗？

#21

by qinrong - opened Jul 4

Jul 4

如何实现多线程部署呢？

Shitao

Beijing Academy of Artificial Intelligence org Jul 4

TEI支持的。如果存在问题，建议在TEI官方repo提问，我们不太清楚TEI的实现细节。

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment