Loading jina-clip-v2 extremely slow
#36
by
kenshinn
- opened
This is the code i use to load jina, but it takes 10 min and more to load the model on H800, is this normal?
@gmastrapas
thanks!
jinav2 = SentenceTransformer(
'path/to/model',
trust_remote_code=True,
truncate_dim=768,
device='cuda'
)
Hey @kenshinn ! No this is not normal. Perhaps a network issue? Are you loading for the first time or loading from cache?