testing for inference endpoints
reqs, handler
Multi commit ID: d2a75116d487e1ef4649f901b2932c6c03c1422ef2ed2cd24f141d0e3bea905f
Scheduled commits:
- Upload 2 file(s) totalling 2.4K (f95af0f48139531e860db5b9a87e09e66e06c43c6909a2266bc6752b6807b211)
This is a PR opened using the huggingface_hub library in the context of a multi-commit. PR can be commented as a usual PR. However, please be aware that manually updating the PR description, changing the PR status, or pushing new commits, is not recommended as it might corrupt the commit process. Learn more about multi-commits in this guide.
Multi-commit is now completed! You can ping the repo owner to review the changes. This PR can now be commented or modified without risking to corrupt it.
This is a comment posted using the huggingface_hub library in the context of a multi-commit. Learn more about multi-commits in this guide.
this is to see if it will work with inference endpoints. You don't need to merge or close
is it working? I am trying to deploy qwen2-vl via custom handler through dedicated endpoint, but I am a little confused how the endpoint query/request would look like with 2 input parameters - image path and text. It doesn't look like the UI TEST interface supports blob storage and multimodal inputs.