README
🏃
Johnson Thomas PRO
Johnyquest7
AI & ML interests
Medical
Recent Activity
updated
a Space
5 days ago
OnDeviceMedNotes/README
updated
a dataset
30 days ago
Johnyquest7/medtran
published
a dataset
30 days ago
Johnyquest7/medtran
Organizations
Johnyquest7's activity
updated
a
Space
5 days ago
updated
a
dataset
30 days ago
published
a
dataset
30 days ago
updated
a
collection
about 1 month ago
liked
2
models
about 2 months ago
updated
a
Space
about 2 months ago
published
a
Space
about 2 months ago
updated
a
dataset
2 months ago
updated
a
collection
2 months ago
liked
a
model
3 months ago
liked
a
dataset
3 months ago
updated
a
collection
3 months ago
updated
a
collection
4 months ago
updated
2
datasets
6 months ago
upvoted
an
article
6 months ago
Article
Fine-tuning LLMs to 1.58bit: extreme quantization made easy
•
225
reacted to
merve's
post with 🔥
6 months ago
Post
5622
I have put together a notebook on Multimodal RAG, where we do not process the documents with hefty pipelines but natively use:
- vidore/colpali for retrieval 📖 it doesn't need indexing with image-text pairs but just images!
- Qwen/Qwen2-VL-2B-Instruct for generation 💬 directly feed images as is to a vision language model with no processing to text!
I used ColPali implementation of the new 🐭 Byaldi library by @bclavie 🤗
https://github.com/answerdotai/byaldi
Link to notebook: https://github.com/merveenoyan/smol-vision/blob/main/ColPali_%2B_Qwen2_VL.ipynb
- vidore/colpali for retrieval 📖 it doesn't need indexing with image-text pairs but just images!
- Qwen/Qwen2-VL-2B-Instruct for generation 💬 directly feed images as is to a vision language model with no processing to text!
I used ColPali implementation of the new 🐭 Byaldi library by @bclavie 🤗
https://github.com/answerdotai/byaldi
Link to notebook: https://github.com/merveenoyan/smol-vision/blob/main/ColPali_%2B_Qwen2_VL.ipynb
updated
a
collection
7 months ago