tinyllava/TinyLLaVA-Phi-2-SigLIP-3.1B
Image-Text-to-Text
•
Updated
•
3.54k
•
14
Nicholas Kluge Corrêa PRO
nicholasKluge
AI & ML interests
AI Ethics and AI Safety
Recent Activity
updated
a model
6 days ago
nicholasKluge/Aira-OPT-125M
new activity
14 days ago
AiresPucrs/bert-base-wikitext:Adding `safetensors` variant of this model
reacted
to
samuellimabraz's
post
with 👍
15 days ago
I wrote a article on Parameter-Efficient Fine-Tuning (PEFT), exploring techniques for efficient fine-tuning in LLMs, their implementations, and variations.
The study is based on the article "Scaling Down to Scale Up: A Guide to Parameter-Efficient Fine-Tuning" and the PEFT library integrated with Hugging Face's Transformers.
Article: https://huggingface.co./blog/samuellimabraz/peft-methods
Notebook: https://colab.research.google.com/drive/1B9RsKLMa8SwTxLsxRT8g9OedK10zfBEP?usp=sharing
Collection: https://huggingface.co./collections/samuellimabraz/service-summary-6793ccfe774073328ea9f8df
Analyzed methods:
- Adapters: Soft Prompts (Prompt Tuning, Prefix Tuning, P-tuning), IA³.
- Reparameterization: LoRA, QLoRA, LoHa, LoKr, X-LoRA, Intrinsic SAID, and variations of initializations (PiSSA, OLoRA, rsLoRA, DoRA).
- Selective Tuning: BitFit, DiffPruning, FAR, FishMask.
I'm starting out in generative AI, I have more experience with computer vision and robotics. Just sharing here 🤗
Organizations
nicholasKluge's activity
liked
a
model
about 1 month ago
liked
2
models
2 months ago
liked
2
models
3 months ago
liked
a
dataset
5 months ago
liked
a
Space
5 months ago
liked
a
dataset
5 months ago
liked
a
model
7 months ago
liked
a
Space
9 months ago
liked
a
model
11 months ago
liked
2
models
12 months ago
liked
a
Space
12 months ago
liked
a
dataset
12 months ago
liked
4
models
12 months ago
liked
a
model
about 1 year ago
