|
--- |
|
library_name: diffusers |
|
tags: |
|
- stable diffusion |
|
- lora |
|
- loradapter |
|
- adapter |
|
- conditioning |
|
--- |
|
# Conditional LoRAdapter for Efficient 0-Shot Control & Altering of T2I Models |
|
|
|
[](https://compvis.github.io/LoRAdapter/)[](https://arxiv.org/abs/2405.07913) |
|
|
|
This repository contains the weights for the paper "CTRLorALTer: Conditional LoRAdapter for Efficient 0-Shot Control & Altering of T2I Models". |
|
|
|
[Nick Stracke](https://twitter.com/nickstracke_), [Stefan Andreas Baumann](https://stefan-baumann.eu/), [Joshua Susskind](https://twitter.com/jsusskin), [Miguel Angel Bautista](https://twitter.com/itsbautistam), [Björn Ommer](https://ommer-lab.com/people/ommer/) |
|
|
|
We present LoRAdapter, an approach that unifies both style and structure conditioning under the same formulation using a novel conditional LoRA block that enables zero-shot control. |
|
LoRAdapter is an efficient, powerful, and architecture-agnostic approach to condition text-to-image diffusion models, which enables fine-grained control conditioning during generation and outperforms recent state-of-the-art approaches. |
|
|
|
## 🎓 Citation |
|
|
|
If you use this codebase or otherwise found our work valuable, please cite our paper: |
|
|
|
```bibtex |
|
@misc{stracke2024loradapter, |
|
title={CTRLorALTer: Conditional LoRAdapter for Efficient 0-Shot Control & Altering of T2I Models}, |
|
author={Nick Stracke and Stefan Andreas Baumann and Joshua Susskind and Miguel Angel Bautista and Björn Ommer}, |
|
year={2024}, |
|
eprint={2405.07913}, |
|
archivePrefix={arXiv}, |
|
primaryClass={cs.CV} |
|
} |
|
``` |
