File size: 1,101 Bytes
0997196
 
 
 
c85588c
 
 
21356c6
 
0997196
 
21356c6
c85588c
21356c6
c85588c
21356c6
 
 
0997196
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
---
license: apache-2.0
---


<video controls autoplay src="https://cdn-uploads.huggingface.co/production/uploads/6310d1226f21f539e52b9d77/P69nZEiM_Z9OPuXuYMr3m.mp4"></video>

_Prompt: A young man walks alone by the seaside."_

__Text2Bricks__ is a fine-tuned [Open Sora](https://github.com/hpcaitech/Open-Sora) model that generates toy brick-style short stop animations.


`text2bricks-360p-32f` is fine-tuned to generated up to 360p/32-frames outputs. 

It was trained on Lambda's [1-Click Clusters](https://lambdalabs.com/service/gpu-cloud/1-click-clusters) in 169.6 H100 GPU hours. See this [Weights $ Biases report](https://api.wandb.ai/links/lambdalabs/2cbrtx45) for details. 

Extra code and data process steps can be found in this [tutorial](https://github.com/LambdaLabsML/Open-Sora/blob/lambda_bricks/TUTORIAL.md). 


# Usage

Use [Lambda's fork](https://github.com/LambdaLabsML/Open-Sora/tree/lambda_bricks) of Open-Sora.

```
python scripts/inference.py \
configs/opensora-v1-1/inference/text2bricks-360p-32f.py \
--prompt "A young man walks alone by the seaside." \
--num-frames 32
```