Update README.md
Browse files
README.md
CHANGED
@@ -10,10 +10,22 @@ tags:
|
|
10 |
- multimodal
|
11 |
---
|
12 |
|
13 |
-
<img src="molmo_logo.png" alt="Logo for the Molmo Project"
|
14 |
|
15 |
# Molmo 7B-D
|
16 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
17 |
## Quick Start
|
18 |
|
19 |
To run Molmo, first install dependencies:
|
@@ -69,7 +81,7 @@ generated_text = processor.tokenizer.decode(generated_tokens, skip_special_token
|
|
69 |
print(generated_text)
|
70 |
|
71 |
# >>> This photograph captures an adorable black Labrador puppy sitting on a weathered
|
72 |
-
# wooden deck. The deck's planks, which are a mix of light and dark brown with ...
|
73 |
```
|
74 |
|
75 |
## License and Use
|
|
|
10 |
- multimodal
|
11 |
---
|
12 |
|
13 |
+
<img src="molmo_logo.png" alt="Logo for the Molmo Project" style="width: 100%; height: 50px;">
|
14 |
|
15 |
# Molmo 7B-D
|
16 |
|
17 |
+
Molmo is an open vision-language model developed by the Allen Institute for AI. Molmo models are trained on PixMo, a dataset of 1 million, highly-curated image-text pairs. It has state-of-the-art performance among multimodal models with a similar size while being fully open-source.
|
18 |
+
|
19 |
+
Molmo 7B-D is based on [Qwen2-7B](https://huggingface.co/Qwen/Qwen2-7B) and uses [OpenAI CLIP](https://huggingface.co/openai/clip-vit-large-patch14-336) as vision backbone. It is trained on our high-quality PixMo dataset.
|
20 |
+
|
21 |
+
|
22 |
+
This checkpoint is a **preview** of the Molmo release. All artifacts used in creating Molmo (PixMo dataset, training code, evaluations, intermediate checkpoints) will be made available at a later date, furthering our commitment to open-source AI development and reproducibility. **[Sign up here](https://docs.google.com/forms/d/e/1FAIpQLSdML1MhNNBDsCHpgWG65Oydg2SjZzVasyqlP08nBrWjZp_c7A/viewform)** to be the first to know when artifacts are released.
|
23 |
+
|
24 |
+
|
25 |
+
|
26 |
+
|
27 |
+
|
28 |
+
|
29 |
## Quick Start
|
30 |
|
31 |
To run Molmo, first install dependencies:
|
|
|
81 |
print(generated_text)
|
82 |
|
83 |
# >>> This photograph captures an adorable black Labrador puppy sitting on a weathered
|
84 |
+
# wooden deck. The deck's planks, which are a mix of light and dark brown with ...
|
85 |
```
|
86 |
|
87 |
## License and Use
|