rahulvenkk commited on
Commit
9626877
1 Parent(s): 6dfcb0f
Files changed (1) hide show
  1. README.md +14 -46
README.md CHANGED
@@ -1,47 +1,15 @@
1
- <div align="center">
2
- <h2>Understanding Physical Dynamics with Counterfactual World Modeling</h2>
3
 
4
- [**Rahul Venkatesh***](https://rahulvenkk.github.io/)<sup>1</sup> · [**Honglin Chen***](https://web.stanford.edu/~honglinc/)<sup>1*</sup> · [**Kevin Feigelis***](https://neuroscience.stanford.edu/people/kevin-t-feigelis)<sup>1</sup> · [**Daniel M. Bear**](https://twitter.com/recursus?lang=en)<sup>1</sup> · [**Khaled Jedoui**](https://web.stanford.edu/~thekej/)<sup>1</sup> · [**Klemen Kotar**](https://klemenkotar.github.io/)<sup>1</sup> · [**Felix Binder**](https://ac.felixbinder.net/)<sup>2</sup> · [**Wanhee Lee**](https://www.linkedin.com/in/wanhee-lee-31102820b/)<sup>1</sup> · [**Sherry Liu**](https://neuroailab.github.io/cwm-physics/)<sup>1</sup> · [**Kevin A. Smith**](https://www.mit.edu/~k2smith/)<sup>3</sup> · [**Judith E. Fan**](https://cogtoolslab.github.io/)<sup>1</sup> · [**Daniel L. K. Yamins**](https://stanford.edu/~yamins/)<sup>1</sup>
5
-
6
- (* equal contribution)
7
-
8
- <sup>1</sup>Stanford&emsp;&emsp;&emsp;&emsp;<sup>2</sup>UCSD&emsp;&emsp;&emsp;&emsp;<sup>3</sup>MIT
9
-
10
-
11
-
12
-
13
- <a href="https://arxiv.org/abs/2312.06721"><img src='https://img.shields.io/badge/arXiv-CWM-red' alt='Paper PDF'></a>
14
- <a href='https://neuroailab.github.io/cwm-physics/'><img src='https://img.shields.io/badge/Project_Page-CWM-green' alt='Project Page'></a>
15
- <a href='https://neuroailab.github.io/cwm-physics/'><img src='https://img.shields.io/badge/%F0%9F%A4%97%20Hugging%20Face-Spaces-blue'></a>
16
- <a href='https://neuroailab.github.io/cwm-physics/'><img src='https://img.shields.io/badge/%F0%9F%A4%97%20Hugging%20Face-Colab-yellow'></a>
17
- </div>
18
-
19
- This work presents the Counterfactual World Modeling (CWM) framework. CWM is capable of counterfactual prediction and extraction of vision structures useful for understanding physical dynamics.
20
-
21
- ![](assets/cwm_teaser.gif)
22
-
23
- ## 📣 News
24
-
25
- - 2024-06-01: Release [project page](https://neuroailab.github.io) and [codes](https://github.com/rahulvenkk/cwm_release.git)
26
-
27
- ## 🔨 Installation
28
-
29
- ```
30
- git clone https://github.com/rahulvenkk/cwm_release.git
31
- pip install -e .
32
- ```
33
-
34
- ## ✨ Usage
35
- To download and use a pre-trianed model run the following
36
- ```
37
- from cwm.model.model_factory import model_factory
38
- model = model_factory.load_model('vitbase_8x8patch_3frames_1tube')
39
- ```
40
- This will automatically initialize the appropriate model class and download the specified weights to your `$CACHE` directory.
41
-
42
- ## 🔄 Pre-training
43
- To train the model run the following script
44
-
45
- ```
46
- ./scripts/pretrain/3frame_patch8x8_mr0.90_gpu.sh
47
- ```
 
 
 
1
 
2
+ ---
3
+ title: Counterfactual World Models
4
+ emoji: 📊
5
+ colorFrom: purple
6
+ colorTo: yellow
7
+ sdk: gradio
8
+ sdk_version: 4.44.0
9
+ app_file: app.py
10
+ pinned: false
11
+ license: mit
12
+ short_description: Vision foundation model that unifies vision structures
13
+ ---
14
+
15
+ Check out the configuration reference at https://huggingface.co/docs/hub/spaces-config-reference