Update README.md
Browse files![5bb2f23dd595d389e6a9a0aadebd87c.png](https://cdn-uploads.huggingface.co/production/uploads/642a298ae5f33939cf3ee600/iOFZOwLGfEByCQ_2EkR7y.png)
Explain the photo in English:
![eeb555092886be02e8e6215d0fdb229.png](https://cdn-uploads.huggingface.co/production/uploads/642a298ae5f33939cf3ee600/CASHz1oxgowVS3n5e4LUq.png)
Explain the photo in Chinese:
![e943a2a36676345cf7f2db2dc4ce98a.png](https://cdn-uploads.huggingface.co/production/uploads/642a298ae5f33939cf3ee600/zqPVmKMxup0ww67a02ke-.png)
README.md
CHANGED
@@ -9,6 +9,14 @@ llava-dinov2-internlm2-7b-v1 is a LLaVA model fine-tuned from [InternLM2-Chat-7B
|
|
9 |
|
10 |
I did not carefully tune the training hyperparameters but the model still show capability to solve some tasks. It shows that a visual encoder can be integrated with an LLM, even when the encoder is not aligned with natural language with contrastive learning like CLIP.
|
11 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
12 |
## Results
|
13 |
Model | MMBench Test (EN) | MMBench Dev (EN) | MMBench Test (CN) | MMBench Dev (CN) | CCBench Dev
|
14 |
------------- | ------------- | ------------- | ------------- | ------------- | -------------
|
|
|
9 |
|
10 |
I did not carefully tune the training hyperparameters but the model still show capability to solve some tasks. It shows that a visual encoder can be integrated with an LLM, even when the encoder is not aligned with natural language with contrastive learning like CLIP.
|
11 |
|
12 |
+
## Example
|
13 |
+
|
14 |
+
![5bb2f23dd595d389e6a9a0aadebd87c.png](https://cdn-uploads.huggingface.co/production/uploads/642a298ae5f33939cf3ee600/iOFZOwLGfEByCQ_2EkR7y.png)
|
15 |
+
Explain the photo in English:
|
16 |
+
![eeb555092886be02e8e6215d0fdb229.png](https://cdn-uploads.huggingface.co/production/uploads/642a298ae5f33939cf3ee600/CASHz1oxgowVS3n5e4LUq.png)
|
17 |
+
Explain the photo in Chinese:
|
18 |
+
![e943a2a36676345cf7f2db2dc4ce98a.png](https://cdn-uploads.huggingface.co/production/uploads/642a298ae5f33939cf3ee600/zqPVmKMxup0ww67a02ke-.png)
|
19 |
+
|
20 |
## Results
|
21 |
Model | MMBench Test (EN) | MMBench Dev (EN) | MMBench Test (CN) | MMBench Dev (CN) | CCBench Dev
|
22 |
------------- | ------------- | ------------- | ------------- | ------------- | -------------
|