THUdyh commited on
Commit
f0375b1
·
verified ·
1 Parent(s): 22d1fa3

Create README.md

Browse files
Files changed (1) hide show
  1. README.md +35 -0
README.md ADDED
@@ -0,0 +1,35 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: apache-2.0
3
+ pipeline_tag: text-generation
4
+ language:
5
+ - en
6
+ - zh
7
+ base_model:
8
+ - meta-llama/Meta-Llama-3-8B-Instruct
9
+ ---
10
+ # Insight-V-Summary-LLaMA3
11
+
12
+ ## Model Summary
13
+
14
+ The Insight-V models are 7B parameter models based on LLaMA3-8B language model with a context window of 32K tokens.
15
+
16
+ Oryx offers an on-demand solution to seamlessly and efficiently process visual inputs with arbitrary spatial sizes and temporal lengths.
17
+
18
+ - **Repository:** https://github.com/dongyh20/Insight-V
19
+ - **Languages:** English, Chinese
20
+ - **Paper:** https://arxiv.org/abs/xxxx.xxxx
21
+
22
+
23
+ ### Model Architecture
24
+
25
+ - **Architecture:** Pre-trained [Oryx-ViT](https://huggingface.co/THUdyh/Oryx-ViT) + LLaMA3-8B
26
+ - **Data:** a mixture of 1.2M image-text data
27
+ - **Precision:** BFloat16
28
+
29
+ #### Hardware & Software
30
+
31
+ - **Hardware:** 64 * NVIDIA Tesla A100
32
+ - **Orchestration:** HuggingFace Trainer
33
+ - **Code:** Pytorch
34
+
35
+ ## Citation