yydxlv commited on
Commit
084f98c
·
verified ·
1 Parent(s): 905baa6

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +5 -25
README.md CHANGED
@@ -10,18 +10,21 @@ datasets:
10
  base_model:
11
  - microsoft/Phi-3.5-vision-instruct
12
  pipeline_tag: feature-extraction
 
13
  ---
14
 
15
  <!-- This model card has been generated automatically according to the information the Trainer had access to. You
16
  should probably proofread and complete it, then remove this comment. -->
17
 
18
- # colphi3.5
19
 
20
  This model was trained from scratch on the data_dir/colpali_train_set dataset.
21
 
22
  ## Model description
23
 
24
- More information needed
 
 
25
 
26
  ## Intended uses & limitations
27
 
@@ -30,26 +33,3 @@ More information needed
30
  ## Training and evaluation data
31
 
32
  More information needed
33
-
34
- ## Training procedure
35
-
36
- ### Training hyperparameters
37
-
38
- The following hyperparameters were used during training:
39
- - learning_rate: 0.0005
40
- - train_batch_size: 32
41
- - eval_batch_size: 8
42
- - seed: 42
43
- - gradient_accumulation_steps: 4
44
- - total_train_batch_size: 128
45
- - optimizer: Use adamw_torch with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
46
- - lr_scheduler_type: linear
47
- - lr_scheduler_warmup_steps: 100
48
- - num_epochs: 5
49
-
50
- ### Framework versions
51
-
52
- - Transformers 4.46.3
53
- - Pytorch 2.4.0+cu121
54
- - Datasets 2.21.0
55
- - Tokenizers 0.20.3
 
10
  base_model:
11
  - microsoft/Phi-3.5-vision-instruct
12
  pipeline_tag: feature-extraction
13
+ license: mit
14
  ---
15
 
16
  <!-- This model card has been generated automatically according to the information the Trainer had access to. You
17
  should probably proofread and complete it, then remove this comment. -->
18
 
19
+ # ColPhi3.5
20
 
21
  This model was trained from scratch on the data_dir/colpali_train_set dataset.
22
 
23
  ## Model description
24
 
25
+ ColPhi3.5 is a model based on a novel model architecture and training strategy based on Vision Language Models (VLMs) to efficiently index documents from their visual features.
26
+ It is a Phi3.5-V-4B extension that generates ColBERT- style multi-vector representations of text and images.
27
+ It was introduced in the paper ColPali: Efficient Document Retrieval with Vision Language Models.
28
 
29
  ## Intended uses & limitations
30
 
 
33
  ## Training and evaluation data
34
 
35
  More information needed