jinjieyuan commited on
Commit
089661d
1 Parent(s): ead54b3

Update model card

Browse files
Files changed (1) hide show
  1. README.md +22 -3
README.md CHANGED
@@ -3,7 +3,7 @@ language: en
3
  license: apache-2.0
4
  ---
5
 
6
- # SQFT: Low-cost Model Adaptation in Low-precision Sparse Foundation Models
7
 
8
  - Base Model: [IntelLabs/sqft-mistral-7b-v0.3-50-base-gptq](https://huggingface.co/IntelLabs/sqft-mistral-7b-v0.3-50-base-gptq)
9
  - Sparsity: 50%
@@ -15,9 +15,28 @@ license: apache-2.0
15
  ### Evaluation
16
 
17
  ```bash
18
- MODEL_PATH=IntelLabs/sqft-qa-sparsepeft-mistral-7b-v0.3-50-gptq-gsm8k-heu
19
- lm_eval --model hf --model_args pretrained=${MODEL_PATH},add_bos_token=True,trust_remote_code=True --tasks gsm8k --batch_size auto:4
20
  ```
21
 
22
  Refer to our [repo](https://github.com/IntelLabs/Hardware-Aware-Automated-Machine-Learning/tree/main/SQFT) for the environment information to run this command.
23
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
3
  license: apache-2.0
4
  ---
5
 
6
+ # SQFT Fine-tuned Model: sqft-qa-sparsepeft-mistral-7b-v0.3-50-gptq-gsm8k-heu
7
 
8
  - Base Model: [IntelLabs/sqft-mistral-7b-v0.3-50-base-gptq](https://huggingface.co/IntelLabs/sqft-mistral-7b-v0.3-50-base-gptq)
9
  - Sparsity: 50%
 
15
  ### Evaluation
16
 
17
  ```bash
18
+ MODEL_NAME=IntelLabs/sqft-qa-sparsepeft-mistral-7b-v0.3-50-gptq-gsm8k-heu
19
+ lm_eval --model hf --model_args pretrained=${MODEL_NAME},add_bos_token=True,trust_remote_code=True --tasks gsm8k --batch_size auto:4
20
  ```
21
 
22
  Refer to our [repo](https://github.com/IntelLabs/Hardware-Aware-Automated-Machine-Learning/tree/main/SQFT) for the environment information to run this command.
23
 
24
+ ## Model Sources
25
+
26
+ - **Repository:** [https://github.com/IntelLabs/Hardware-Aware-Automated-Machine-Learning/tree/main/SQFT](https://github.com/IntelLabs/Hardware-Aware-Automated-Machine-Learning/tree/main/SQFT)
27
+ - **Paper:** [SQFT: Low-cost Model Adaptation in Low-precision Sparse Foundation Models]()
28
+
29
+ ## Citation
30
+
31
+ ```bash
32
+ @article{munoz2024sqft,
33
+ title = {SQFT: Low-cost Model Adaptation in Low-precision Sparse Foundation Models},
34
+ author={J. Pablo Munoz and Jinjie Yuan and Nilesh Jain},
35
+ journal={},
36
+ year={2024}
37
+ }
38
+ ```
39
+
40
+ ## License
41
+
42
+ Apache-2.0