File size: 778 Bytes
e2b2525
 
 
 
 
911ab5a
 
e2b2525
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
# Easy-Translate Examples

This folder contains examples of how to use Easy-Translate with different models and configurations.
You can adapt these examples to your own use cases. If you have any questions, please feel free to open an issue.

> Run the examples from the root of the Easy-Translate repository as follows: `sh examples/<example>.sh`

### MT Models

```bash
m2m100-1.2B.sh
m2m100-12B_fp16.sh
nllb200_3B_fp16.sh
opusMT.sh
mbart.sh
small100.sh
```

#### Multi-GPU example
```bash
m2m100-1.2B_2GPUs.sh
```
#### Running large models on customer hardware
```bash
m2m100-12B_8bits.sh
nllb200_3B_8bit.sh
nllb200-moe-54B_1GPU_int8.sh
nllb200-moe-54B_1GPU_int4.sh
```

### Running LLMs with translation prompts

```bash
FlanT5-large.sh
LLaMA.sh
Vicuna.sh
Alpaca-Lora.sh
```