architectures/opt.txt

[OPT](https://huggingface.co./facebook/opt-30b) uses decoder-only models like GPT-3. It was trained on 5 datasets with one containing a small portion of code. In this demo we use the 30B parameters model. The largest model has 176B parameters.

|Model | # parameters |
|   -   |   -  | 
| Decoder |30B |