[CodeParrot](https://huggingface.co./lvwerra/codeparrot) uses GPT-2 architecture with BPE tokenizer trained on Python code.

|Model | # parameters | 
|   -   |   -  | 
| GPT2 | 1.5B |