---
language: 
- zh
---
# Tiny BERT 4L zh
This is a backup repo of [the official repo](https://huggingface.co./huawei-noah/TinyBERT_4L_zh). 

Now the model can be loaded with 
```python
from transformers import AutoModel
model = AutoModel.from_pretrained("JeremiahZ/TinyBERT_4L_zh_backup")
```

More information on this model can be found [here](https://github.com/huawei-noah/Pretrained-Language-Model/tree/master/TinyBERT).