---
datasets:
- togethercomputer/RedPajama-Data-V2
language:
- de
pipeline_tag: text-generation
library_name: transformers
---

# LLäMmchen 1B

This is a German Tinyllama 1B language model trained from scratch using the 
the [Tinyllama](https://github.com/jzhang38/TinyLlama) codebase on the German portion of [RedPajama V2](https://huggingface.co./datasets/togethercomputer/RedPajama-Data-V2). 


### Usage

```python
from transformers import AutoModelForCausalLM, AutoTokenizer

model = AutoModelForCausalLM.from_pretrained("LSX-UniWue/llammchen_1b")

tokenizer = AutoTokenizer.from_pretrained("LSX-UniWue/llammchen_1b")
```


### Evaluation 
We evaluated our results on the [Superkleber](https://lsx-uniwue.github.io/SuperGLEBer-site/) benchmark.