Spaces:
Sleeping
Sleeping
Update README.md
Browse files
README.md
CHANGED
@@ -4,7 +4,7 @@ emoji: 🔤
|
|
4 |
colorFrom: indigo
|
5 |
colorTo: purple
|
6 |
sdk: gradio
|
7 |
-
sdk_version:
|
8 |
app_file: app.py
|
9 |
pinned: false
|
10 |
---
|
@@ -48,6 +48,4 @@ The tokenizer is available at: [https://huggingface.co/Saiteja/telugu-bpe](https
|
|
48 |
- Built using the 🤗 Tokenizers library
|
49 |
- Uses WordPiece tokenization with Telugu-specific pre-tokenization rules
|
50 |
- Handles Telugu Unicode characters effectively
|
51 |
-
- Maintains high compression ratio while preserving token interpretability
|
52 |
-
|
53 |
-
|
|
|
4 |
colorFrom: indigo
|
5 |
colorTo: purple
|
6 |
sdk: gradio
|
7 |
+
sdk_version: 5.9.1
|
8 |
app_file: app.py
|
9 |
pinned: false
|
10 |
---
|
|
|
48 |
- Built using the 🤗 Tokenizers library
|
49 |
- Uses WordPiece tokenization with Telugu-specific pre-tokenization rules
|
50 |
- Handles Telugu Unicode characters effectively
|
51 |
+
- Maintains high compression ratio while preserving token interpretability
|
|
|
|