File size: 715 Bytes
6ceb713
 
10db471
6ceb713
 
 
c79179f
6ceb713
 
 
 
10db471
6ceb713
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
# Release

- 2024.10.16: [GOT-OCR2_0-716M-BF16-GGUF](https://huggingface.co./Jerry666/GOT-OCR2_0-716M-BF16-GGUF)

# Description

[gguf-py](https://github.com/jerrylsu/gguf-py) is a Python package for writing binary files in the GGUF based on llama_cpp.

# Usage

`
python convert_hf_to_gguf.py --outtype bf16 --model ~/GOT-OCR2_0 --outfile ~/output/GOT-OCR2_0-GGUF
`

# Adding Supported Model

[GOT_OCR2](https://huggingface.co./stepfun-ai/GOT-OCR2_0)

Continue...

# References

[llama.cpp](https://github.com/ggerganov/llama.cpp): LLM inference in C/C++.

[GOT-OCR2.0](https://github.com/Ucas-HaoranWei/GOT-OCR2.0): Official code implementation of General OCR Theory: Towards OCR-2.0 via a Unified End-to-end Model.