how did you create this
#1
by
ehartford
- opened
how did you create this?
did you use their conversion script?
https://huggingface.co./deepseek-ai/DeepSeek-V3/blob/main/inference/fp8_cast_bf16.py
I tried but it seems to missing some metadata
@bartowski I didnt know you are working at arcee :-)
What metadata is it missing? Yeah that's the script I used
I added the rest of the files manually (config with removed quantization config, tokenizer, etc)
I've been contracting for them for a bit now yeah :)
ehartford
changed discussion status to
closed
How will I created it