Structured output
Hi great model..
Any suggestion how to get a structured output, I did not find it in the API docs.
Our official API actually supports structured output, but this is not currently mentioned in the official documentation. We will update the relevant documentation as soon as possible.
https://intl.minimaxi.com/document/ChatCompletion%20v2?key=66701d281d57f38758d581d0
In this document, the param response_format might meet your needs.
the good news is: yes response_format works indeed for structure output scheme.
the bad news is: Stream=true is not compatible with response_format , and since my prompt is very long, I cannot use it because it gives me timeout errors.
"invalid params, stream and response_format are mutually exclusive"
but I getting 98% of the reply I need so I can work out the rest.
Note: I love your model because is the only one that can take a lot of context and reply something that make sense. And yes I know google have a great model too but is ridiculously censored.
Even with censor settings in NONE.
this give me a little more room with some tweaks, and my project needs it.