Function calling and structured outputs

Arkor inference endpoints now accept the OpenAI-compatible tools, tool_choice, and response_format fields on POST /v1/chat/completions.

What's new

• Function calling — pass an array of tools and a tool_choice; the model emits structured tool_calls when it decides to invoke one.
• Structured outputs — constrain the response to JSON Schema, regex, or a fixed grammar.

Enabling tools on your endpoint

Set the tool-call parser when deploying the inference worker, then redeploy.