Optional
toolsA list of tools the model may call. LangChain StructuredTool definitions are converted to Heroku's function tool format. See: https://devcenter.heroku.com/articles/heroku-inference-api-v1-chat-completions#tools-array-function-type-tools
Optional
tool_Controls how the model uses tools. Can be "auto", "required", or an object specifying a particular function to call. See: https://devcenter.heroku.com/articles/heroku-inference-api-v1-chat-completions#tool_choice-parameter
Optional
additionalAllows passing other Heroku-specific parameters not explicitly defined (e.g., extended_thinking) at runtime.
Optional
temperatureOptional
maxOptional
topOptional
stopStop tokens to use for this call. If not provided, the default stop tokens for the model will be used.
Interface for the options that can be passed at runtime to HerokuMia methods. Extends BaseChatModelCallOptions and includes Heroku-specific tool parameters.