OptionaltoolsA list of tools the model may call. LangChain StructuredTool definitions are converted to Heroku's function tool format. See: https://devcenter.heroku.com/articles/heroku-inference-api-v1-chat-completions#tools-array-function-type-tools
Optionaltool_Controls how the model uses tools. Can be "auto", "required", "any" (converted to "required"), or an object specifying a particular function to call. Note: LangChain may pass "any" which will be automatically converted to "required" for the Heroku API. See: https://devcenter.heroku.com/articles/heroku-inference-api-v1-chat-completions#tool_choice-parameter
OptionaladditionalAllows passing other Heroku-specific parameters not explicitly defined (e.g., extended_thinking) at runtime.
OptionaltemperatureOptionalmaxOptionaltopOptionalstopStop tokens to use for this call. If not provided, the default stop tokens for the model will be used.
Interface for the options that can be passed at runtime to ChatHeroku methods. Extends BaseChatModelCallOptions and includes Heroku-specific tool parameters.