Together AI

Together AI supports the OpenAI client, allowing you to use the openai-generic provider with an overridden base_url.

See https://docs.together.ai/docs/openai-api-compatibility for more information.

BAML
client<llm> MyClient {
provider "openai-generic"
options {
base_url "https://api.together.ai/v1"
api_key env.TOGETHER_API_KEY
model "meta-llama/Llama-3-70b-chat-hf"
}
}