Together AI

Together AI provides access to open-source models with OpenAI-compatible API.

Basic Example

client<llm> MyClient {
    provider "openai-generic"
    options {
        base_url "https://api.together.ai/v1"
        api_key env.TOGETHER_API_KEY
        model "meta-llama/Llama-3-70b-chat-hf"
    }
}

BAML-Specific Options

Option	Type	Default	Description
base_url	string	-	https://api.together.ai/v1
api_key	string	env.TOGETHER_API_KEY	API key
model	string	-	Model identifier

Available Models

Model	Description
meta-llama/Llama-3-70b-chat-hf	Llama 3 70B
meta-llama/Llama-3-8b-chat-hf	Llama 3 8B
mistralai/Mixtral-8x7B-Instruct-v0.1	Mixtral 8x7B
Qwen/Qwen2-72B-Instruct	Qwen2 72B

See Together AI API compatibility for the complete list.

See Also

• OpenAI Generic
• Groq
• Client Overview