Skip to main content

Cerebras

Cerebras provides ultra-fast inference using their custom Wafer-Scale Engine hardware.

Basic Example​

client<llm> CerebrasLlama {
provider "openai-generic"
options {
base_url "https://api.cerebras.ai/v1"
api_key env.CEREBRAS_API_KEY
model "llama-3.3-70b"
}
}

BAML-Specific Options​

OptionTypeDefaultDescription
base_urlstring-https://api.cerebras.ai/v1
api_keystringenv.CEREBRAS_API_KEYAPI key
modelstring-Model identifier

See OpenAI Generic for all supported options.

See Also​