LM Studio

LM Studio allows you to run local LLMs with an OpenAI-compatible server.

Basic Example

client<llm> MyClient {
    provider "openai-generic"
    options {
        base_url "http://localhost:1234/v1"
        model "TheBloke/phi-2-GGUF"
    }
}

BAML-Specific Options

Option	Type	Default	Description
base_url	string	-	http://localhost:1234/v1
model	string	-	Model identifier

See LM Studio documentation for more information.

See Also

• OpenAI Generic
• Ollama
• Client Overview