LLM Client Providers

LMStudio

LMStudio supports the OpenAI client, allowing you to use the openai-generic provider with an overridden base_url.

See https://lmstudio.ai/docs/developer/openai-compat/chat-completions for more information.

BAML
1client<llm> MyClient {
2  provider "openai-generic"
3  options {
4    base_url "http://localhost:1234/v1"
5    model "TheBloke/phi-2-GGUF"
6  }
7}