LLM Client Providers

LMStudio

LMStudio supports the OpenAI client, allowing you to use the openai-generic provider with an overridden base_url.

See https://lmstudio.ai/docs/developer/openai-compat/chat-completions for more information.

BAML
client<llm> MyClient {
  provider "openai-generic"
  options {
    base_url "http://localhost:1234/v1"
    model "TheBloke/phi-2-GGUF"
  }
}