huggingface

HuggingFace supports the OpenAI client, allowing you to use the openai-generic provider with an overridden base_url.

See https://huggingface.co/docs/inference-endpoints/index for more information on their Inference Endpoints.

BAML

1 client<llm> MyClient {
2   provider openai-generic
3   options {
4     base_url "https://api-inference.huggingface.co/v1"
5     api_key env.HUGGINGFACE_API_KEY
6   }
7 }

1	client<llm> MyClient {
2	provider openai-generic
3	options {
4	base_url "https://api-inference.huggingface.co/v1"
5	api_key env.HUGGINGFACE_API_KEY
6	}
7	}