LLM Client Providers

Tinfoil

Tinfoil is verifiably private AI inference.

Tinfoil supports the OpenAI client, allowing you to use the openai-generic provider with an overridden base_url.

1client<llm> TinfoilDeepSeek {
2  provider openai-generic
3  retry_policy Exponential
4  options {
5    base_url "https://deepseek-r1-70b-p.model.tinfoil.sh/v1"
6    model "deepseek-r1-70b"
7    api_key env.TINFOIL_API_KEY
8  }
9}