Groq supports the OpenAI client, allowing you to use the openai-generic provider with an overridden base_url.
openai-generic
base_url
See https://console.groq.com/docs/openai for more information.
1client<llm> MyClient {2 provider openai-generic3 options {4 base_url "https://api.groq.com/openai/v1"5 api_key env.GROQ_API_KEY6 model "llama-3-groq-70b-tool-use"7 }8}