Skip to main content
Watch: I Built an AI App Without Leaving Databricks

API compatibility - 4 documented limits

Groq API compatibility

Groq documents an OpenAI-compatible API at https://api.groq.com/openai/v1 (chat/completions, responses, audio/transcriptions and audio/translations). Its docs do not mention an Anthropic-compatible endpoint. The docs list 4 limitations: 4 for the OpenAI-compatible layer.

Verified against Groq's own documentation. Not documented means the docs read that day do not say; it never means No.

Compare every provider in the API compatibility matrix.

OpenAI-compatible API

Supported
Base URL
https://api.groq.com/openai/v1
Endpoints
  • chat/completions
  • responses
  • audio/transcriptions
  • audio/translations
Auth
GROQ_API_KEY passed as the OpenAI client's api_key
Notes
Groq describes the API as 'mostly compatible' with OpenAI's client libraries and also ships its own Groq Python/TypeScript libraries, which it encourages. The Responses API is supported.

From the docs

To start using Groq with OpenAI's client libraries, pass your Groq API key to the api_key parameter and change the base_url to https://api.groq.com/openai/v1
console.groq.com/docs/openai

Anthropic-compatible API

Not documented
Notes
The Groq OpenAI compatibility page read today does not mention an Anthropic-compatible endpoint.

Checked: console.groq.com/docs/openai

Documented limitations

Parameters, content types and features Groq's docs say its compatibility layers ignore, reject or change, each with the line it comes from. A layer with nothing listed may still differ in ways the docs do not spell out.

OpenAI-compatible layer4

  • logprobs, logit_bias, top_logprobs, messages[].name return 400

    The following fields are currently not supported and will result in a 400 error (yikes) if they are supplied: logprobs, logit_bias, top_logprobs, messages[].name
    console.groq.com/docs/openai
  • n must be 1

    If N is supplied, it must be equal to 1.
    console.groq.com/docs/openai
  • temperature 0 converted to 1e-8

    If you set a temperature value of 0, it will be converted to 1e-8.
    console.groq.com/docs/openai
  • audio transcription/translation: vtt and srt formats not supported

    The following values are not supported: vtt, srt
    console.groq.com/docs/openai

Example from Groq's docs

Copied verbatim from the provider's documentation, placeholders included.

Provider example
import os
import openai

client = openai.OpenAI(
    base_url="https://api.groq.com/openai/v1",
    api_key=os.environ.get("GROQ_API_KEY")
)

More on Groq

Newsletter

Know when a provider changes its API

One email per week. New models, new endpoints and the compatibility changes that break a base URL, and what they mean for your stack.