Flex
Flex inference
Set with service_tier: flex
- Price effect
50% of standard
- Trade-off
Minutes (1 to 15 min target), best-effort sheddable capacity, 503/429 on congestion, no automatic fallback to standard; counts toward normal rate limits
- From the docs
“The Gemini Flex API is an inference tier that offers a 50% cost reduction compared to standard rates, in exchange for variable latency and best-effort availability.”
ai.google.dev “| **Latency** | Minutes (1–15 min target) | Low (Seconds) | Seconds to minutes | Up to 24 hours |”
ai.google.dev “No server-side fallback: To prevent unexpected charges, the system won't automatically upgrade a Flex request to the Standard tier if Flex capacity is full.”
ai.google.dev