Cloud platforms - 36 entries
Vertex AI quotas and rate limits
Google Cloud's official docs, read on October 17, 2026, set quotas for Vertex AI across Standard PayGo Tier 1, Standard PayGo Tier 2, Standard PayGo Tier 3, Standard PayGo Tier 4 and Priority PayGo. For Gemini Pro and Argon models, Standard PayGo Tier 2 is listed at $250 - $2,000 Customer spend (30 days) and 1,000,000 Traffic TPM (org-level, prioritized throughput threshold), and Standard PayGo Tier 4 at 10,000,000 Traffic TPM (org-level, prioritized throughput threshold).
Last verified from docs.cloud.google.com. What the docs leave out
- Tiers
- 5
- Tables
- 28
- Entries
- 36
- Verified
- Oct 17, 2026
Limits by model, endpoint and plan
Values are copied exactly as the docs show them, units included, in the docs' own order. A dash means the docs list no value for that row.
All 28 tables on this page
- Gemini Pro and Argon models
- Gemini Flash and Flash-Lite models (GA tier-eligible: Gemini 3.8 Flash Cyber, 3.8 Flash, 3.7 Flash, 3.6 Flash, 3.5 Flash-Lite, 3.5 Flash, 3.1 Flash-Lite, 2.5 Flash-Lite, 2.5 Flash)
- Gemini Flash and Flash-Lite models
- Gemini Pro models (Priority PayGo; e.g. gemini-4-argon, gemini-4-argon-cyber-permissive, gemini-3.1-pro-preview, gemini-2.5-pro) and Gemini Flash and Flash-Lite models (Priority PayGo; e.g. gemini-3.8-flash, gemini-3.5-flash, gemini-3.5-flash-lite, gemini-3.1-flash-lite, gemini-2.5-flash)
- Gemini generateContent / streamGenerateContent multimodal input, per project per region, per base model and resolution
- base_model: gemini-embedding (gemini-embedding-001), global quota
- base_model: gemini-embedding-2, global quota
- claude-opus-5 (anthropic-claude-opus lineage) and claude-opus-4-8 (anthropic-claude-opus lineage)
- claude-opus-4-7
- claude-opus-4-5
- claude-opus-4-1 and claude-opus-4
- claude-sonnet-5 (anthropic-claude-sonnet lineage)
- claude-sonnet-4
- claude-3-7-sonnet
- claude-3-5-sonnet-v2
- claude-3-5-sonnet
- claude-3-5-haiku
- claude-3-opus
- claude-3-haiku
- claude-fable-5 (anthropic-claude-fable lineage)
- Mistral Medium 3 and Mistral Small 3.1 (25.03)
- Codestral 2
- Mistral OCR (25.05)
- Agent Runtime (formerly Agent Engine / reasoning engine), per project per region
- RAG Engine on Gemini Enterprise Agent Platform
- Gen AI evaluation service (default judge model Gemini 2.5 Flash)
- Batch inference (Gemini and non-Gemini models)
- Semantic Governance Policy, per project per region
Gemini Pro and Argon models
3 tiers
| Tier | Customer spend (30 days) |
|---|---|
| Standard PayGo Tier 2 | $250 - $2,000 |
| |
| Standard PayGo Tier 3 | $2,000 - $50,000 |
| |
| Standard PayGo Tier 4 | > $50,000 |
| |
- Applies to global endpoint; per model within family; no separate RPM limit.
Gemini Flash and Flash-Lite models (GA tier-eligible: Gemini 3.8 Flash Cyber, 3.8 Flash, 3.7 Flash, 3.6 Flash, 3.5 Flash-Lite, 3.5 Flash, 3.1 Flash-Lite, 2.5 Flash-Lite, 2.5 Flash)
Standard PayGo Tier 1
| Metric | Standard PayGo Tier 1 |
|---|---|
| Customer spend (30 days) | $10 - $250 |
| Traffic TPM (org-level, prioritized throughput threshold) | 2,000,000 |
| RPM | There's no separate requests-per-minute (RPM) limit for each tier. |
- Usage tiers do not apply to Gemini Nano Banana 2.1, Gemini 3.1 Flash Image, Gemini 3.1 Flash-Lite Image, Gemini 3 Pro Image, Gemini 2.5 Flash Image (Standard PayGo without tiers), nor to preview models.
Gemini Flash and Flash-Lite models
3 tiers
| Tier | Customer spend (30 days) |
|---|---|
| Standard PayGo Tier 2 | $250 - $2,000 |
| |
| Standard PayGo Tier 3 | $2,000 - $50,000 |
| |
| Standard PayGo Tier 4 | > $50,000 |
| |
- Standard PayGo Tier 2 and Standard PayGo Tier 4: Applies to global endpoint; per model within family.
- Standard PayGo Tier 3: Page example: "an organization in Tier 3 has a prioritized throughput threshold of 10,000,000 TPM for Gemini 3.5 Flash."
Gemini Pro models (Priority PayGo; e.g. gemini-4-argon, gemini-4-argon-cyber-permissive, gemini-3.1-pro-preview, gemini-2.5-pro) and Gemini Flash and Flash-Lite models (Priority PayGo; e.g. gemini-3.8-flash, gemini-3.5-flash, gemini-3.5-flash-lite, gemini-3.1-flash-lite, gemini-2.5-flash)
2 scopes - Priority PayGo
| Model or scope | Baseline throughput limit (org-level, per model) |
|---|---|
| Gemini Pro models (Priority PayGo; e.g. gemini-4-argon, gemini-4-argon-cyber-permissive, gemini-3.1-pro-preview, gemini-2.5-pro) | 10,000,000 tokens per minute |
| Gemini Flash and Flash-Lite models (Priority PayGo; e.g. gemini-3.8-flash, gemini-3.5-flash, gemini-3.5-flash-lite, gemini-3.1-flash-lite, gemini-2.5-flash) | 50,000,000 tokens per minute |
- Gemini Pro models (Priority PayGo; e.g. gemini-4-argon, gemini-4-argon-cyber-permissive, gemini-3.1-pro-preview, gemini-2.5-pro): "These limits are available to your organization immediately. There's no ramp-up period". Requires header X-Vertex-AI-LLM-Shared-Request-Type: priority (add X-Vertex-AI-LLM-Request-Type: shared to use only Priority PayGo). Traffic above the limit is served at priority when capacity exists; otherwise downgraded to Standard PayGo (trafficType ON_DEMAND instead of ON_DEMAND_PRIORITY). Billed at a higher per-token rate than Standard PayGo.
- Gemini Flash and Flash-Lite models (Priority PayGo; e.g. gemini-3.8-flash, gemini-3.5-flash, gemini-3.5-flash-lite, gemini-3.1-flash-lite, gemini-2.5-flash): Supported on global, us and eu endpoints in general; some models (such as Gemini 2.5) may not support all three.
Gemini generateContent / streamGenerateContent multimodal input, per project per region, per base model and resolution
| Metric | Limit |
|---|---|
| Image input per minute per base model and resolution (generate_content_image_input_per_base_model_id_and_resolution) | 34,000,000 |
| Video input per minute per base model and resolution (generate_content_video_input_per_base_model_id_and_resolution) | 192,000,000 |
| Audio input per minute per base model and resolution (generate_content_audio_input_per_base_model_id_and_resolution) | 11,000,000 |
| Document input per minute per base model and resolution (generate_content_document_input_per_base_model_id_and_resolution) | 1,200,000 |
- Same limits apply on the global endpoint via the corresponding ..._global metric. Metric prefix aiplatform.googleapis.com/.
base_model: gemini-embedding (gemini-embedding-001), global quota
| Metric | Limit |
|---|---|
| Input tokens per minute (global_embed_content_input_tokens_per_minute_per_base_model) | 100,000,000 |
| Requests per minute (global_embed_content_requests_per_minute_per_base_model) | 100,000 |
| online_prediction_requests (predict API, gemini-embedding-001) | 30,000 |
- Tuned model inference shares the same quota as the base model.
base_model: gemini-embedding-2, global quota
| Metric | Limit |
|---|---|
| Input tokens per minute (global_embed_content_input_tokens_per_minute_per_base_model) | 200,000,000 |
| Requests per minute (global_embed_content_requests_per_minute_per_base_model) | 60,000 |
claude-opus-5 (anthropic-claude-opus lineage) and claude-opus-4-8 (anthropic-claude-opus lineage)
2 scopes
| Model or scope | QPM (Multi-region) |
|---|---|
| claude-opus-5 (anthropic-claude-opus lineage) | 1,000 |
| |
| claude-opus-4-8 (anthropic-claude-opus lineage) | 1,000 |
| |
- claude-opus-5 (anthropic-claude-opus lineage): Shares the anthropic-claude-opus bucket with other lineage versions on the same endpoint.
- claude-opus-4-8 (anthropic-claude-opus lineage): Docs example: calling Claude Opus 4.8 through the global endpoint counts against the anthropic-claude-opus bucket regardless of Opus version.
claude-opus-4-7
Model page: Claude Opus 4.7
| Metric | Limit |
|---|---|
| QPM (Multi-region) | 400 |
| Input TPM (Multi-region, uncached and cache write) | 4,000,000 |
| Output TPM (Multi-region) | 400,000 |
| QPM (global endpoint) | 800 |
| Input TPM (global endpoint, uncached and cache write) | 8,000,000 |
| Output TPM (global endpoint) | 800,000 |
| Context length | 1,000,000 |
- Listed in the Quotas by model and region table; its model page was not checked for whether it uses shared lineage or per-model quota.
claude-opus-4-5
Model page: Claude Opus 4.5
| Metric | Limit |
|---|---|
| QPM (us-east5 / europe-west1 / asia-southeast1, each) | 200 |
| Input TPM (each regional endpoint, uncached and cache write) | 2,000,000 |
| Output TPM (each regional endpoint) | 200,000 |
| QPM (global endpoint) | 400 |
| Input TPM (global endpoint, uncached and cache write) | 4,000,000 |
| Output TPM (global endpoint) | 400,000 |
| Context length | 200,000 |
claude-opus-4-1 and claude-opus-4
2 scopes
| Model or scope | QPM (us-east5) |
|---|---|
| claude-opus-4-1 | 25 |
| |
| claude-opus-4 | 25 |
| |
claude-sonnet-5 (anthropic-claude-sonnet lineage)
Model page: Claude Sonnet 5
| Metric | Limit |
|---|---|
| QPM (Multi-region) | 1,250 |
| Input TPM (Multi-region, uncached and cache write) | 12,500,000 |
| Output TPM (Multi-region) | 1,250,000 |
| QPM (global endpoint) | 2,500 |
| Input TPM (global endpoint, uncached and cache write) | 25,000,000 |
| Output TPM (global endpoint) | 2,500,000 |
| Context length | 1,000,000 |
- Values from the Claude quotas table; the model page returned no extractable quota section.
claude-sonnet-4
| Metric | Limit |
|---|---|
| QPM (us-east5) | 35 |
| Input TPM (us-east5, uncached and cache write) | 280,000 |
| Output TPM (us-east5) | 20,000 |
| QPM (europe-west1) | 25 |
| Input TPM (europe-west1) | 180,000 |
| Output TPM (europe-west1) | 20,000 |
| QPM (global endpoint) | 35 |
| Input TPM (global endpoint) | 276,000 |
| Output TPM (global endpoint) | 24,000 |
| Context length | 1,000,000 |
claude-3-7-sonnet
| Metric | Limit |
|---|---|
| QPM (us-east5) | 55 |
| TPM (us-east5, uncached input and output) | 500,000 |
| QPM (europe-west1) | 40 |
| TPM (europe-west1, uncached input and output) | 300,000 |
| QPM (global endpoint) | 35 |
| TPM (global endpoint, uncached input and output) | 300,000 |
| Context length | 200,000 |
claude-3-5-sonnet-v2
| Metric | Limit |
|---|---|
| QPM (us-east5) | 90 |
| TPM (us-east5, input and output) | 540,000 |
| QPM (europe-west1) | 55 |
| TPM (europe-west1, input and output) | 330,000 |
| QPM (global endpoint) | 25 |
| TPM (global endpoint, input and output) | 140,000 |
| Context length | 200,000 |
claude-3-5-sonnet
| Metric | Limit |
|---|---|
| QPM (us-east5) | 80 |
| TPM (us-east5, input and output) | 350,000 |
| QPM (europe-west1) | 130 |
| TPM (europe-west1, input and output) | 600,000 |
| QPM (asia-southeast1) | 35 |
| TPM (asia-southeast1, input and output) | 150,000 |
| Context length | 200,000 |
claude-3-5-haiku
| Metric | Limit |
|---|---|
| QPM (us-east5) | 80 |
| TPM (us-east5, input and output) | 350,000 |
| QPM (europe-west1) | 90 |
| TPM (europe-west1, input and output) | 400,000 |
| Context length | 200,000 |
claude-3-opus
| Metric | Limit |
|---|---|
| QPM (us-east5) | 20 |
| TPM (us-east5, input and output) | 105,000 |
| Context length | 200,000 |
claude-3-haiku
| Metric | Limit |
|---|---|
| QPM (us-east5) | 245 |
| TPM (us-east5, input and output) | 600,000 |
| QPM (europe-west1) | 75 |
| TPM (europe-west1, input and output) | 181,000 |
| QPM (asia-southeast1) | 70 |
| TPM (asia-southeast1, input and output) | 174,000 |
| Context length | 200,000 |
claude-fable-5 (anthropic-claude-fable lineage)
Model page: Claude Fable 5
| Metric | Limit |
|---|---|
| QPM (Multi-region) | 1,000 |
| Input TPM (Multi-region, uncached and cache write) | 10,000,000 |
| Output TPM (Multi-region) | 1,000,000 |
| QPM (global endpoint) | 2,000 |
| Input TPM (global endpoint, uncached and cache write) | 20,000,000 |
| Output TPM (global endpoint) | 2,000,000 |
| Context length | 1,000,000 |
- Claude Fable 5.1 shares the anthropic-claude-fable lineage but its quota cells are empty on both the quotas table and its model page.
Mistral Medium 3 and Mistral Small 3.1 (25.03)
2 scopes
| Model or scope | QPM (us-central1 / europe-west4, each) |
|---|---|
| Mistral Medium 3 | 90 |
| |
| Mistral Small 3.1 (25.03) | 60 |
| |
- Mistral Medium 3: Quota applies per region where the model is available.
Codestral 2
| Metric | Limit |
|---|---|
| QPM (us-central1 / europe-west4, each) | 1,100 |
| Input TPM (each region) | 1,100,000 |
| Output TPM (each region) | 110,000 |
| Context length | 128,000 tokens |
Mistral OCR (25.05)
| Metric | Limit |
|---|---|
| QPM (us-central1 / europe-west4, each) | 30 |
| Pages per request | 30 (1 page = 1 million input tokens and 1 million output tokens) |
| Context length | 30 pages |
Agent Runtime (formerly Agent Engine / reasoning engine), per project per region
| Metric | Limit |
|---|---|
| Create, delete, or update Agent Runtime resources per minute (reasoning_engine_service_write_requests) | 10 |
| Create, delete, or update Agent Runtime sessions per minute (session_write_requests) | 100 |
| Get, list, or retrieve Agent Runtime sessions per minute (session_read_requests) | 10000 |
| Query or StreamQuery Agent Runtime per minute (reasoning_engine_service_query_requests) | 90 |
| Append event to Agent Runtime sessions per minute (session_event_append_requests) | 300 |
| Maximum number of Agent Runtime resources (reasoning_engine_service_entities) | 100 |
| Create, delete, or update Agent Runtime memory resources per minute (memory_bank_write_requests) | 100 |
| Get, list, or retrieve from Agent Runtime Memory Bank per minute (memory_bank_read_requests) | 300 |
| Sandbox environment (Code Execution) execute requests per minute | 1000 |
| Sandbox environment (Code Execution) entities per region | 1000 |
| Sandbox environment (Code Execution) write requests per minute | 500 |
| A2A Agent post requests like sendMessage and cancelTask per minute | 60 |
| A2A Agent get requests like getTask and getCard per minute | 600 |
| Concurrent live bidirectional connections using the BidiStreamQuery API per minute | 10 |
- Metric prefix aiplatform.googleapis.com/.
RAG Engine on Gemini Enterprise Agent Platform
| Metric | Limit |
|---|---|
| RAG Engine data management APIs (VertexRagDataService requests per minute per region) | 60 RPM |
| RetrievalContexts API (VertexRagService retrieve requests per minute per region) | 600 RPM |
| base_model: textembedding-gecko (Online prediction requests per base model per minute per region per base_model) | 1,500 RPM |
| Concurrent ImportRagFiles requests (limit) | 3 RPM |
| Maximum number of files per ImportRagFiles request (limit) | 10,000 |
Gen AI evaluation service (default judge model Gemini 2.5 Flash)
| Metric | Limit |
|---|---|
| Gen AI evaluation service requests per minute | 1,000 requests per project per region |
| Concurrent evaluation runs | 20 concurrent evaluation runs per project per region |
| Gemini throughput | Depends on model and consumption option |
| Request timeout (system limit) | 60 seconds |
- Judge model consumption is calculated at the organization level.
Batch inference (Gemini and non-Gemini models)
| Metric | Limit |
|---|---|
| Gemini models concurrent batch jobs | There are no predefined quota limits on batch inference for Gemini models. |
| aiplatform.googleapis.com/textembedding_gecko_concurrent_batch_prediction_jobs | 4 |
- Gemini batch uses a shared pool dynamically allocated; requests may be queued for capacity. Same across all regions.
Semantic Governance Policy, per project per region
| Metric | Limit |
|---|---|
| Get or list policy resources per minute | 600 |
| Create, update, or delete policy resources per minute | 60 |
| Get policy engine resources per minute | 600 |
| Update or deprovision policy engine resources per minute | 60 |
| Number of policy resources per project per location | 1,000 |
How to raise your limits
Gemini Pro and Argon models and Gemini Flash and Flash-Lite models
Custom Tier: "Contact your sales team for more information".
Gemini Pro and Argon models, Gemini Flash and Flash-Lite models (GA tier-eligible: Gemini 3.8 Flash Cyber, 3.8 Flash, 3.7 Flash, 3.6 Flash, 3.5 Flash-Lite, 3.5 Flash, 3.1 Flash-Lite, 2.5 Flash-Lite, 2.5 Flash) and Gemini Flash and Flash-Lite models
Automatic promotion based on rolling 30-day org spend on eligible Agent Platform services (Gemini predictions, Gemini features such as caching, Agent Platform CPU/GPU/TPU predictions, management fees, Provisioned Throughput SKUs, LLM Grounding).
Gemini Pro models (Priority PayGo; e.g. gemini-4-argon, gemini-4-argon-cyber-permissive, gemini-3.1-pro-preview, gemini-2.5-pro) and Gemini Flash and Flash-Lite models (Priority PayGo; e.g. gemini-3.8-flash, gemini-3.5-flash, gemini-3.5-flash-lite, gemini-3.1-flash-lite, gemini-2.5-flash)
"If your workload requires a higher limit, contact your sales team." For dedicated capacity use Provisioned Throughput.
Gemini generateContent / streamGenerateContent multimodal input, per project per region, per base model and resolution
"To request a higher limit for these quotas, contact your Google Cloud account team; they can't be increased from the Google Cloud console."
base_model: gemini-embedding (gemini-embedding-001), global quota, base_model: gemini-embedding-2, global quota and claude-sonnet-5 (anthropic-claude-sonnet lineage)
Request quota changes through Cloud Quotas (Quotas and System Limits page in the Google Cloud console).
claude-opus-5 (anthropic-claude-opus lineage), claude-opus-4-8 (anthropic-claude-opus lineage) and 2 more
Google Cloud console Quotas and system limits page, filter base_model anthropic-claude-fable.
claude-opus-4-7, claude-opus-4-5 and 13 more
"If you want to increase any of your quotas for Agent Platform, you can use the Google Cloud console to request a quota increase."
claude-opus-4-7, claude-opus-4-5 and 13 more
Quotas can typically be adjusted via Cloud Quotas (request a quota increase in the Google Cloud console).
RAG Engine on Gemini Enterprise Agent Platform
Quotas adjustable via Cloud Quotas; the two "limits" rows are system limits that can't be changed.
Gen AI evaluation service (default judge model Gemini 2.5 Flash)
"you might need to file a quota increase request. See View and manage quotas".
Batch inference (Gemini and non-Gemini models)
Quotas and System Limits page: filter aiplatform.googleapis.com/textembedding_gecko_concurrent_batch_prediction_jobs, click the three dots, Edit quota, enter value, Submit request.
Semantic Governance Policy, per project per region
Quotas and System Limits page: filter the property (for example aiplatform.googleapis.com/semantic_governance/policy_write_requests), Edit quota, Submit request.
What the docs leave out
- Generative media quotas (Gemini Omni, Veo, Lyria): no numeric values published; docs only say to view/edit in the console's Quotas and System Limits page using metrics global_generate_content_requests_per_minute_per_project_per_base_model (Gemini Omni, Lyria) and long_running_online_prediction_requests_per_base_model (Veo).
- Claude Fable 5.1 on Google Cloud (claude-fable-5-1): quota cells (QPM, Input TPM, Output TPM, context length) are blank on both the Claude quotas table and the model page.
- Per-project actual quota values and the current Standard PayGo usage tier for an organization are only shown in the logged-in Google Cloud console (Quotas and System Limits page, Agent Platform Dashboard).
- Gemini models: no per-model fixed RPM/TPM quota under Standard PayGo; docs say there is no separate RPM limit per tier. Gemini image models (Nano Banana 2.1, 3.1 Flash Image, 3.1 Flash-Lite Image, 3 Pro Image, 2.5 Flash Image) and preview models have no published tier thresholds.
- XAI Grok, Meta Muse Spark, AI21 Jamba partner models: quotas not found in public docs during this pass (model cards link to the console).
- Provisioned Throughput capacity figures were not captured (dedicated purchased capacity, not a default quota).
FAQ
What are the Vertex AI quotas and rate limits?
Google Cloud's official docs, read on October 17, 2026, set quotas for Vertex AI across Standard PayGo Tier 1, Standard PayGo Tier 2, Standard PayGo Tier 3, Standard PayGo Tier 4 and Priority PayGo. For Gemini Pro and Argon models, Standard PayGo Tier 2 is listed at $250 - $2,000 Customer spend (30 days) and 1,000,000 Traffic TPM (org-level, prioritized throughput threshold), and Standard PayGo Tier 4 at 10,000,000 Traffic TPM (org-level, prioritized throughput threshold).
How do I raise my Vertex AI quotas?
Custom Tier: "Contact your sales team for more information". Automatic promotion based on rolling 30-day org spend on eligible Agent Platform services (Gemini predictions, Gemini features such as caching, Agent Platform CPU/GPU/TPU predictions, management fees, Provisioned Throughput SKUs, LLM Grounding). "If your workload requires a higher limit, contact your sales team." For dedicated capacity use Provisioned Throughput.
Where do these Vertex AI numbers come from?
Every value is copied verbatim from Google Cloud's official documentation at docs.cloud.google.com, read on October 17, 2026. This page lists all 36 entries in 28 tables, each linked to the page it came from.
Related reading
- How to Use Claude Fable 5: Every Access Path ExplainedHow to use Claude Fable 5 via claude.ai plans, the Claude API, Amazon Bedrock, Vertex AI and Microsoft Foundry, with model IDs, setup effort and prompt tips.
- Gemini CLI Guide: 1M Token Context and Who Can Still Use ItGemini CLI puts a 1 million token context in your terminal but now only serves paid Gemini API, Vertex AI and Code Assist users. Setup and TypeScript workflow.
- Claude Code Fast Mode: Is 2.5x Speed Worth 2x Price?Claude Code fast mode pricing: $8/$40 per MTok on Opus 5.5, the first-enable context charge, separate rate limit pools, and when 2.5x speed pays off.
- Claude Fable 5 API: Production Integration Patterns, Rate Limits, and Migration GotchasClaude Fable 5 API production guide - adaptive thinking, rate limit strategy, streaming latency, fallback chains and a migration checklist from Opus 4.8.
Sources
Last verified . Every value is copied verbatim from the official pages below, read on that date.
- https://docs.cloud.google.com/gemini-enterprise-agent-platform/models/standard-paygo
- https://docs.cloud.google.com/gemini-enterprise-agent-platform/models/priority-paygo
- https://docs.cloud.google.com/gemini-enterprise-agent-platform/models/quotas
- https://docs.cloud.google.com/gemini-enterprise-agent-platform/models/partner-models/claude/quotas
- https://docs.cloud.google.com/gemini-enterprise-agent-platform/models/partner-models/mistral
Newsletter
Know when limits change
One email per week. New model releases, pricing and limit changes, and what they mean for what you build.