Skip to main content
Gemini APIProduct page

Gemini API Signals

What teams building AI features on Gemini API report, with every finding tied to its evidence.

Read the findings

What the evidence says

Whose sources count

Practitioner sentiment, teams and leaders

0 Mixed from 74 sources that take a side

How this figure is made

Mixed overall signal, net 0 points

From 70 authors in 63 discussions. Run a pilot on your own prompts to measure output quality and cost per task.

Analyzed
220 total sources
Top praise
Cost Efficiency (16 of 17 sources) See praise evidence
Top concern
Model Changes (14 of 14 sources) See concern evidence

Jan 2025 to Oct 2026.

194 sources from practitioners, by month and sentiment.

Teams and leaders are evenly split: 24 are positive, 25 mixed and 25 negative. Flash pricing draws praise from 16 of the 17 who discuss cost, and all 13 who discuss multimodal input praise it. Model retirements and version changes lead their concerns, as DoorDash's platform lead describes for hundreds of use cases, followed by latency, which PartForge measured at 143 seconds a task on Gemini 3.8 Flash against 48 on Claude Sonnet 5.5. Most team accounts that name a route buy through Google Cloud.

Positive, mixed and negative sources

The score counts them as 23 positive, 24 mixed and 23 negative votes, one per author. See How the numbers work.

See the evidence

Below: 6 praise themes, 6 concerns, 5 close to agreement and 1 disagreement.

Findings

Counted for Teams and technical leaders, from 85 sources. Change group

What practitioners praise

Every capability practitioners describe positively, ranked by how many sources say so. Open one to read who said it.

  1. Cost Efficiency16 of 17 sources on it praise itValue for money from Flash and Flash-Lite prices, the Batch API, and caching on the author's own workload.

    Counted for Teams and technical leaders.

    Positive, 16

    1. Positive

      Piotr Skalski, Roboflow

      Google Is Back! Gemini 4 Argon Leads Our Vision BenchmarkEngineering blog post, Roboflow

      Roboflow's vision benchmark puts Gemini 4 Argon first overall and about 6 times cheaper than GPT-6 Astra at low effort, though its requests averaged 13.4 seconds at that setting.

      Published Oct 15, 2026self-described: Roboflow's vision-language benchmark: object detection, segmentation, OCR, and video tests

    2. Positive

      Swift, Major League Hacking

      I got Jev to zero mistakes. I'm still using Flash-Lite.Engineering blog post, dev.to

      MLH measured Gemini Flash-Lite against a decision model on thousands of runs; Flash-Lite made zero dangerous routing calls and stays in production.

      Published Oct 8, 2026self-described: Major League Hacking, eval router in production for AI coding agent grading

    3. Positive

      merb, Hacker News commenter

      Comment on: Gemini 4 ArgonHacker News comment

      The team runs Gemini Flash-Lite for customer-generated automations and finds the Flash families best on cost, speed, and business-document OCR.

      Published Sep 30, 2026self-described: Customer-facing automation generation in an application

    4. Mixed

      thraxil, Hacker News commenter

      Comment on: Price per 1M tokens is meaninglessHacker News comment

      For large-input classification, Gemini 2.0 Flash at US$0.10 per million tokens, less with batch, was adequate; newer models cost significantly more.

      Published Jul 7, 2026self-described: Classification and extraction on 100,000-token inputs

    5. Positive

      OakNinja, Hacker News commenter

      Comment on: Gemini 3.5 FlashHacker News comment

      Running almost entirely on 3.1 and 2.5 Flash-Lite with guaranteed JSON output, the team reports 99.5% accuracy at low cost.

      Published May 19, 2026self-described: High-volume structured tasks

    6. Mixed

      Sudeeksha Murari, AI Research & Risk Lead, Augment Code

      Frontier AI at half the cost: Gemini 3.1 Pro now available in Augment CodeCompany engineering blog

      Augment found Gemini 3.1 Pro cheaper than Opus 4.6 in real use and stronger on one codebase planning task. Murari warns that it needs clearer instructions and can lose the thread when conversations or tool results grow.

      Published Apr 2, 2026Augment compared Gemini 3.1 Pro with Claude Opus 4.6 on codebase planning and daily coding work

    7. Positive

      tucnak, Hacker News commenter

      Comment on: Giving university exams in the age of chatbotsHacker News comment

      At a previous job, dataset-scale transformations were 97% of model spend and ran on Gemini 2.5 Flash in batch and caching mode on Vertex AI.

      Published Jan 20, 2026self-described: Previous employer, dataset-scale transformations

    8. Mixed

      Ari Messer, AI Partnerships, Anaconda (Kilo)

      Gemini 3 Flash Outperforms Gemini 3 Pro in Coding TestsCompany-written coding benchmark

      Kilo's tests found Gemini 3 Flash faster and cheaper than Pro, but both missed security requirements. Messer recommends trying Flash for implementation after a stronger model plans the work.

      Published Dec 19, 2025Kilo's own coding tests of Gemini 3 Flash and Pro, including security requirements

    9. Positive

      wsxiaoys, Hacker News commenter

      Comment on: Creating a Tab completion model from scratchHacker News comment

      The team fine-tuned Gemini Flash-Lite with LoRA for next-edit prediction, avoiding model infrastructure and getting faster responses at lower cost.

      Published Nov 20, 2025self-described: Tab completion edit model

    10. Mixed

      aymeric, Mercari Cross Border Engineering

      The Journey of User-Generated Content TranslationEngineering blog post, Mercari Engineering

      Mercari moved listing translation to Gemini on Google Cloud for higher pay-as-you-go rate limits and lower cost. Latency then rose after a forced move off a retiring Gemini model, a switch it made without A/B testing.

      Published Oct 12, 2025self-described: Mercari listing translation for the Mercari Global App, moved from GPT-4o mini on Azure to Gemini on Google Cloud

    11. Positive

      mfkhalil, Hacker News commenter

      Comment on: Launch HN: Webhound (YC S23) - Research agent that builds datasetsHacker News comment

      Webhound's research agent runs on Gemini 2.5 Flash, which keeps inference costs low even with parallel search agents.

      Published Sep 25, 2025self-described: Webhound, research agent product

    12. Mixed

      film42, Hacker News commenter

      Comment on: Claude Sonnet 4 now supports 1M tokens of contextHacker News comment

      Gemini 2.5 Pro beats Claude on price and uses far fewer tokens on PDFs, but dynamic QoS rate limits hit the team constantly and the Vertex SDK is awkward.

      Published Aug 12, 2025self-described: Customer invoice document processing

    13. Positive

      serjester, Hacker News commenter

      Comment on: Mistral OCRHacker News comment

      The team uses Gemini to write specific alt text during extraction, and a specialized OCR model costs 2 to 3 times as much as Gemini Flash.

      Published Mar 6, 2025self-described: RAG document extraction

    14. Positive

      ajcp, Hacker News commenter

      Comment on: Ingesting PDFs and why Gemini 2.0 changes everythingHacker News comment

      Processed over 10 million shipping documents in a month for under US$1,000 at 80-82% accuracy, against 66% for humans.

      Published Feb 5, 2025self-described: Shipping document extraction pipeline

    15. Positive

      Sez Saygılı, founding engineer, Patientdesk AI (YC W26)

      Post on Gemini Flash in productionX post

      A founding engineer calls Gemini Flash underrated in production, naming its reliability, low price, adequate speed, and consistent output.

      Published Sep 2, 2026self-described: Voice AI for healthcare at a Y Combinator W26 startup

    16. Positive

      arjunchint, Hacker News commenter

      Comment on: Show HN: Cua-Bench - a benchmark for AI agents in GUI environmentsHacker News comment

      rtrvr.ai's DOM-only web agent runs on off-the-shelf Gemini Flash-Lite, which the team credits with top benchmark results at the lowest cost.

      Published Jan 29, 2026self-described: rtrvr.ai, DOM-only web agent

    Mixed or negative, 1

    1. Negative

      Bruno Škvorc, Staff Software Engineer, Lindy

      Migrating from Claude to DeepSeekEngineering blog post, Lindy

      Lindy moved most managed-agent traffic from its Gemini and Claude Sonnet paths to DeepSeek v4 Flash in May and June 2026, ramping only while its evals held, and inference cost on those routes fell by about 90%.

      "We moved most managed model traffic from Claude Sonnet and Gemini paths to DeepSeek v4 Flash on Atlas Cloud. Inference costs on those routes fell by about 90%."
      Excerpt, Bruno Škvorc

      Published Jun 24, 2026self-described: Lindy's managed agents for email, calendar and meeting work

    Open them in the record
  2. Multimodal & Long ContextAll 13 sources on it praise itHow well Gemini handles images, video, audio, PDFs, and very long inputs on the author's task.

    Counted for Teams and technical leaders.

    1. Positive

      Piotr Skalski, Roboflow

      Google Is Back! Gemini 4 Argon Leads Our Vision BenchmarkEngineering blog post, Roboflow

      Roboflow's vision benchmark puts Gemini 4 Argon first overall and about 6 times cheaper than GPT-6 Astra at low effort, though its requests averaged 13.4 seconds at that setting.

      Published Oct 15, 2026self-described: Roboflow's vision-language benchmark: object detection, segmentation, OCR, and video tests

    2. Positive

      Karl Mielnicki, CTO and co-founder, Flobotics

      Post on analyzing sales-call video with the Gemini APIX post

      A CTO uses the Gemini API constantly to analyze sales calls and other videos and says nothing comes close, down to counting how often someone touched their face.

      Published Sep 28, 2026Flobotics, an automation and AI agent company; sales-call and video analysis

    3. Positive

      Ben Halpern, The DEV Team

      How we're using Gemini Embeddings to build a smarter, community-driven feed on DEVEngineering blog post, DEV Community

      DEV moved its feed pipeline to Gemini Embeddings 2 with pgvector to group posts by meaning, and asks the Gemini API to label a trend once a cluster reaches 10 articles.

      Published May 22, 2026self-described: DEV and the Forem platform, feed ranking and trend clustering

    4. Positive

      mattnewton, Hacker News commenter

      Comment on: GPT-5o-mini hallucinates medical residency applicant gradesHacker News comment

      Gemini 2.5 Flash parses complicated tables in PDF image chunks well, with a small prompt working in over 90% of cases.

      Published Oct 14, 2025self-described: Parsing tables in PDF images

    5. No opinion stated

      Orr Zohar and coauthors, Stanford and Hugging Face

      TimeScope: How Long Can Your Video Large Multimodal Model Go?Independent benchmark, Hugging Face blog

      On the TimeScope long-video benchmark, Gemini 2.5 Pro was the only model tested that kept strong accuracy on videos longer than one hour.

      Published Jul 23, 2025self-described: Open benchmark that hides short clips in videos from one minute to eight hours

    6. Mixed

      Mandy Gu, author of InfoQ's article on Wealthsimple's generative AI tools

      Gen AI Productivity Tools at WealthsimpleEngineering article, InfoQ

      Wealthsimple added Gemini to its internal LLM gateway beside OpenAI and Cohere because Gemini's 1 million token context models promised a way around the context limits it kept hitting. Amazon Bedrock followed, and in September 2024 the gateway API moved to OpenAI's format.

      "Following that, we started expanding the LLM providers that we supported. The catalyst for this was Gemini. Around that time, Gemini had launched their 1-million-token context window models, and we were really interested to see how this could circumvent a lot of our previous challenges with the context window limitations."
      Excerpt, Mandy Gu

      Published Feb 6, 2025self-described: Wealthsimple's internal LLM gateway for employee productivity tools, built in 2023

    7. Positive

      lazypenguin, Hacker News commenter

      Comment on: Ingesting PDFs and why Gemini 2.0 changes everythingHacker News comment

      A fintech team replaced a specialist OCR vendor with Gemini for PDF ingestion after testing, because it worked with minimal effort.

      Published Feb 5, 2025self-described: Fintech PDF ingestion

    8. Positive

      merb, Hacker News commenter

      Comment on: Gemini 4 ArgonHacker News comment

      The team runs Gemini Flash-Lite for customer-generated automations and finds the Flash families best on cost, speed, and business-document OCR.

      Published Sep 30, 2026self-described: Customer-facing automation generation in an application

    9. Positive

      johnnymakes, Hacker News commenter

      Comment on: #1 on the leading AI memory benchmark using a smaller, cheaper modelHacker News comment

      Exabase's memory engine scored 96.4% on LongMemEval running on Gemini 3 Flash, where other leaderboard systems used Gemini 3 Pro.

      Published May 15, 2026self-described: Exabase, memory engine M-1

    10. Positive

      Yui Takeuchi, software engineer on Mercari's search team

      Search Results Quality Monitoring with LLMsEngineering blog post, Mercari Engineering

      Mercari's search team compared several models and chose Gemini 2.5 Pro for its LLM reviewers of search results, because it best understood user intent. Adding item images and details to screenshots improved accuracy.

      Published Dec 9, 2025self-described: Mercari product search, weekly LLM review of the top 120 results for about 1,000 keywords drawn from search logs

    11. Mixed

      film42, Hacker News commenter

      Comment on: Claude Sonnet 4 now supports 1M tokens of contextHacker News comment

      Gemini 2.5 Pro beats Claude on price and uses far fewer tokens on PDFs, but dynamic QoS rate limits hit the team constantly and the Vertex SDK is awkward.

      Published Aug 12, 2025self-described: Customer invoice document processing

    12. Positive

      serjester, Hacker News commenter

      Comment on: Mistral OCRHacker News comment

      The team uses Gemini to write specific alt text during extraction, and a specialized OCR model costs 2 to 3 times as much as Gemini Flash.

      Published Mar 6, 2025self-described: RAG document extraction

    13. Positive

      ajcp, Hacker News commenter

      Comment on: Ingesting PDFs and why Gemini 2.0 changes everythingHacker News comment

      Processed over 10 million shipping documents in a month for under US$1,000 at 80-82% accuracy, against 66% for humans.

      Published Feb 5, 2025self-described: Shipping document extraction pipeline

    Open them in the record
  3. Model Quality11 of 12 sources on it praise itAccuracy, reasoning, and instruction following on the author's own task.

    Counted for Teams and technical leaders.

    Positive, 11

    1. Positive

      johnnymakes, Hacker News commenter

      Comment on: #1 on the leading AI memory benchmark using a smaller, cheaper modelHacker News comment

      Exabase's memory engine scored 96.4% on LongMemEval running on Gemini 3 Flash, where other leaderboard systems used Gemini 3 Pro.

      Published May 15, 2026self-described: Exabase, memory engine M-1

    2. Positive

      Ben Halpern, The DEV Team

      Fighting Spam at Scale: How We Use Gemini to Protect the DEV CommunityEngineering blog post, DEV Community

      DEV sends posts that need judgment to Gemini 3 with author history as context, and spam fell after the system shipped.

      Published Jan 22, 2026self-described: DEV and the Forem platform, automated content moderation

    3. Positive

      Yui Takeuchi, software engineer on Mercari's search team

      Search Results Quality Monitoring with LLMsEngineering blog post, Mercari Engineering

      Mercari's search team compared several models and chose Gemini 2.5 Pro for its LLM reviewers of search results, because it best understood user intent. Adding item images and details to screenshots improved accuracy.

      Published Dec 9, 2025self-described: Mercari product search, weekly LLM review of the top 120 results for about 1,000 keywords drawn from search logs

    4. No opinion stated

      Albert Ziegler, XBOW

      Agents Built From AlloysEngineering blog post, XBOW blog

      XBOW found Gemini 2.5 Pro a real step up for its pentesting agent. Alternating it with Claude Sonnet in one loop raised benchmark success rates from 25% to 40% and then 55%.

      Published Jul 17, 2025self-described: XBOW, an autonomous penetration-testing agent measured on a fixed benchmark of vulnerability challenges

    5. Positive

      Swift, Major League Hacking

      I got Jev to zero mistakes. I'm still using Flash-Lite.Engineering blog post, dev.to

      MLH measured Gemini Flash-Lite against a decision model on thousands of runs; Flash-Lite made zero dangerous routing calls and stays in production.

      Published Oct 8, 2026self-described: Major League Hacking, eval router in production for AI coding agent grading

    6. Mixed

      deaux, Hacker News commenter

      Comment on: Gemini 3.6 Flash, 3.5 Flash-Lite, and 3.5 Flash CyberHacker News comment

      The team runs Gemini in production products because it beats OpenAI and Anthropic models on cost, quality, latency, and adherence for those tasks, while calling Google's product side a mess.

      Published Jul 21, 2026self-described: Team with LLM-based applications in production

    7. Mixed

      SkyPuncher, Hacker News commenter

      Comment on: Everything we like is a psyop?Hacker News comment

      In an agentic product using all three frontier families, Gemini leads on reasoning and Flash on latency-sensitive steps, but it struggles with tool calling.

      Published Apr 17, 2026self-described: Agentic product using three frontier model families

    8. Mixed

      Sudeeksha Murari, AI Research & Risk Lead, Augment Code

      Frontier AI at half the cost: Gemini 3.1 Pro now available in Augment CodeCompany engineering blog

      Augment found Gemini 3.1 Pro cheaper than Opus 4.6 in real use and stronger on one codebase planning task. Murari warns that it needs clearer instructions and can lose the thread when conversations or tool results grow.

      Published Apr 2, 2026Augment compared Gemini 3.1 Pro with Claude Opus 4.6 on codebase planning and daily coding work

    9. Mixed

      zapnuk, Hacker News commenter

      Comment on: Gemini Embedding: Powering RAG and context engineeringHacker News comment

      Gemini embeddings improved the team's classifier, but the API returned quota errors at about 150 requests a minute despite a far higher quota.

      Published Aug 1, 2025self-described: Embedding 6,000 documents for a classifier

    10. Positive

      PaulShin, Hacker News commenter

      Comment on: Ask HN: What Does Your Self-Hosted LLM Stack Look Like in 2025?Hacker News comment

      Markhub runs heavy tasks on Gemini models through Vertex AI and keeps small, frequent tasks on self-hosted models.

      Published Jun 9, 2025self-described: Markhub, AI collaboration product

    11. Mixed

      Raunak Chowdhuri, CTO of Reducto

      Comment on: Ingesting PDFs and why Gemini 2.0 changes everythingHacker News comment

      Reducto's CTO calls Gemini 2.0 a great model after extensive testing. A fine-tuned Gemini 1.5 and base Gemini 2.0 still hallucinated checkboxes, raising error rates by 17% on Flash and 8% on Pro.

      Published Feb 5, 2025self-described: Reducto document parsing; Gemini 1.5 fine-tuned and Gemini 2.0 base tested for checkbox extraction

    Mixed or negative, 1

    1. Mixed

      pimeys, Hacker News commenter

      Comment on: DeepSeek v4.1 Flash Is Now Our Best Hacking ModelHacker News comment

      After weeks of evaluations against Gemini 3.8, Kimi K3, and Opus 5, DeepSeek V4.1 won the team's evals at a fraction of the price.

      Published Sep 16, 2026self-described: Product priced per token to customers

    Open them in the record
  4. Speed6 of 9 sources on it praise itHow quickly Flash and Flash-Lite respond and how much output they produce per second on the author's workload.

    Counted for Teams and technical leaders.

    Positive, 6

    1. Positive

      Sez Saygılı, founding engineer, Patientdesk AI (YC W26)

      Post on Gemini Flash in productionX post

      A founding engineer calls Gemini Flash underrated in production, naming its reliability, low price, adequate speed, and consistent output.

      Published Sep 2, 2026self-described: Voice AI for healthcare at a Y Combinator W26 startup

    2. Positive

      Amp team

      Gemini 3 Flash in the Search SubagentEngineering blog post, Amp

      Amp's codebase search subagent switched from Haiku 4.5 to Gemini 3 Flash, which runs 3 times faster at the same quality and fires about 8 parallel tool calls per iteration.

      Published Dec 17, 2025self-described: Amp coding agent, codebase search subagent

    3. Positive

      Swift, Major League Hacking

      I got Jev to zero mistakes. I'm still using Flash-Lite.Engineering blog post, dev.to

      MLH measured Gemini Flash-Lite against a decision model on thousands of runs; Flash-Lite made zero dangerous routing calls and stays in production.

      Published Oct 8, 2026self-described: Major League Hacking, eval router in production for AI coding agent grading

    4. Positive

      merb, Hacker News commenter

      Comment on: Gemini 4 ArgonHacker News comment

      The team runs Gemini Flash-Lite for customer-generated automations and finds the Flash families best on cost, speed, and business-document OCR.

      Published Sep 30, 2026self-described: Customer-facing automation generation in an application

    5. Mixed

      Ari Messer, AI Partnerships, Anaconda (Kilo)

      Gemini 3 Flash Outperforms Gemini 3 Pro in Coding TestsCompany-written coding benchmark

      Kilo's tests found Gemini 3 Flash faster and cheaper than Pro, but both missed security requirements. Messer recommends trying Flash for implementation after a stronger model plans the work.

      Published Dec 19, 2025Kilo's own coding tests of Gemini 3 Flash and Pro, including security requirements

    6. Positive

      wsxiaoys, Hacker News commenter

      Comment on: Creating a Tab completion model from scratchHacker News comment

      The team fine-tuned Gemini Flash-Lite with LoRA for next-edit prediction, avoiding model infrastructure and getting faster responses at lower cost.

      Published Nov 20, 2025self-described: Tab completion edit model

    Mixed or negative, 3

    1. Negative

      Scott Sykora, developer behind PartForge (Pixite Inc.)

      Why PartForge now defaults to Claude Sonnet 5.5Engineering blog post, PartForge

      PartForge replaced Gemini 3.8 Flash as its default model with Claude Sonnet 5.5 on October 20, 2026, as a trial. In PartForge's own tests Gemini 3.8 Flash took 143 seconds for a typical hard task and Sonnet 5.5 took 48 seconds.

      "New chats in PartForge now run on Claude Sonnet 5.5, replacing Gemini 3.8 Flash, which has been our default since September."
      Excerpt, Scott Sykora

      Published Oct 20, 2026self-described: PartForge, a chat product that designs CAD parts, with Gemini 3.8 Flash as its default since September 2026

    2. Negative

      dacox, Hacker News commenter

      Comment on: Please don't discontinue Gemini 2.5 FlashHacker News comment

      Older Flash models were cheap and fast, but aggressive deprecation replaces them with reasoning models that are slower and much more expensive.

      Published Jul 10, 2026self-described: Fine-tuned workloads considered for Flash

    3. Negative

      ekidd, Hacker News commenter

      Comment on: Please don't discontinue Gemini 2.5 FlashHacker News comment

      On the team's own benchmarks, every generation after Gemini 2.0 Flash costs more, runs slower, and improves only slightly, with some regressions.

      Published Jul 10, 2026self-described: Team benchmarks per use case

    Open them in the record
  5. Tool Use & Structured Output4 of 9 sources on it praise itHow reliably Gemini calls functions, returns schema-valid JSON, and stays on track in agent loops.

    Counted for Teams and technical leaders.

    Positive, 4

    1. Positive

      Amp team

      Gemini 3 Flash in the Search SubagentEngineering blog post, Amp

      Amp's codebase search subagent switched from Haiku 4.5 to Gemini 3 Flash, which runs 3 times faster at the same quality and fires about 8 parallel tool calls per iteration.

      Published Dec 17, 2025self-described: Amp coding agent, codebase search subagent

    2. Positive

      zbrw, Hacker News commenter

      Comment on: Use the Gemini API with OpenAI Fallback in TypeScriptHacker News comment

      JSON mode with a response schema works reliably in the team's production applications.

      Published Apr 7, 2025self-described: Production applications

    3. Positive

      Swift, Major League Hacking

      I got Jev to zero mistakes. I'm still using Flash-Lite.Engineering blog post, dev.to

      MLH measured Gemini Flash-Lite against a decision model on thousands of runs; Flash-Lite made zero dangerous routing calls and stays in production.

      Published Oct 8, 2026self-described: Major League Hacking, eval router in production for AI coding agent grading

    4. Positive

      OakNinja, Hacker News commenter

      Comment on: Gemini 3.5 FlashHacker News comment

      Running almost entirely on 3.1 and 2.5 Flash-Lite with guaranteed JSON output, the team reports 99.5% accuracy at low cost.

      Published May 19, 2026self-described: High-volume structured tasks

    Mixed or negative, 5

    1. Mixed

      SkyPuncher, Hacker News commenter

      Comment on: Everything we like is a psyop?Hacker News comment

      In an agentic product using all three frontier families, Gemini leads on reasoning and Flash on latency-sensitive steps, but it struggles with tool calling.

      Published Apr 17, 2026self-described: Agentic product using three frontier model families

    2. Mixed

      Agshin_Rajabov, Google AI Developers Forum member

      MALFORMED_FUNCTION_CALL finish reason happens too frequently with Vertex AIDeveloper forum post

      One system-prompt line about JSON escaping cut malformed function calls from about 15% to about 2% in the team's production agent.

      Published Mar 11, 2026self-described: Production with heavy function calling since mid-2025

    3. Mixed

      Chris Whatley, Google AI Developers Forum member

      Structured outputs in batch using OpenAI compatibility modeDeveloper forum post

      Moving batch workloads from OpenAI to Gemini through the OpenAI compatibility layer, the team found json_schema structured output works in real time but fails in the Batch API.

      Published Feb 24, 2026self-described: Team moving batch workloads from OpenAI to Gemini

    4. Mixed

      Amp team

      Opus 4.5: Better, Faster, Often CheaperEngineering blog post, Amp

      Amp made Gemini 3 Pro its main agent model and replaced it a week later, because rough edges turned into frustrating and costly behavior for users. Its table puts Gemini 3 Pro's off-the-rails cost at 17.8% against 2.4% for Opus 4.5.

      Published Nov 27, 2025self-described: Amp coding agent, main model in smart mode

    5. Negative

      03data2, Hacker News commenter

      Comment on: Update turns Google Gemini into a prude, breaking apps for trauma survivorsHacker News comment

      After an update, Gemini stops on certain chemicals in safety data sheets and returns invalid JSON even with a schema.

      Published May 10, 2025self-described: Extracting data from safety data sheets

    Open them in the record
  6. Developer Experience3 of 6 sources on it praise itHow the API, the Google Gen AI SDKs, the documentation, and AI Studio feel to build with.

    Counted for Teams and technical leaders.

    Positive, 3

    1. Positive

      progbits, Hacker News commenter

      Comment on: Google Gemini has the worst LLM APIHacker News comment

      Inside an existing Google Cloud setup, the startup used Vertex AI with no new vendor setup, where an outside service needed cards and legal review.

      Published May 4, 2025self-described: Startup already on Google Cloud

    2. Positive

      wsxiaoys, Hacker News commenter

      Comment on: Creating a Tab completion model from scratchHacker News comment

      The team fine-tuned Gemini Flash-Lite with LoRA for next-edit prediction, avoiding model infrastructure and getting faster responses at lower cost.

      Published Nov 20, 2025self-described: Tab completion edit model

    3. Positive

      lazypenguin, Hacker News commenter

      Comment on: Ingesting PDFs and why Gemini 2.0 changes everythingHacker News comment

      A fintech team replaced a specialist OCR vendor with Gemini for PDF ingestion after testing, because it worked with minimal effort.

      Published Feb 5, 2025self-described: Fintech PDF ingestion

    Mixed or negative, 3

    1. Mixed

      film42, Hacker News commenter

      Comment on: Claude Sonnet 4 now supports 1M tokens of contextHacker News comment

      Gemini 2.5 Pro beats Claude on price and uses far fewer tokens on PDFs, but dynamic QoS rate limits hit the team constantly and the Vertex SDK is awkward.

      Published Aug 12, 2025self-described: Customer invoice document processing

    2. Mixed

      O_P, Google AI Developers Forum member

      We need a logit_bias parameterDeveloper forum post

      Moving some company products from OpenAI to the Gemini API, and blocked on classification features that rely on OpenAI's logit_bias parameter.

      Published May 25, 2025self-described: Company moving some products from OpenAI to the Gemini API

    3. Negative

      egamirorrim, Hacker News commenter

      Comment on: Google Gemini has the worst LLM APIHacker News comment

      The team retries across every Vertex region to get past overloaded capacity, well under its quotas, and read timeouts cannot be configured.

      Published May 4, 2025self-described: Small development team on Vertex AI

    Open them in the record

What concerns them

Every concern practitioners raise, most raised first.

  1. Model ChangesAll 14 sources on it raise it as a concernRetirements, pre-release models withdrawn, behavior changes between versions, and the migration work they cause.

    Counted for Teams and technical leaders.

    1. Mixed

      Swaroop Chitlur, Lead, Generative AI Platform, DoorDash, with Siddharth Kodwani

      Building a GenAI Platform at DoorDashConference talk, InfoQ

      DoorDash runs Gemini beside OpenAI and Anthropic models behind one gateway. Its platform lead names cost at scale and Gemini's one-year model lifetime, which forces migrations across hundreds of use cases, as the cracks that followed.

      "Similarly, on the model side, we went vendor first. Let's use OpenAI, Anthropic, Gemini models. Folks started getting productive. Folks learned how to do prompt engineering. They were able to scale up. At DoorDash scale, at some point, cost becomes an issue. There were a few other cracks that started to appear. Like the one is the deprecation treadmill. How many of you know that Gemini has a one-year lifetime for models? In one year, the model gets shut down, and this applies to every new model. At the end of that one year, you have to switch to a newer model, whether or not it meets your business needs. I could probably accept that if I was a single product team and I was working on my product, but I as a platform team, I have to think about hundreds of use cases and how I'm going to drive hundreds of teams to migrate to the latest model without necessarily giving them a business argument of the benefits."
      Excerpt, Swaroop Chitlur

      Published Oct 3, 2026self-described: DoorDash's LLM Gateway, serving OpenAI, Anthropic and Gemini models to product teams across the company

    2. Negative

      correlator, Hacker News commenter

      Comment on: Gemini 3.7 FlashHacker News comment

      A platform that serves many frontier models found Gemini 2.5 Flash cheap and fast at launch. It now weighs dropping the Gemini family, because scrubbing stray thinking blocks from responses costs more engineering time than it is worth.

      Published Aug 14, 2026self-described: Platform serving models from several frontier labs for conversations and workflows

    3. Negative

      5701652400, Hacker News commenter

      Comment on: Gemini 3.6 Flash, 3.5 Flash-Lite, and 3.5 Flash CyberHacker News comment

      After two years of production on Gemini, the team is moving to DeepSeek because Google drops working models and charges far more for the replacements.

      Published Jul 21, 2026self-described: Production workloads on Gemini for 2 years

    4. Negative

      dacox, Hacker News commenter

      Comment on: Please don't discontinue Gemini 2.5 FlashHacker News comment

      Older Flash models were cheap and fast, but aggressive deprecation replaces them with reasoning models that are slower and much more expensive.

      Published Jul 10, 2026self-described: Fine-tuned workloads considered for Flash

    5. Negative

      ekidd, Hacker News commenter

      Comment on: Please don't discontinue Gemini 2.5 FlashHacker News comment

      On the team's own benchmarks, every generation after Gemini 2.0 Flash costs more, runs slower, and improves only slightly, with some regressions.

      Published Jul 10, 2026self-described: Team benchmarks per use case

    6. Negative

      zuzululu, Hacker News commenter

      Comment on: Please don't discontinue Gemini 2.5 FlashHacker News comment

      The company handles millions of requests a day on 2.5 Flash and Flash-Lite and finds nothing at that price, while Gemini 3 Flash is expensive.

      Published Jul 10, 2026self-described: Company workload, millions of requests a day

    7. Negative

      Ruthvik, Google AI Developers Forum member

      Gemini 2.5 Flash deprecated without warning earlier than shutdown dateDeveloper forum post

      Gemini 2.5 Flash returned 404 "no longer available" months before its published October 2026 deprecation date.

      Published Jul 9, 2026self-described: Critical workloads on Gemini 2.5 Flash

    8. Negative

      SeaSure, Google AI Developers Forum member

      Gemini model lifecycle is incompatible with production workloads, reconsidering provider choiceDeveloper forum post

      A pre-release Flash-Lite model in production saw rising 503s before a 14-day deprecation window, and the team is weighing a move off Gemini.

      Published May 11, 2026self-described: Enterprise production chat application

    9. Negative

      thraxil, Hacker News commenter

      Comment on: Qwen3.6-Plus: Towards real world agentsHacker News comment

      Removal of Gemini 2.0 Flash forces the team onto models at least 2.5x as expensive and slower, with no measurable gain for its tasks.

      Published Apr 2, 2026self-described: Basic app functionality on Gemini 2.0 Flash

    10. Mixed

      Radixqa_Test, Google AI Developers Forum member

      Clarification on Stable Replacement Models for gemini-2.5-flash and gemini-2.5-proDeveloper forum post

      Facing a deprecation date for 2.5 Flash and Pro, the team found the next models still pre-release and asked which stable models replace them.

      Published Mar 9, 2026self-described: Production environment on Gemini 2.5

    11. Mixed

      aymeric, Mercari Cross Border Engineering

      The Journey of User-Generated Content TranslationEngineering blog post, Mercari Engineering

      Mercari moved listing translation to Gemini on Google Cloud for higher pay-as-you-go rate limits and lower cost. Latency then rose after a forced move off a retiring Gemini model, a switch it made without A/B testing.

      Published Oct 12, 2025self-described: Mercari listing translation for the Mercari Global App, moved from GPT-4o mini on Azure to Gemini on Google Cloud

    12. Negative

      Shreyas, Google AI Developers Forum member

      Gemini 2.5 Flash Quality Degradation based on internal EvalsDeveloper forum post

      When the pre-release 04-17 Gemini 2.5 Flash was retired, the team's internal evals failed on the replacement, and quality swung by time of day on both AI Studio and Vertex AI.

      Published Jul 18, 2025self-described: Team with agents tuned on a pre-release Gemini 2.5 Flash

    13. Negative

      03data2, Hacker News commenter

      Comment on: Update turns Google Gemini into a prude, breaking apps for trauma survivorsHacker News comment

      After an update, Gemini stops on certain chemicals in safety data sheets and returns invalid JSON even with a schema.

      Published May 10, 2025self-described: Extracting data from safety data sheets

    14. Negative

      sanjay1, Google AI Developers Forum member

      Recent Gemini API Issues: Response Delays, 429 Errors, and Model InstabilityDeveloper forum post

      In production the team saw 429s under moderate traffic, delays and timeouts, inconsistent outputs, and higher latency after model updates.

      Published May 18, 2026self-described: Production application

    GILD's fact checks, which don't count as sources

    Checked Oct 12, 2026.Google lists each shutdown date as the earliest possible date and routes some retired Flash versions to their successors automatically. The pre-release Gemini 3.1 Flash-Lite was deprecated on May 11, 2026 and shut down on May 25, 2026, after its stable release on May 7. Gemini deprecations

    Open them in the record
  2. LatencyAll 11 sources on it raise it as a concernResponse time, throughput, and timing variance for interactive and batch work.

    Counted for Teams and technical leaders.

    1. Negative

      Scott Sykora, developer behind PartForge (Pixite Inc.)

      Why PartForge now defaults to Claude Sonnet 5.5Engineering blog post, PartForge

      PartForge replaced Gemini 3.8 Flash as its default model with Claude Sonnet 5.5 on October 20, 2026, as a trial. In PartForge's own tests Gemini 3.8 Flash took 143 seconds for a typical hard task and Sonnet 5.5 took 48 seconds.

      "New chats in PartForge now run on Claude Sonnet 5.5, replacing Gemini 3.8 Flash, which has been our default since September."
      Excerpt, Scott Sykora

      Published Oct 20, 2026self-described: PartForge, a chat product that designs CAD parts, with Gemini 3.8 Flash as its default since September 2026

    2. Mixed

      prathap chowdary, Google AI Developers Forum member

      High TTFT (~2s) with Gemini Flash vs ~150ms on GroqDeveloper forum post

      Vachan AI measured about 2.1 seconds to first token on Gemini 3 Flash against about 150 ms for Qwen on Groq, too slow for its real-time voice path.

      Published Apr 5, 2026self-described: Vachan AI, real-time voice AI platform

    3. Mixed

      dsjoerg, Hacker News commenter

      Comment on: Batch Mode in the Gemini API: Process More for LessHacker News comment

      Batch through BigQuery did not suit development, because responses could take up to 24 hours with no visibility into timing.

      Published Jul 11, 2025self-described: Batch jobs through BigQuery during development

    4. Positive

      Piotr Skalski, Roboflow

      Google Is Back! Gemini 4 Argon Leads Our Vision BenchmarkEngineering blog post, Roboflow

      Roboflow's vision benchmark puts Gemini 4 Argon first overall and about 6 times cheaper than GPT-6 Astra at low effort, though its requests averaged 13.4 seconds at that setting.

      Published Oct 15, 2026self-described: Roboflow's vision-language benchmark: object detection, segmentation, OCR, and video tests

    5. Negative

      dacox, Hacker News commenter

      Comment on: Please don't discontinue Gemini 2.5 FlashHacker News comment

      Older Flash models were cheap and fast, but aggressive deprecation replaces them with reasoning models that are slower and much more expensive.

      Published Jul 10, 2026self-described: Fine-tuned workloads considered for Flash

    6. Negative

      ekidd, Hacker News commenter

      Comment on: Please don't discontinue Gemini 2.5 FlashHacker News comment

      On the team's own benchmarks, every generation after Gemini 2.0 Flash costs more, runs slower, and improves only slightly, with some regressions.

      Published Jul 10, 2026self-described: Team benchmarks per use case

    7. Negative

      sanjay1, Google AI Developers Forum member

      Recent Gemini API Issues: Response Delays, 429 Errors, and Model InstabilityDeveloper forum post

      In production the team saw 429s under moderate traffic, delays and timeouts, inconsistent outputs, and higher latency after model updates.

      Published May 18, 2026self-described: Production application

    8. Negative

      thraxil, Hacker News commenter

      Comment on: Qwen3.6-Plus: Towards real world agentsHacker News comment

      Removal of Gemini 2.0 Flash forces the team onto models at least 2.5x as expensive and slower, with no measurable gain for its tasks.

      Published Apr 2, 2026self-described: Basic app functionality on Gemini 2.0 Flash

    9. Negative

      CSMastermind, Hacker News commenter

      Comment on: Getting a Gemini API key is an exercise in frustrationHacker News comment

      The API fails about 1% of the time, so retries are mandatory, and the same query takes from 30 seconds to 4 minutes.

      Published Dec 11, 2025self-described: Company using the Gemini API

    10. Mixed

      downsplat, Hacker News commenter

      Comment on: Getting a Gemini API key is an exercise in frustrationHacker News comment

      With about 10,000 calls a day, response times vary and random failures happen, so the team abstracts OpenAI, Gemini, and Mistral to switch quickly.

      Published Dec 11, 2025self-described: Text analysis at work, about 10,000 calls a day

    11. Mixed

      aymeric, Mercari Cross Border Engineering

      The Journey of User-Generated Content TranslationEngineering blog post, Mercari Engineering

      Mercari moved listing translation to Gemini on Google Cloud for higher pay-as-you-go rate limits and lower cost. Latency then rose after a forced move off a retiring Gemini model, a switch it made without A/B testing.

      Published Oct 12, 2025self-described: Mercari listing translation for the Mercari Global App, moved from GPT-4o mini on Azure to Gemini on Google Cloud

    GILD's fact checks, which don't count as sources

    Checked Oct 12, 2026.Priority inference, a pre-release tier, prioritizes traffic above the standard and Flex tiers at a premium price. Flex trades latency for a 50% discount. Priority inference

    Open them in the record
  3. Billing & Spend ControlAll 9 sources on it raise it as a concernSurprise bills, leaked keys, price increases between model generations, and how hard spending is to cap.

    Counted for Teams and technical leaders.

    1. Negative

      enginous, Hacker News commenter

      Comment on: Stolen Gemini API key racks up US$82,000 in 48 hoursHacker News comment

      Delays between incurring costs and alerts make a company-ending bill easy, which is why the author reaches for OpenAI before Gemini.

      Published Mar 3, 2026self-described: Small bootstrapped company

    2. Negative

      Joe Leon, security researcher, Truffle Security

      Google API Keys Weren't Secrets. But then Gemini Changed the Rules.Security research, Truffle Security blog

      Truffle Security found 2,863 live Google API keys in the November 2025 Common Crawl that could call Gemini because the Generative Language API had been enabled on their projects, including keys of banks, security firms and Google itself.

      "We identified 2,863 live Google API keys vulnerable to this privilege-escalation vector."
      Excerpt, Joe Leon

      Published Feb 25, 2026self-described: Scan of the November 2025 Common Crawl for live Google API keys that can call Gemini

    3. Negative

      simplyfaster, Google AI Developers Forum member

      Gemini API cost suddenly skyrocketedDeveloper forum post

      Gemini API cost spiked within minutes while the team's traffic was unchanged, so it deleted the key and sought support.

      Published Aug 23, 2025self-described: Production API key in Secret Manager

    4. Negative

      5701652400, Hacker News commenter

      Comment on: Gemini 3.6 Flash, 3.5 Flash-Lite, and 3.5 Flash CyberHacker News comment

      After two years of production on Gemini, the team is moving to DeepSeek because Google drops working models and charges far more for the replacements.

      Published Jul 21, 2026self-described: Production workloads on Gemini for 2 years

    5. Negative

      dacox, Hacker News commenter

      Comment on: Please don't discontinue Gemini 2.5 FlashHacker News comment

      Older Flash models were cheap and fast, but aggressive deprecation replaces them with reasoning models that are slower and much more expensive.

      Published Jul 10, 2026self-described: Fine-tuned workloads considered for Flash

    6. Negative

      ekidd, Hacker News commenter

      Comment on: Please don't discontinue Gemini 2.5 FlashHacker News comment

      On the team's own benchmarks, every generation after Gemini 2.0 Flash costs more, runs slower, and improves only slightly, with some regressions.

      Published Jul 10, 2026self-described: Team benchmarks per use case

    7. Negative

      zuzululu, Hacker News commenter

      Comment on: Please don't discontinue Gemini 2.5 FlashHacker News comment

      The company handles millions of requests a day on 2.5 Flash and Flash-Lite and finds nothing at that price, while Gemini 3 Flash is expensive.

      Published Jul 10, 2026self-described: Company workload, millions of requests a day

    8. Mixed

      thraxil, Hacker News commenter

      Comment on: Price per 1M tokens is meaninglessHacker News comment

      For large-input classification, Gemini 2.0 Flash at US$0.10 per million tokens, less with batch, was adequate; newer models cost significantly more.

      Published Jul 7, 2026self-described: Classification and extraction on 100,000-token inputs

    9. Negative

      thraxil, Hacker News commenter

      Comment on: Qwen3.6-Plus: Towards real world agentsHacker News comment

      Removal of Gemini 2.0 Flash forces the team onto models at least 2.5x as expensive and slower, with no measurable gain for its tasks.

      Published Apr 2, 2026self-described: Basic app functionality on Gemini 2.0 Flash

    GILD's fact checks, which don't count as sources

    Checked Oct 12, 2026.Since March 2026, monthly billing-account caps are US$250 on Tier 1 and US$2,000 on Tier 2. The API also offers experimental project spend caps. New accounts prepay, and requests stop at a zero balance. Billing data can lag about ten minutes, so batch jobs and agents can exceed a cap. Billing

    Open them in the record
  4. Reliability & CapacityAll 9 sources on it raise it as a concern503 overloaded errors, empty responses, stuck batch jobs, and outages.

    Counted for Teams and technical leaders.

    1. Negative

      Mais_Empenho_SaaS, Google AI Developers Forum member

      Persistent 37% UNAVAILABLE (503) on GenerateContent with gemini-3.6-flashDeveloper forum post

      Public-tender document analysis on Gemini 3.6 Flash saw a sustained 37% failure rate from 503 errors over 30 days on a paid Tier 1 project.

      Published Aug 28, 2026self-described: Automated public-tender document analysis

    2. Mixed

      scirob, Hacker News commenter

      Comment on: Qwen 3.8 27BHacker News comment

      Production runs Gemini Flash-Lite as the primary model and falls back to Qwen when Gemini servers are overloaded or return 429s.

      Published Aug 15, 2026self-described: German language benchmark index, production

    3. Negative

      lhm, Google AI Developers Forum member

      Tier 3 Project: Persistent 503 & 429 Errors in ProductionDeveloper forum post

      A Tier 3 production project saw recurring 503 and 429 errors for days without an incident report.

      Published May 6, 2026self-described: Production environment on a Tier 3 project

    4. Negative

      CSMastermind, Hacker News commenter

      Comment on: Getting a Gemini API key is an exercise in frustrationHacker News comment

      The API fails about 1% of the time, so retries are mandatory, and the same query takes from 30 seconds to 4 minutes.

      Published Dec 11, 2025self-described: Company using the Gemini API

    5. Negative

      kanwisher, Hacker News commenter

      Comment on: Improved Gemini 2.5 Flash and Flash-LiteHacker News comment

      The commenter's team dropped the Gemini API because it was too unreliable in production, however long they waited.

      Published Sep 25, 2025self-described: A team running the Gemini API in production

    6. Negative

      egamirorrim, Hacker News commenter

      Comment on: Google Gemini has the worst LLM APIHacker News comment

      The team retries across every Vertex region to get past overloaded capacity, well under its quotas, and read timeouts cannot be configured.

      Published May 4, 2025self-described: Small development team on Vertex AI

    7. Negative

      SeaSure, Google AI Developers Forum member

      Gemini model lifecycle is incompatible with production workloads, reconsidering provider choiceDeveloper forum post

      A pre-release Flash-Lite model in production saw rising 503s before a 14-day deprecation window, and the team is weighing a move off Gemini.

      Published May 11, 2026self-described: Enterprise production chat application

    8. Mixed

      downsplat, Hacker News commenter

      Comment on: Getting a Gemini API key is an exercise in frustrationHacker News comment

      With about 10,000 calls a day, response times vary and random failures happen, so the team abstracts OpenAI, Gemini, and Mistral to switch quickly.

      Published Dec 11, 2025self-described: Text analysis at work, about 10,000 calls a day

    9. Negative

      Shreyas, Google AI Developers Forum member

      Gemini 2.5 Flash Quality Degradation based on internal EvalsDeveloper forum post

      When the pre-release 04-17 Gemini 2.5 Flash was retired, the team's internal evals failed on the replacement, and quality swung by time of day on both AI Studio and Vertex AI.

      Published Jul 18, 2025self-described: Team with agents tuned on a pre-release Gemini 2.5 Flash

    GILD's fact checks, which don't count as sources

    Checked Oct 12, 2026.Google Cloud Standard PayGo uses shared capacity. A 429 does not mean the request hit a fixed quota. Google directs workloads with strict SLAs to Provisioned Throughput. Standard PayGo

    Open them in the record
  5. Rate Limits & TiersAll 8 sources on it raise it as a concern429 errors, usage tiers, quota mismatches, and the spend history needed to reach higher limits.

    Counted for Teams and technical leaders.

    1. Negative

      the_bigfatpanda, Hacker News commenter

      Comment on: Gemini 3.7 FlashHacker News comment

      After a year in production the author is moving off Gemini because Google wrongly downgraded and re-upgraded the account's usage tier.

      Published Aug 14, 2026self-described: Production workload for a year

    2. Negative

      TrustAI, Google AI Developers Forum member

      AI Studio shows Tier 1 limits while Billing shows Paid 2 + heavy 429 throttlingDeveloper forum post

      A production OCR pipeline was throttled at Tier 1 limits while the billing page showed a higher paid tier.

      Published May 20, 2026self-described: Production OCR and document digitization pipeline

    3. Negative

      sanjay1, Google AI Developers Forum member

      Recent Gemini API Issues: Response Delays, 429 Errors, and Model InstabilityDeveloper forum post

      In production the team saw 429s under moderate traffic, delays and timeouts, inconsistent outputs, and higher latency after model updates.

      Published May 18, 2026self-described: Production application

    4. Negative

      rozap, Hacker News commenter

      Comment on: Getting a Gemini API key is an exercise in frustrationHacker News comment

      The team kept hitting a 15 requests-per-minute quota while every quota page showed 0% usage, and importing the project into AI Studio failed silently.

      Published Dec 11, 2025self-described: Team project with a billing account

    5. Mixed

      film42, Hacker News commenter

      Comment on: Claude Sonnet 4 now supports 1M tokens of contextHacker News comment

      Gemini 2.5 Pro beats Claude on price and uses far fewer tokens on PDFs, but dynamic QoS rate limits hit the team constantly and the Vertex SDK is awkward.

      Published Aug 12, 2025self-described: Customer invoice document processing

    6. Mixed

      zapnuk, Hacker News commenter

      Comment on: Gemini Embedding: Powering RAG and context engineeringHacker News comment

      Gemini embeddings improved the team's classifier, but the API returned quota errors at about 150 requests a minute despite a far higher quota.

      Published Aug 1, 2025self-described: Embedding 6,000 documents for a classifier

    7. Mixed

      scirob, Hacker News commenter

      Comment on: Qwen 3.8 27BHacker News comment

      Production runs Gemini Flash-Lite as the primary model and falls back to Qwen when Gemini servers are overloaded or return 429s.

      Published Aug 15, 2026self-described: German language benchmark index, production

    8. Negative

      lhm, Google AI Developers Forum member

      Tier 3 Project: Persistent 503 & 429 Errors in ProductionDeveloper forum post

      A Tier 3 production project saw recurring 503 and 429 errors for days without an incident report.

      Published May 6, 2026self-described: Production environment on a Tier 3 project

    GILD's fact checks, which don't count as sources

    Checked Oct 12, 2026.Limits apply to the project as a whole; API keys do not have separate allowances. Tiers 2 and 3 depend on cumulative Google Cloud spend and days since the first payment, and spend-based limits of US$10, US$50, and US$200 per 10 minutes apply by tier. Rate limits

    Open them in the record
  6. Two Platforms & SetupAll 5 sources on it raise it as a concernThe split between AI Studio and Google Cloud, project and billing setup, and SDK changes.

    Counted for Teams and technical leaders.

    1. Mixed

      pants2, Hacker News commenter

      Comment on: Getting a Gemini API key is an exercise in frustrationHacker News comment

      Connecting the Gemini API at work was easy on an existing Google Cloud account, while a personal account hit confusing billing errors.

      Published Dec 11, 2025self-described: Work and personal accounts

    2. Negative

      CSMastermind, Hacker News commenter

      Comment on: Getting a Gemini API key is an exercise in frustrationHacker News comment

      No console showed all Gemini API keys and usage across the organization, so the company shares one key.

      Published Dec 11, 2025self-described: Organization-wide key management

    3. Mixed

      deaux, Hacker News commenter

      Comment on: Gemini 3.6 Flash, 3.5 Flash-Lite, and 3.5 Flash CyberHacker News comment

      The team runs Gemini in production products because it beats OpenAI and Anthropic models on cost, quality, latency, and adherence for those tasks, while calling Google's product side a mess.

      Published Jul 21, 2026self-described: Team with LLM-based applications in production

    4. Negative

      TrustAI, Google AI Developers Forum member

      AI Studio shows Tier 1 limits while Billing shows Paid 2 + heavy 429 throttlingDeveloper forum post

      A production OCR pipeline was throttled at Tier 1 limits while the billing page showed a higher paid tier.

      Published May 20, 2026self-described: Production OCR and document digitization pipeline

    5. Negative

      rozap, Hacker News commenter

      Comment on: Getting a Gemini API key is an exercise in frustrationHacker News comment

      The team kept hitting a 15 requests-per-minute quota while every quota page showed 0% usage, and importing the project into AI Studio failed silently.

      Published Dec 11, 2025self-described: Team project with a billing account

    GILD's fact checks, which don't count as sources

    Checked Oct 12, 2026.Google recommends the Gemini Developer API for most developers and the Gemini platform on Google Cloud for enterprise controls. Both now run through the same Google Gen AI SDK; moving to Google Cloud requires service-account authentication. Gemini Developer API vs. Gemini platform

    Open them in the record

Where the evidence agrees

Statements this group's sources agree on, then the ones close to agreement.

Close to agreement: each needs 17 supporting sources

  1. Below threshold

    Teams run their own evaluation set before adopting or switching Gemini models, since list prices and benchmarks do not predict results on their task.

    10 supporting sources
  2. Below threshold

    Teams keep another model provider in reach for overload errors, price changes, and retirements.

    10 supporting sources
  3. Below threshold

    Teams use Gemini through the API as the model behind their own agents, with tools and multi-step loops.

    9 supporting sources
  4. Below threshold

    Teams send high-volume, simple work to Flash-Lite or Flash and keep Pro or another model for hard cases.

    8 supporting sources
  5. Below threshold

    Teams pick Gemini, usually Flash or Flash-Lite, because its quality per dollar beat the alternatives on their workload.

    5 supporting sources

Where it disagrees

Questions the sources split on, with the count on each side.

  • Evidence remains mixed

    Should a team call Gemini with an AI Studio API key or through Google Cloud?

    • AI Studio API key, 5 sources

      Some call the Gemini Developer API with an AI Studio key, which takes seconds to set up and carries the free tier, prepaid billing, and per-project tiers.

    • Google Cloud, 9 sources

      Others call Gemini through Vertex AI, now the Gemini Enterprise Agent Platform, for service accounts, regions, Cloud billing, and Provisioned Throughput. Several moved there after 429s, 503s, or a depleted prepay balance.

The evidence

Whose experience this is

The three groups, then every practitioner by the context they work in, and how emphasis changes with scale.

Three groups drawn from the same sources. Choose a group to select whose experience counts. Within that group, each author counts once in the practitioner sentiment, with their latest view. Signals open on Teams and technical leaders.

  • Teams and technical leaders

    85 sources. These accounts focus on cost at production volume, model retirements, capacity, and which Google route teams buy through, from the accounts of teams and companies running Gemini in their products.

  • Individual builders

    109 sources. These accounts focus on billing, free-tier use, multimodal work, and setup for developers building on the API on their own.

  • All practitioners

    194 sources. This gives the broadest read, but combines side projects with production teams that can reach different conclusions.

194 sources from practitioners, by the context they work in. Filled rows count for this group.

  1. Individual builderDevelopers building on the platform on their own109 sources

    Emphasizes Surprise bills and multimodal value

  2. Small product team2 to 10 engineers, or an unnamed startup team49 sources, counted here

    Emphasizes Model retirements and price increases

  3. Product or platform team11 to 50 engineers, or a named company's team31 sources, counted here

    Emphasizes Cost at volume and the Google Cloud route

  4. Technical leadershipLeaders setting model and platform choices across teams3 sources, counted here

    Emphasizes Document extraction and coding quality, from CTOs and an AI research lead

  5. Organization-wideEnterprise or company-wide AI platform2 sources, counted here

    Emphasizes Gateways that run Gemini beside other providers, and the cost of Gemini's yearly model retirements

What changes with scale. Individual builders focus on surprise bills, many from leaked or old API keys, and Flash's value for images, audio, and documents. Teams focus more on retirements, price increases between Flash generations and task speed. Company-wide gateways at DoorDash and Wealthsimple run Gemini beside other providers, and most team accounts use Google Cloud.

Where the sources come from

Where this group's sources were published.

Counted for Teams and technical leaders, from 85 sources. Change group

111 sources for this group, 26 of them documentation

  • Developer Communities & Forums64, 58% of 111 sources
  • Product Documentation26, 23% of 111 sources
  • Engineering Blogs & Reviews19, 17% of 111 sources
  • Podcasts, Talks & Videos2, 2% of 111 sources

Older evidence stays when it still applies. Accounts tied to retired models, earlier tiers, or replaced SDKs remain in the history with a Needs a recheck label.

See sources by origin

The record

Who each source is, how it knows, whether it still applies and what it counts toward.

About this read

What changed, and how we count

What changed

  • Oct 30, 2026: a second-model check corrected 13 findings to what their pages say. GitHub's Copilot changelog now counts as a competitor's and counts toward no score, and it states only the May 20, 2026 removal from web chat. Cline's release notes no longer tie its default change to Argon's general release, a batch-job issue says the reporter linked two similar incidents, and Wealthsimple's author is named as the InfoQ article's author. Five records move to the cohort their pages support. PartForge, Truffle Security, Home Assistant and GitHub cards say only what their pages say. Home Assistant's installation counts now come from its analytics as read on Oct 31, 2026.
  • Oct 29, 2026: the 16 Reddit posts and GitHub issues added on October 28, the Latent Space episode and three benchmark posts now count toward no score, since GILD has not checked their authors' ties to Google. The Pydantic and Lindy records show their authors' identities as self-stated.
  • The evidence base uses public English-language sources dated 2025 or later. Each source links to the original page and names the author and publication date.
  • On October 12, 2026, GILD removed 24 sources for language, pre-2025 dates, or failed hand review. GILD added 13 from Hacker News and the Google AI Developers Forum to statements and a concern that fell short of 5 sources from 3 authors.
  • GILD shows a finding when at least 5 sources from 3 different authors discuss it. A disagreement needs at least 2 sources on each side.
  • The Gemini Developer API and Google Cloud route count as one Product. The record names the route each author used, including Vertex AI, now Gemini Enterprise Agent Platform.
  • Provider strategy is excluded as a disagreement because only 1 source standardizes on Gemini alone.
  • GILD checks documentation against Google's current Gemini API and Agent Platform pages.
  • Oct 25, 2026: added Feature Gaps, drawn from accounts already in the record: 5 report a feature they needed and could not get, mostly around structured output and batch.
  • Oct 25, 2026: added Accuracy, where 4 earlier accounts report hallucinated or misread output, or failed instruction tests.
  • Oct 25, 2026: adds 15 independent benchmark, engineering and personal blog, GitHub issue, and X sources.
  • Oct 26, 2026: adds ten accounts from Mercari, Roboflow, Amp, DEV, Reducto, Augment Code, Kilo, and a model-serving platform, archived the same way. The Flobotics CTO's role is as the company's own site states it.
  • Oct 25, 2026: added Long-Context Limits, Speed, and Stability from existing accounts and the new sources. 8 sources report long inputs read in part, handled worse, or failing, including Chroma's and NoLiMa's independent benchmarks. On speed, 10 praise Flash response time or throughput and 2 say newer models are slower. On stability, 4 say requests keep succeeding and 4 report errors, overload, or outages.
  • Oct 28, 2026: adds 31 records. They are a DoorDash conference talk and a Latent Space podcast episode with Pydantic's founder, each with its passage; team write-ups from Wealthsimple, PartForge, Lindy and Truffle Security; GitHub's changelog and Home Assistant's usage analytics; 14 Reddit posts and comments read through the Arctic Shift archive; 6 GitHub issues and release notes; 2 Hacker News comments and an X post. Four Reddit and X records come from a research set that sought out critical accounts and carry no stance, so they count toward no score. Leaders and teams now read 24 positive, 26 mixed and 26 negative; all sources read 52 positive, 48 mixed and 74 negative.

Method

A running review of what teams building AI features on Gemini API report, from individual builders to company-wide platforms. Each finding links to its sources, and each conflict shows both sides.

Counts cover only the sources GILD reviewed.

Who counts

Teams and technical leaders
Small product team, Product or platform team, Technical leadership, Organization-wide
Individual builders
Individual builder
All practitioners
Everyone in the teams and leaders and individual builders groups

Choose a group to select whose experience counts. Within that group, each author counts once in the practitioner sentiment, with their latest view. GILD files each source in a group from how the account describes its author. A role or employer marked self-described is what the source states about themselves. Documentation checks facts for every group and never counts toward sentiment.

How the numbers work

  • Overall signal. Positive votes minus negative ones, per 100 votes from the sources that take a side. Each author counts once, with their latest view, whoever they are and wherever they posted. The older weighted reading, where accounts GILD matched to a named person count three times when GILD lists the author among technical leaders and twice otherwise, is shown beside it as a second view. Where an author wrote more than one source, the line beside the split gives the votes, one per author, so the score follows from it. When one author's sources from the same day disagree, that author counts as mixed, and a half point rounds away from zero. Sources with no opinion are listed and not counted. Strong positive is +50 or higher, positive +20 to +49, mixed −19 to +19, negative −20 to −49, strong negative −50 or lower.
  • Weighted reading, second view. Counted the older way, where an account GILD matched to a named person counts two or three times, teams and leaders read +2 mixed (method sentiment/S1). GILD printed that number as "GILD score" until October 29, 2026; most of those matches rest on a name or a self-described role.
  • Method change, Oct 30, 2026. GILD changed how practitioner sentiment counts, to one vote per author. Weighted, it read +9 Mixed; with one vote per author it reads +6 Mixed. No evidence changed.
  • Unscored. A group gets a score only with 20 sources from 15 authors. Below that, one source moves the score about 5 points, so the read says "Unscored until 20 sources from 15 authors" and shows its counts.
  • Independence. A source whose author works for the vendor, for one of its partners or programs, or for a competitor, and a page the vendor published or ran, is listed with that tie and counts toward nothing. One author counts on at most two records per product. The line under the score says how many authors and how many separate discussions the counted sources come from: comments in one thread are one discussion.
  • Praise and concerns. How many of the sources that discuss a theme praise it or raise it.
  • Consensus. A statement joins when 20% of the group's sources support it and fewer contradict it. Contradicting sources are counted separately. Below that line a statement shows as building. At 40% or more it reads Strong agreement; below, Recurring point.
  • Disagreements. The count on each side. GILD names no winner and gives no share of all users.
  • Minimum evidence. A finding needs 5 sources from 3 authors; a disagreement also needs 2 on each side. Smaller counts stay in the table below, marked under the minimum.

Labels on a source

A source's date and whether it still applies are separate: a recent post can describe an old version, and an old one can still hold.

Documented
Stated in official documentation.
Reported
A practitioner's account of their own use.
Measured
Backed by the source's own measurements, such as a comparative test or tracked team metrics.
GILD analysis
GILD's check of a claim against official documentation.
Current
Describes the product as it is now.
Still applicable
Older, and the behavior or lesson still holds.
Needs a recheck
May depend on a plan, version or setting that changed since it was written. It keeps counting until GILD rechecks it, since the rest of the account usually holds, and its card says so.
Out of date
No longer accurate. Kept in the record; counts toward nothing current.

Flagged for a recheck, of the sources that take a side: teams and leaders 6 of 74, individual builders 18 of 83, all practitioners 24 of 157.

Limits

  • These figures count reviewed public accounts; they do not represent all Gemini API customers. Hacker News supplies 114 of the 194 sources from engineers and teams. Google's developer forum supplies 23 and Reddit 14, mostly problem reports, which tilts those posts negative. The other 43 are 23 engineering, personal and security blog posts, changelogs and usage reports, 9 GitHub issues and release notes, 5 X posts, 4 benchmarks, a DoorDash conference talk and a Latent Space podcast episode. The Reddit posts and GitHub issues added on October 28, the Latent Space episode and three benchmark posts are shown with their links and count toward no score, since GILD has not checked their authors' ties to Google.
  • Each source records the model, tier, and route its author names. Those details vary across accounts. Sources tied to retired models, pre-March 2026 tiers, replaced SDKs, or lifted limits carry the Needs a recheck label.

Every count, and the sources behind it

26 findings for 3 groups

Each row opens its sources for the group you are reading.

FindingTeams and technical leadersIndividual buildersAll practitionersSources
Current readCurrent sentiment24 positive, 25 mixed, 25 negative28 positive, 21 mixed, 34 negative52 positive, 46 mixed, 59 negativeSources
PraiseCost Efficiency16 of 17 positive15 of 15 positive31 of 32 positiveSources
PraiseMultimodal & Long Context13 of 13 positive10 of 14 positive23 of 27 positiveSources
PraiseModel Quality11 of 12 positive6 of 10 positive17 of 22 positiveSources
PraiseTool Use & Structured Output4 of 9 positive10 of 14 positive14 of 23 positiveSources
PraiseDeveloper Experience3 of 6 positive2 of 8 positive5 of 14 positiveSources
PraiseFree Tier0 of 0 positive (under the minimum)5 of 6 positive5 of 6 positiveSources
PraiseSpeed6 of 9 positive6 of 6 positive12 of 15 positiveSources
PraiseStability2 of 2 positive (under the minimum)2 of 6 positive4 of 8 positiveSources
ConcernBilling & Spend Control9 of 9 raise it18 of 18 raise it27 of 27 raise itSources
ConcernModel Changes14 of 14 raise it7 of 7 raise it21 of 21 raise itSources
ConcernRate Limits & Tiers8 of 8 raise it9 of 14 raise it17 of 22 raise itSources
ConcernReliability & Capacity9 of 9 raise it10 of 10 raise it19 of 19 raise itSources
ConcernTwo Platforms & Setup5 of 5 raise it10 of 10 raise it15 of 15 raise itSources
ConcernLatency11 of 11 raise it2 of 4 raise it (under the minimum)13 of 15 raise itSources
ConcernData Handling3 of 4 raise it (under the minimum)2 of 3 raise it (under the minimum)5 of 7 raise itSources
ConcernAccuracy2 of 2 raise it (under the minimum)4 of 4 raise it (under the minimum)6 of 6 raise itSources
ConcernFeature Gaps1 of 1 raise it (under the minimum)5 of 5 raise it6 of 6 raise itSources
ConcernLong-Context Limits4 of 4 raise it (under the minimum)5 of 5 raise it9 of 9 raise itSources
ConsensusEvaluate before choosing10 supporting (below threshold)7 supporting (below threshold)17 supporting (below threshold)Sources
ConsensusChosen on quality per dollar5 supporting (below threshold)7 supporting (below threshold)12 supporting (below threshold)Sources
ConsensusRoute by task8 supporting (below threshold)1 supporting (under the minimum)9 supporting (below threshold)Sources
ConsensusGemini runs their own agents9 supporting (below threshold)5 supporting (below threshold)14 supporting (below threshold)Sources
ConsensusTeams keep a fallback provider10 supporting (below threshold)5 supporting (below threshold)15 supporting (below threshold)Sources
DisagreementShould a team call Gemini with an AI Studio API key or through Google Cloud?AI Studio API key 5, Google Cloud 9AI Studio API key 4, Google Cloud 12AI Studio API key 9, Google Cloud 21Sources
Current readEvidence mix111 sources135 sources220 sourcesSources

Fact checks

GILD's checks of claims against official documentation, kept apart from the source counts.

  • Billing & Spend Control. Since March 2026, monthly billing-account caps are US$250 on Tier 1 and US$2,000 on Tier 2. The API also offers experimental project spend caps. New accounts prepay, and requests stop at a zero balance. Billing data can lag about ten minutes, so batch jobs and agents can exceed a cap. Billing, checked Oct 12, 2026
  • Model Changes. Google lists each shutdown date as the earliest possible date and routes some retired Flash versions to their successors automatically. The pre-release Gemini 3.1 Flash-Lite was deprecated on May 11, 2026 and shut down on May 25, 2026, after its stable release on May 7. Gemini deprecations, checked Oct 12, 2026
  • Rate Limits & Tiers. Limits apply to the project as a whole; API keys do not have separate allowances. Tiers 2 and 3 depend on cumulative Google Cloud spend and days since the first payment, and spend-based limits of US$10, US$50, and US$200 per 10 minutes apply by tier. Rate limits, checked Oct 12, 2026
  • Reliability & Capacity. Google Cloud Standard PayGo uses shared capacity. A 429 does not mean the request hit a fixed quota. Google directs workloads with strict SLAs to Provisioned Throughput. Standard PayGo, checked Oct 12, 2026
  • Two Platforms & Setup. Google recommends the Gemini Developer API for most developers and the Gemini platform on Google Cloud for enterprise controls. Both now run through the same Google Gen AI SDK; moving to Google Cloud requires service-account authentication. Gemini Developer API vs. Gemini platform, checked Oct 12, 2026
  • Latency. Priority inference, a pre-release tier, prioritizes traffic above the standard and Flex tiers at a premium price. Flex trades latency for a 50% discount. Priority inference, checked Oct 12, 2026
  • Data Handling. Google uses unpaid traffic, including AI Studio and free quota, to improve its products. Human reviewers can read it. Paid traffic is excluded from product improvement. Google keeps prompts and outputs for 55 days for abuse monitoring. Gemini API Additional Terms of Service, checked Oct 12, 2026