• Writing
  • Work
  • Activity
  • Contact

Mike Garite

ok@mikeg.meResume
  • GitHub (opens in a new tab)
  • LinkedIn (opens in a new tab)
Writing/Product

When Serving Agents Costs More Than They Earn

Grok Bot hit a unit-economics wall in early November. Usage limits tightened because serving costs outran revenue. The lesson is broader than one product: agent systems fail first as businesses, not as demos.

November 2, 20263 min read

Over Halloween weekend in 2026, some Grok Bot users found their weekly usage limits maxed out even when they had not been working overnight. On November 1, Elon Musk confirmed it was not a glitch. TechCrunch reported his reply: the cost of serving Grok Bot was unsustainably high relative to revenue.

That is an uncomfortable sentence for anyone building agents. The demos look like capability problems. The failures that matter often look like cost, latency, and margin problems.

What the numbers around the product say#

According to that same reporting, SpaceX had said in a filing the previous month that AI made up about 52% of company income. The renamed Super Intelligence division turned a profit of about $431 million, reduced by roughly $1.2 billion in one-time costs tied to the Cursor acquisition. Musk had also called Grok Bot the fastest-growing product he had ever seen.

Growth and unit economics can both be true at once. A product can feel inevitable to users and still lose money on every heavy session. Agents make that gap wider because a successful interaction is not one completion. It is tools, retries, computer use, long context, and follow-up turns.

Pricing is catching up to the stack#

The commercial surface around Grok is consolidating. The X Subscription bundles Grok, Grok Bot, Cursor, and X Premium into one plan, with usage pools shared across Grok and Cursor and higher tiers for more usage. Extra usage is billed at API list prices through top-ups.

On the voice side, Grok Voice 3.0 launched on October 14, 2026 at $0.08 per minute, the same price as the prior generation, while ranking first on Artificial Analysis's Speech-to-Speech Index. Capability can improve without a price cut. Serving cost still has to fit inside the subscription and the API bill.

None of that makes the throttle surprising. It makes it predictable.

What I take from it as a builder#

I care about this less as platform gossip and more as a design constraint.

Measure cost per completed task, not per token. Tokens are an input. The business cares whether a bot finished the job, how many model calls and tool calls it burned, and whether a human had to intervene. If you only watch token spend, you will miss the expensive loops.

Put budgets next to permissions. Teams already decide what an agent may touch. They should also decide what it may spend. A bot that can shop, browse, and spin cloud agents without a spend ceiling will find the ceiling for you.

Own the parts of the stack where cost and privacy meet. Running some inference on hardware you control does not solve every problem, but it makes the tradeoffs visible. You can see memory, context windows, idle timeouts, and queue depth. Hosted APIs hide those details until the invoice arrives. Privacy of sensitive work is a lighter reason for the same instinct: keep the hot path somewhere you can inspect.

Design for graceful degradation. When limits tighten, the product should degrade into a clear, useful mode. Silent max-outs feel like breakage. Explicit budgets, queued work, and cheaper routes feel like operations.

The product lesson#

Agent products fail in public when the model is wrong. They fail quietly when the serving cost is wrong. The November throttle is a reminder that a bot that can do useful work is not finished until the work has a price the business can sustain.

If you are shipping agents into real workflows, put unit economics on the same checklist as tools, memory, and review. Capability without a sustainable cost curve is a demo with a delayed outage.

Tagged

  • Agents
  • AI
  • Product
  • Business
  • Infrastructure
← PreviousWhat to Do with AdjustmentsNext →Interoperability That Touches the Workflow

Related

  1. November 9, 2026·Design

    Talk to the Agent While It Works→

    Cursor and Google both shipped two-way voice for coding agents in the same week. The interesting part is not speech. It is what the interface has to become when an agent runs for a long time.

    Agents · AI · Design systems · Front-end3 min read

  2. November 8, 2026·Leadership

    Sales Should Be Talking to High-Level Engineering→

    Deals increasingly turn on how a company runs agents, data, and delivery systems. The useful sales motion is not a louder pitch. It is a better conversation with the engineers who can evaluate the real architecture.

    Careers · Leadership · Business · Agents3 min read

  3. November 1, 2026·Product

    What to Do with Adjustments→

    Returns, refunds, chargebacks, and price adjustments are not edge cases. They are a large share of ecommerce economics. Here is a practical way to handle them without training customers to abuse the policy or punishing honest ones.

    Business · Product · Data · AI3 min read