The AI boom is quietly making your cloud bill bigger too
For about a decade, the cloud got cheaper almost every year — a steady drip of price cuts and new, cheaper instance types you could count on. That era is over. And the thing that ended it is the same thing running up your token bill: the AI buildout.
The evidence, from people who buy this stuff
A recent r/devops thread on cloud-vs-on-prem turned, unprompted, into a pile-up of the same observation from different people:
- Hardware has spiked. One commenter put a 1RU server at ”~$50k now, forecast $100k by year end”; another said hardware costs have “tripled since 2022,” with DRAM and NAND leading the way. GPUs you already know about.
- The price cuts have stopped. As one put it, “the days of AWS announcing price decreases are long gone.” The hyperscalers are pouring hundreds of billions into AI datacenters and GPUs — and that capex gets recouped from customers, not absorbed out of kindness. Older hardware costs more to run, capacity is tight, and everyone’s competing for the same silicon.
- Increases are coming. Some in the thread expect them to be steep — one floated “3–5× for AWS and Azure in the next 18 months.”
The decade of cloud getting cheaper every year is over.
Take that 3–5× as a Reddit guess, not a forecast — I won’t put a number on it. But the direction is not in doubt: cloud pricing pressure is up, for the first time in the platform era. If your five-year infrastructure plan quietly assumes “cloud keeps getting cheaper,” it’s built on an assumption that just stopped being true.
Why this is one problem, not two
Here’s the part that matters for anyone reading both halves of this site — the cloud posts and the AI posts. This trend reprices both meters upward at once:
- Your cloud meter costs more per unit. Every wasteful gigabyte of egress, every idle box, every over-provisioned instance doesn’t just get bigger as you grow — it gets more expensive per unit on top. The waste you shrugged off at old prices starts to bite. Controlling the meter isn’t a nice-to-have you can defer until “later, when there’s time” — later is more expensive than now.
- Your AI meter is the same story, sharper. The token prices you’re building on are venture-subsidized — below what it costs to serve you. As the buildout has to start paying for itself, that subsidy erodes: the uncapped meter gets more expensive per token and most teams still aren’t watching it. Rising unit price on an unwatched meter is exactly how a surprise bill gets bigger.
It’s one meter problem wearing two coats. The AI boom is the common cause, and it’s making both halves more urgent, together.
The move is the same on both meters: get off the part that’s about to reprice
You don’t fight a rising per-unit price by using slightly less of it. You get off the metered part where you can:
- On cloud: move the traffic- and storage-heavy pieces onto a flat-rate rented box (OVH, Hetzner) that locks a price for its term. A per-gigabyte meter reprices; a flat monthly rent doesn’t. You insulate the biggest, fastest-growing lines from the hikes entirely.
- On AI: put a hard cap and per-user quotas on spend, so a rising token price can’t quietly compound into a rising bill. You can’t lock the vendor’s per-token price, but you can lock your total.
One honest caveat, because the same thread makes it: on-prem isn’t magically immune — hardware got more expensive too, so buying a server into a closet isn’t the escape. The escape is a flat-rate rented box (someone else owns and maintains the hardware; you pay a fixed price) for the steady, meter-heavy workloads — and hard caps on the AI spend. The point was never “flee to a closet.” It’s stop standing on the two meters that are about to go up.
If your cloud and AI bills are both riding meters that are about to reprice upward, moving the heavy parts to flat rate and capping the rest is exactly what I do — for both. Every message comes straight to me — I read and reply to each one myself, usually within a day, and what readers send shapes what I build next. It’s just me for now, so that’s genuinely true; it won’t be forever. Send me your setup and I’ll show you which lines are most exposed to the hikes — free, within a business day.