Short, sourced notes on cloud-exit economics and running boring, predictable infrastructure. A new one goes up most days — subscribe at the bottom so you don't miss it.
Grab the free checklist — the one-page guide to stopping a surprise cloud bill →
The recurring wisdom in every self-hosting thread isn't ideological — it's 'I host everything myself, except email and DNS.' That carve-out is the whole framework. Here's the honest per-service decision: move the things whose cost scales with your success, keep managed the things that are cheap to rent and painful to run.
A local open model for the boring bulk, the frontier API only for the hard 20% — one Reddit user calls it the 'turbo model.' It can cut an AI bill by ~90%. But the cost doesn't vanish; it moves from a per-token meter to fixed hardware, power, and your own time. Here's the real hardware cost, the break-even, and the three hidden charges that decide whether it actually saves you money.
The highest-leverage AI cost lever isn't caching or a cheaper model — it's not making the call at all. A sharp point from a SaaS-founder thread: people lazily use an LLM to DO tasks they should use an LLM to WRITE CODE to do. Doing the task is recurring metered compute; writing the code once is a capital investment that then runs for free. Here's when to reach for which.
During the MVP the AI bill looks harmless. Then the product works, usage grows, and the same prompts run millions of times. A SaaS-founder thread named the exact culprit: routing deterministic, repeatable jobs — extraction, classification, normalization — through the biggest, priciest models. Here is the list of tasks that quietly detonate, and what to send instead.
The recurring complaint about every cloud cost platform, from the people who actually run them: they give you visibility without the power to execute the fix. A dashboard names the idle box, the untagged sprawl, the open IAM gate — and then leaves them running. The maturity marker isn't a nicer chart; it's remediation. The same lesson the AI per-run breaker teaches, on the cloud side.
A Google Cloud user watched a $50-a-month account bill almost $20,000 in a single day. The 'billing cap' didn't stop it — the threshold rose as the spend rose, the card was charged in chunks, and when the card finally failed the servers kept running. This is not a bug. Cloud billing has no hard cap by design, and here's what actually stops the meter.
A FinOps engineer's question cuts to the core of agent cost control: most of the money a runaway agent burns is spent after the failure signal already fired. A bill-anomaly alert catches it a day late. The fix is a breaker that lives on the request path — at the gateway, per run — not on the invoice.
A developer asks why their GCP $300 trial and a $1,000 GenAI credit won't spend on Claude — and nobody can quite say. That confusion is the real story: free credits and split billing agreements hide what an AI call actually costs, so you're building on a meter you can't read — subsidized by someone else, with the real number deferred to later.
The reason startups run resources 24/7 and eat six-figure bills isn't that engineers are dumb — it's that cloud cost has no owner. One overworked person owns infra, security, on-call, and cost for five teams, and cost is the thing that quietly loses. The fix isn't another dashboard; it's an owner.
Day 4 of an AI cost + safety playbook. The gateway from Day 3 gave us a door; now we bolt on the first control — a global hard spend cap plus per-user quotas. Two different things, and you need both to turn Day 2's fail-open bill into one that fails closed.
Day 3 of an AI cost + safety playbook. Every control in this series — spend caps, quotas, caching, key vaulting, a kill switch — needs one place to live. That place is a gateway: a single proxy every LLM call passes through. It's a pattern you already know, and often a one-line change.
Day 2 of an AI cost + safety playbook. One LLM call is cheap; you go broke when the number of calls — or tokens per call — goes unbounded. Five ways that happens in real systems, each a fail-open default that keeps charging until something breaks.
This site runs self-hosted, cookieless Matomo, not Google Analytics. The reasoning is the same as everything else here: own the thing that matters, and don't rent your independence. What Matomo is and how it's used, an honest comparison to Google Analytics, when "free" Google becomes a liability (EU law, forced migrations, sampling), and the privacy-and-independence philosophy underneath — with the honest caveats about when GA still wins.
Day 1 of an AI cost + safety playbook, in the open. LLM calls are billed per token — input and output priced separately, and output runs 3–5× higher. Here's why, the two dials on every call (how much it says, how much it reads), and the arithmetic worked on real prices.
An LLM API is metered per token, uncapped by default, and fails open — to your wallet. Worse than cloud in three ways: the meter runs faster, the endpoint is built to accept anything from strangers, and your AI can be turned against you. Here's what fail-closed looks like for AI.
Every 'surprise AWS bill' story shares one root cause nobody names: the account has no ceiling. Unlimited postpaid billing is the default, it fails open — to your wallet — and it scales from a student's $1,100 to a funded startup's six-figure weekend. Why the default is reckless, and the fail-closed alternative.
A surprise AWS bill — a resource left running, or a leaked key someone abused — is one of the most common panics in cloud. Here's how to ask AWS to waive a first-time accidental bill (it works more often than you'd think), and the six guardrails that stop it happening again.
The follow-up to the CloudWatch per-scan post: the exact self-hosted setup that replaces it — Grafana + Loki on a flat-rate box where queries are free — with the hardware, a docker-compose to copy, the migration path, and the real savings.
Amazon CloudWatch Logs Insights bills per gigabyte your queries scan, not per gigabyte you store — so an always-on dashboard on auto-refresh quietly becomes a metered query loop that can cost more than the rest of your logging combined. Here's the trap, how to spot it on your bill, and the fix.
Most SaaS teams go hunting for an extra $100k in revenue. At any real scale, that money is usually already in your AWS/Azure/GCP bill as pure waste — across four predictable line items. Here's where it hides and how to find yours in an afternoon.
A SaaS founder's Google Cloud bill jumped from ~$200/month to ~$55,000 in a single billing cycle — one public Firebase API key, abused against the Gemini API. Here's exactly how it happens, how to fight the charge, and the five settings that cap it for good.
Storage and compute have list prices you can shop on. Egress is the line that quietly scales with your success — and it's the one almost nobody budgets for. Here's how to find it on your own bill in five minutes.
I publish honest, sourced breakdowns of cloud-exit economics — egress, storage, monitoring, reliability — and the occasional announcement. Leave your email and I'll let you know when something new goes up.
Double opt-in — you'll get one email to confirm. No spam, unsubscribe anytime. Read by me, never shared.