Your first $5 becomes $15Get started

The nRouter Blog

Notes on shipping reliable LLM infrastructure.

Engineering, product, and company posts from the nRouter team. What we shipped, why we built it that way, and the trade-offs we made along the way. Code-first, cost-honest, no vendor-marketing fluff.

Browse all postsBrowse by tag
01
Product
Features & releases·9
02
Engineering
Architecture & internals·13
03
Comparison
How we compare·13
04
Guides
How-tos & best practice·16
All posts

Browse the catalog

Filter by category, or browse the full archive of deep-dives.

63 posts found
Guardrails on Every Request, Not Gated Behind Enterprise
Engineering

Guardrails on Every Request, Not Gated Behind Enterprise

PII redaction and prompt-injection detection only protect you if they run on every call. Here is how nRouter applies guardrails inline, with key > team > org scope precedence, on every tier.

Nemo Team
9 min
The Four Ceilings Every LLM Request Passes
Guides

The Four Ceilings Every LLM Request Passes

Before an LLM call leaves the gateway it clears four independent limits: credit balance, budget cap, rate limit, and guardrails. Here is what each one checks and why they are separate.

Nemo Team
8 min
Reserve-and-Settle: Never Overspend a Credit Balance
Engineering

Reserve-and-Settle: Never Overspend a Credit Balance

Checking a balance after a call is too late under concurrency. Here is the reserve-and-settle pattern nRouter uses to make credit caps exact, even when thousands of requests race for the last dollar.

Nemo Team
10 min
How to Set Hard Spend Limits on Your LLM Gateway
Guides

How to Set Hard Spend Limits on Your LLM Gateway

A runaway agent or leaked key can burn thousands in hours. Here is how hard budget caps, soft alerts, and reserve-and-settle stop the bleeding on an LLM gateway — before the invoice arrives.

Nemo Team
9 min
Cost Honesty: We Read the Number, We Don't Invent It
Company

Cost Honesty: We Read the Number, We Don't Invent It

The most important number in an LLM gateway is the cost, and the easiest one to fudge. Our principle: read the provider's authoritative cost, never compute a convenient one. Here is why that shapes everything.

Nemo Team
7 min
Why We Ban Mocks and Demo Mode
Company

Why We Ban Mocks and Demo Mode

No IS_MOCK flag, no DEMO_MODE, no fake data path. Every code path hits real services, even in demos. Here is why that engineering rule makes the product more honest and the bugs easier to catch.

Nemo Team
7 min
Why We Don't Do BYOK
Company

Why We Don't Do BYOK

"Bring your own key" sounds customer-friendly. We chose the opposite: you get a nRouter key and credits, we manage every provider key. Here is the reasoning behind that decision.

Nemo Team
7 min
Markup-Free LLM Credits: You Keep 100%
Product

Markup-Free LLM Credits: You Keep 100%

Most gateways quietly take a cut of every token. nRouter charges a platform fee on top at purchase and gives you 100% of your credits. Here is why that pricing model is more honest — and cheaper at scale.

Nemo Team
7 min
Multimodal Cost Safety: Image, Video, and Audio Floors
Product

Multimodal Cost Safety: Image, Video, and Audio Floors

Image, video, and audio models don't price like text — and a $0 cost reading is a silent revenue leak. Here is how reserve floors and zero-cost gating keep multimodal spend safe.

Nemo Team
8 min

Stay in the loop

Get every new post by email

One email when a post lands — no digests, no marketing, no tracking pixels. Or wire it into your reader with the RSS feed.

Subscribe by emailRSS feed

Atom + RSS available · unsubscribe one-click