06 · Competing in an OpenRouter world

The router weights price by its inverse square.

By OpenRouter's published default, providers with a recent outage are skipped and the rest are weighted by 1 / price². One third the price is nine times as likely to be routed to first. Every point of utilization is cost per token you can keep as margin or pass on as price.

85%
60%100% · same price

Illustration of the published default weighting only: four providers, no recent outages, identical except price. Latency and throughput order providers only when the caller asks for them.

You
Rival A
Rival B
Rival C
Share of first-choice routing. You are as likely to be picked as each rival.
More traffic, same fleet

More concurrent tenants and longer contexts before turning traffic away or adding accelerators.

Lower cost per token

Recovered utilization gives room to price lower on the router, or to keep price and take the margin.

Stay out of the outage filter

More requests from the same memory keeps capacity rejections from dropping you when demand peaks.

Your endpoint, untouched

API contract, model versions and fleet topology stay as your router listing depends on them.

Start with an answer, not an install

Find out whether memory is costing your fleet.

The first step puts nothing in your request path: a couple of weeks of counters your serving engine already keeps, and a written answer. Then we confirm it on your own traffic, on your own hardware, against your current configuration.