o3
Timed at 66 tok/s, on 5 Design Arena boards, with results on 1 openly licensed board, and not scored by Artificial Analysis.
retrieved sha256 · 0bb53a77713f
The maker's own list price, read from developers.openai.com. OpenRouter's rate is its routed rate across whichever sellers it uses, and the two need not agree.
Measured speed
203 requests · 1 endpoint · 30-minute windowOpenRouter's own timing of its routed traffic, weighted by requests, over one 30-minute window read . Every route is on the endpoint ledger below.
Every endpoint
1 priced · 1 timed · cheapest first- OpenAIopenai · listed$2.00$8.00$0.50not declared100k66 tok/s34.22.26s203 req100%
Uptime is OpenRouter's own figure for each seller over the trailing day, read once a day, and the column prints the latest reading, taken . The one seller with a reading was at 99% or better on each of the 23 days held. Source: OpenRouter's public endpoints API, one reading a day for each seller: 1,211 sellers carried one on the latest of the 23 days held.
Source: OpenRouter's public endpoints API. 1257 sellers across 359 models when the mirror ran, 186 of them served by more than one. List prices, not what anybody paid; a discount is the seller's own. Read . Speed is OpenRouter's own timing over one 30-minute window, read .
What each seller accepts
8 parameters · 1 seller- include_reasoningevery seller
- max_tokensevery seller
- reasoningevery seller
- response_formatevery seller
- seedevery seller
- structured_outputsevery seller
- tool_choiceevery seller
- toolsevery seller
The one seller that publishes a list accepts these 8. Each list is the seller's own declaration in OpenRouter's endpoints API, read , and nothing here tested one.
Price position
342 priced modelsBlended $3.50 per million tokens, 3 in to 1 out: cheaper than 66 of the 342 priced models in the catalog. Each bar is one stretch of the catalog on a logarithmic price scale; the mark is this listing.
Measured quality
145 models with an index · 132 on a design arena boardEach mark is one board this model stands on, placed at the share of that board it scores above, and led to its number in the list under the rule. The columns and the ledger below carry the figures.
- Code · Models1008 Elowin rate 51.9% · source rank 129the board, 120 ranked
- Data visualisation · Models1200 Elowin rate 48.1% · source rank 60the board, 110 ranked
- Game development · Models1023 Elowin rate 56.9% · source rank 124the board, 120 ranked
- UI components · Models1005 Elowin rate 53.3% · source rank 123the board, 116 ranked
- Websites · Models1027 Elowin rate 53.8% · source rank 131the board, 126 ranked
Position 85 of the 258 models Epoch has placed, which is not the population of either board above, on a scale anchored at Claude 3.5 Sonnet 130 and GPT-5 150. Epoch states that absolute values are meaningless by themselves and that comparisons between models are what the index is for, that values are not linearly related to benchmark accuracy, and that a highly specialised model may score low while being capable in its own domain.
Benchmark results
1 of 6 boards · 2 results| Task | Effort | Score |
|---|---|---|
| polyglot pass rate | high | 81.30 |
| unstated | 76.90 |
Percent of 225 Exercism exercises solved with a second attempt allowed, higher is better. The id carries the edit format, because the publisher says a model alone does not identify a run. Aider polyglot names these runs o3 (high) (diff) and o3 (diff), and the effort beside each score says which run it is, unstated where the publisher wrote none. Read from raw.githubusercontent.com ↗, which dates its own data . Aider polyglot benchmark, Apache-2.0, by the Aider project. Results are submitted by contributors rather than produced by the publisher.
1 of the 6 openly licensed boards Vitna mirrors carries a result for o3, each printed as its publisher published it and none added to another. Epoch AI Benchmarking Hub, MTEB, LiveBench, HELM and Vectara hallucination leaderboard have not published one under a name that matches its listing, and names are matched to the catalog exactly and never guessed. A task that is a link opens its column on /capability, with every run scored on it. Every board, with its licence and what its publisher measures, is on /benchmarks.
Source: OpenRouter (openrouter.ai/models), as of 17 Nov 16:29 UTC. sha256 0bb53a77713f over 853,270 bytes.
Catalog: OpenRouter's public model list.
Intelligence, coding and agentic indexes: Artificial Analysis, as published by OpenRouter.
Elo, win rate and rank: Design Arena, as published by OpenRouter.
Source: the Epoch AI Capabilities Index (epoch.ai/eci), as of 20 Nov 2026. 258 models placed over 2917 benchmark results.
Epoch AI Benchmarking Hub data, by Epoch AI, under CC BY 4.0.
Vitna ran none of these evaluations and adjusted none of these figures.
