GPT-4.1 (batch)
Timed at 82.7 tok/s, on 6 Design Arena boards, with results on 1 openly licensed board, and not scored by Artificial Analysis.
retrieved sha256 · 0bb53a77713f
Measured speed
15,792 requests · 3 endpoints · 30-minute windowOpenRouter's own timing of its routed traffic, weighted by requests, over one 30-minute window read . Every route is on the endpoint ledger below.
Every endpoint
3 priced · 3 timed · cheapest first- Azureazure$2.00$8.00$0.50not declared943k111 tok/s62.11.31s486 req100%
- Azureazure$2.00$8.00$0.50not declared943k41 tok/s261.71s1,744 req100%
- OpenAIopenai$2.00$8.00$0.50not declared33k87 tok/s49882ms13,562 req100%
Each track runs from a route's p90, the rate nine in ten of its requests met or beat, up to its median. Weighted by requests, the figure above reports where the traffic went rather than what one route does: 1 of the 3 timed routes are slower than it, and the middle route runs at 87 tok/s. The widest median-to-p90 gap is Azure's, 1.79x.
Uptime is OpenRouter's own figure for each seller over the trailing day, read once a day, and the column prints the latest reading, taken . 1 of the 3 sellers with a reading fell under 99% on at least one of the 23 days held, 23 Oct 2026 to 21 Nov 2026: OpenAI at 97.70% on 10 Nov 2026. Source: OpenRouter's public endpoints API, one reading a day for each seller: 1,211 sellers carried one on the latest of the 23 days held.
Source: OpenRouter's public endpoints API. 1257 sellers across 359 models when the mirror ran, 186 of them served by more than one. List prices, not what anybody paid; a discount is the seller's own. Read . Speed is OpenRouter's own timing over one 30-minute window, read .
What each seller accepts
9 parameters · 2 sellers- response_formatevery seller
- seedevery seller
- structured_outputsevery seller
- temperatureevery seller
- tool_choiceevery seller
- toolsevery seller
- top_pevery seller
- max_completion_tokens1 of 2not OpenAI
- max_tokens1 of 2not Azure
7 of these 9 are accepted by every one of the 2 sellers that publish a list; the other 2 are declared by some sellers and not others, so what a request sending one of them gets depends on which seller serves it. Each list is the seller's own declaration in OpenRouter's endpoints API, read , and nothing here tested one.
Price position
342 priced modelsBlended $1.75 per million tokens, 3 in to 1 out: cheaper than 111 of the 342 priced models in the catalog. Each bar is one stretch of the catalog on a logarithmic price scale; the mark is this listing.
Measured quality
145 models with an index · 132 on a design arena boardEach mark is one board this model stands on, placed at the share of that board it scores above, and led to its number in the list under the rule. The columns and the ledger below carry the figures.
- 3D scenes · Models830 Elowin rate 30.9% · source rank 136the board, 113 ranked
- Code · Models1014 Elowin rate 50.9% · source rank 128the board, 120 ranked
- Data visualisation · Models1104 Elowin rate 59.5% · source rank 99the board, 110 ranked
- Game development · Models1068 Elowin rate 59.1% · source rank 111the board, 120 ranked
- UI components · Models989 Elowin rate 49.7% · source rank 124the board, 116 ranked
- Websites · Models1029 Elowin rate 52.3% · source rank 130the board, 126 ranked
Position 139 of the 258 models Epoch has placed, which is not the population of either board above, on a scale anchored at Claude 3.5 Sonnet 130 and GPT-5 150. Epoch states that absolute values are meaningless by themselves and that comparisons between models are what the index is for, that values are not linearly related to benchmark accuracy, and that a highly specialised model may score low while being capable in its own domain.
Benchmark results
1 of 6 boards · 1 result| Task | Score |
|---|---|
| polyglot pass rate | 52.40 |
Percent of 225 Exercism exercises solved with a second attempt allowed, higher is better. The id carries the edit format, because the publisher says a model alone does not identify a run. Aider polyglot names this run gpt-4.1 (diff), with no effort setting written on it. Read from raw.githubusercontent.com ↗, which dates its own data . Aider polyglot benchmark, Apache-2.0, by the Aider project. Results are submitted by contributors rather than produced by the publisher.
1 of the 6 openly licensed boards Vitna mirrors carries a result for GPT-4.1 (batch), each printed as its publisher published it and none added to another. Epoch AI Benchmarking Hub, MTEB, LiveBench, HELM and Vectara hallucination leaderboard have not published one under a name that matches its listing, and names are matched to the catalog exactly and never guessed. A task that is a link opens its column on /capability, with every run scored on it. Every board, with its licence and what its publisher measures, is on /benchmarks.
Source: OpenRouter (openrouter.ai/models), as of 17 Nov 16:29 UTC. sha256 0bb53a77713f over 853,270 bytes.
Catalog: OpenRouter's public model list.
Intelligence, coding and agentic indexes: Artificial Analysis, as published by OpenRouter.
Elo, win rate and rank: Design Arena, as published by OpenRouter.
Source: the Epoch AI Capabilities Index (epoch.ai/eci), as of 20 Nov 2026. 258 models placed over 2917 benchmark results.
Epoch AI Benchmarking Hub data, by Epoch AI, under CC BY 4.0.
Vitna ran none of these evaluations and adjusted none of these figures.
