GPT-4o (2024-05-13)
Timed at 58 tok/s, scored 24.2 on the Coding Index, and with results on 1 openly licensed board.
retrieved sha256 · 0bb53a77713f
Measured speed
5 requests · 1 endpoint · 30-minute windowOpenRouter's own timing of its routed traffic, weighted by requests, over one 30-minute window read . Every route is on the endpoint ledger below.
Every endpoint
1 priced · 1 timed · cheapest first- Azureazure · listed$5.00$15.00not listednot declared4k58 tok/s37.61.22s5 req100%
Uptime is OpenRouter's own figure for each seller over the trailing day, read once a day, and the column prints the latest reading, taken . 1 of the 2 sellers with a reading fell under 99% on at least one of the 23 days held, 23 Oct 2026 to 21 Nov 2026: OpenAI at 0.00% on 25 Oct 2026. Source: OpenRouter's public endpoints API, one reading a day for each seller: 1,211 sellers carried one on the latest of the 23 days held.
Source: OpenRouter's public endpoints API. 1257 sellers across 359 models when the mirror ran, 186 of them served by more than one. List prices, not what anybody paid; a discount is the seller's own. Read . Speed is OpenRouter's own timing over one 30-minute window, read .
What each seller accepts
15 parameters · 1 seller- frequency_penaltyevery seller
- logit_biasevery seller
- logprobsevery seller
- max_completion_tokensevery seller
- presence_penaltyevery seller
- response_formatevery seller
- seedevery seller
- stopevery seller
- structured_outputsevery seller
- temperatureevery seller
- tool_choiceevery seller
- toolsevery seller
- top_logprobsevery seller
- top_pevery seller
- web_search_optionsevery seller
The one seller that publishes a list accepts these 15. Each list is the seller's own declaration in OpenRouter's endpoints API, read , and nothing here tested one.
Price position
342 priced modelsBlended $7.50 per million tokens, 3 in to 1 out: cheaper than 27 of the 342 priced models in the catalog. Each bar is one stretch of the catalog on a logarithmic price scale; the mark is this listing.
Measured quality
145 models with an index · 132 on a design arena boardNot ranked in any Design Arena category.
Epoch AI has not placed GPT-4o (2024-05-13) on its Capabilities Index, or places it under a name the pairing does not reach. Epoch places a model once four of its benchmarks carry a result.
Benchmark results
1 of 6 boards · 3 results| Task | All runs | Score |
|---|---|---|
| GPQA diamond | 342 | 0.49 |
| MATH level 5 | 108 | 0.51 |
| OTIS Mock AIME 2024-2025 | 319 | 0.06 |
Mean accuracy, 0 to 1, on the task the row names, as Epoch AI runs it and averaged over repeated runs. All eighteen of their tasks, including the held-out FrontierMath tiers, named as they name them. The model id carries the effort setting the run used. Epoch AI Benchmarking Hub names this run gpt-4o-2024-05-13, with no effort setting written on it. All runs is how many runs the publisher scored on the task, every model's. Read from epoch.ai ↗, which dates its own data . Epoch AI Benchmarking Hub data, by Epoch AI, under CC BY 4.0.
1 of the 6 openly licensed boards Vitna mirrors carries a result for GPT-4o (2024-05-13), each printed as its publisher published it and none added to another. MTEB, LiveBench, HELM, Vectara hallucination leaderboard and Aider polyglot have not published one under a name that matches its listing, and names are matched to the catalog exactly and never guessed. A task that is a link opens its column on /capability, with every run scored on it; an effort that is a link opens its run's row there, where the run is ranked on Vitna's scale. Every board, with its licence and what its publisher measures, is on /benchmarks.
Source: OpenRouter (openrouter.ai/models), as of 17 Nov 16:29 UTC. sha256 0bb53a77713f over 853,270 bytes.
Catalog: OpenRouter's public model list.
Intelligence, coding and agentic indexes: Artificial Analysis, as published by OpenRouter.
Elo, win rate and rank: Design Arena, as published by OpenRouter.
Vitna ran none of these evaluations and adjusted none of these figures.
