Get started

GPT-4o (2024-08-06)

Timed at 78 tok/s, with results on 2 openly licensed boards, and not scored by Artificial Analysis.

retrieved sha256 · 0bb53a77713f

Models/OpenAI/GPT-4o (2024-08-06)USD per 1M tokens · as OpenRouter routes it
openai/gpt-4o-2024-08-06OpenAI · base listing · GPT tokenizer
OpenRouter list price · the routed rate, as the catalog carried itretrieved 17 Nov 16:29 UTC from openrouter.ai ↗
Input$2.50per 1M tokens
Output$10.00per 1M tokens
Cached input$1.25per 1M tokens
Context128k128,000 tokens
What the list says · the fields OpenRouter publishes for this id8 fields
AuthorOpenAI
Listed
Context128,000 tokens
Max output16,384 tokens
Modalitiestext, image, file → text
TokenizerGPT
Moderationmoderated by OpenRouter
Knowledge cutoff2023-10-31

Measured speed

7,328 requests · 2 endpoints · 30-minute window
Throughput78 tok/sMedian output rate, weighted across the 2 endpoints serving it by the requests each answered.the speed board
First token534msMedian wait before the first token, over the same window and weighted the same way.how Vitna reads a figure
Endpoint spread78 to 109The slowest and the fastest route serving this model, in tokens per second. Speed is a property of the route, not of the weights.the board, fastest first

OpenRouter's own timing of its routed traffic, weighted by requests, over one 30-minute window read . Every route is on the endpoint ledger below.

Every endpoint

2 priced · 2 timed · cheapest first
  1. Azureazure · listed$2.50$10.00$1.25not declared16k109 tok/s41.9873ms7 req100%
  2. OpenAIopenai · listed$2.50$10.00$1.25not declared16k78 tok/s55534ms7,321 req100%

Each track runs from a route's p90, the rate nine in ten of its requests met or beat, up to its median. Weighted by requests, the figure above reports where the traffic went rather than what one route does: 0 of the 2 timed routes are slower than it, and the middle route runs at 93.5 tok/s. The widest median-to-p90 gap is Azure's, 2.6x.

Uptime is OpenRouter's own figure for each seller over the trailing day, read once a day, and the column prints the latest reading, taken . Every one of the 2 sellers with a reading was at 99% or better on each of the 23 days held, 23 Oct 2026 to 21 Nov 2026. Source: OpenRouter's public endpoints API, one reading a day for each seller: 1,211 sellers carried one on the latest of the 23 days held.

Source: OpenRouter's public endpoints API. 1257 sellers across 359 models when the mirror ran, 186 of them served by more than one. List prices, not what anybody paid; a discount is the seller's own. Read . Speed is OpenRouter's own timing over one 30-minute window, read .

What each seller accepts

17 parameters · 2 sellers
  1. frequency_penaltyevery seller
  2. logit_biasevery seller
  3. logprobsevery seller
  4. presence_penaltyevery seller
  5. response_formatevery seller
  6. seedevery seller
  7. stopevery seller
  8. structured_outputsevery seller
  9. temperatureevery seller
  10. tool_choiceevery seller
  11. toolsevery seller
  12. top_logprobsevery seller
  13. top_pevery seller
  14. web_search_optionsevery seller
  15. max_completion_tokens1 of 2not OpenAI
  16. max_tokens1 of 2not Azure
  17. prediction1 of 2not Azure

14 of these 17 are accepted by every one of the 2 sellers that publish a list; the other 3 are declared by some sellers and not others, so what a request sending one of them gets depends on which seller serves it. Each list is the seller's own declaration in OpenRouter's endpoints API, read , and nothing here tested one.

Price position

342 priced models

Blended $4.375 per million tokens, 3 in to 1 out: cheaper than 48 of the 342 priced models in the catalog. Each bar is one stretch of the catalog on a logarithmic price scale; the mark is this listing.

Measured quality

145 models with an index · 132 on a design arena board
Intelligence Indexnot scoredArtificial Analysis has not scored this model on its Intelligence Index.the intelligence leaderboard
Coding Indexnot scoredArtificial Analysis has not scored this model on its Coding Index.the coding leaderboard
Agentic Indexnot scoredArtificial Analysis has not scored this model on its Agentic Index.the agentic leaderboard

Not ranked in any Design Arena category.

Epoch Capabilities Index · a fit by a third party over every benchmark this model has results onthe whole index, with intervals

Epoch AI has not placed GPT-4o (2024-08-06) on its Capabilities Index, or places it under a name the pairing does not reach. Epoch places a model once four of its benchmarks carry a result.

Benchmark results

2 of 6 boards · 9 results
Epoch AI Benchmarking Hub · publisher-run, CC-BY-4.08 of 22 tasks · effort unstated

Mean accuracy, 0 to 1, on the task the row names, as Epoch AI runs it and averaged over repeated runs. All eighteen of their tasks, including the held-out FrontierMath tiers, named as they name them. The model id carries the effort setting the run used. Epoch AI Benchmarking Hub names this run gpt-4o-2024-08-06, with no effort setting written on it. All runs is how many runs the publisher scored on the task, every model's. Read from epoch.ai ↗, which dates its own data . Epoch AI Benchmarking Hub data, by Epoch AI, under CC BY 4.0.

Aider polyglot · submitted, Apache-2.01 of 1 task · 69 runs scored on the task · effort unstated
TaskScore
polyglot pass rate23.10

Percent of 225 Exercism exercises solved with a second attempt allowed, higher is better. The id carries the edit format, because the publisher says a model alone does not identify a run. Aider polyglot names this run gpt-4o-2024-08-06 (diff), with no effort setting written on it. Read from raw.githubusercontent.com ↗, which dates its own data . Aider polyglot benchmark, Apache-2.0, by the Aider project. Results are submitted by contributors rather than produced by the publisher.

2 of the 6 openly licensed boards Vitna mirrors carry a result for GPT-4o (2024-08-06), each printed as its publisher published it and none added to another. MTEB, LiveBench, HELM and Vectara hallucination leaderboard have not published one under a name that matches its listing, and names are matched to the catalog exactly and never guessed. A task that is a link opens its column on /capability, with every run scored on it; an effort that is a link opens its run's row there, where the run is ranked on Vitna's scale. Every board, with its licence and what its publisher measures, is on /benchmarks.

Sources

Source: OpenRouter (openrouter.ai/models), as of 17 Nov 16:29 UTC. sha256 0bb53a77713f over 853,270 bytes.
Catalog: OpenRouter's public model list.
Intelligence, coding and agentic indexes: Artificial Analysis, as published by OpenRouter.
Elo, win rate and rank: Design Arena, as published by OpenRouter.
Vitna ran none of these evaluations and adjusted none of these figures.