Get started

GPT-4o (2024-11-20)

Timed at 106 tok/s, with results on 2 openly licensed boards, and not scored by Artificial Analysis.

retrieved sha256 · 0bb53a77713f

Models/OpenAI/GPT-4o (2024-11-20)USD per 1M tokens · as OpenRouter routes it
openai/gpt-4o-2024-11-20OpenAI · base listing · GPT tokenizer
OpenRouter list price · the routed rate, as the catalog carried itretrieved 17 Nov 16:29 UTC from openrouter.ai ↗
Input$2.50per 1M tokens
Output$10.00per 1M tokens
Cached input$1.25per 1M tokens
Context128k128,000 tokens
What the list says · the fields OpenRouter publishes for this id8 fields
AuthorOpenAI
Listed
Context128,000 tokens
Max output16,384 tokens
Modalitiestext, image, file → text
TokenizerGPT
Moderationmoderated by OpenRouter
Knowledge cutoff2023-10-31

Measured speed

903 requests · 1 endpoint · 30-minute window
Throughput106 tok/sMedian output rate, weighted across the one endpoint serving it by the requests each answered.the speed board
First token613msMedian wait before the first token, over the same window and weighted the same way.how Vitna reads a figure
Endpoint spreadone routeOne endpoint served this model in the window, so the headline is that endpoint's own figure rather than a blend.the board, fastest first

OpenRouter's own timing of its routed traffic, weighted by requests, over one 30-minute window read . Every route is on the endpoint ledger below.

Every endpoint

1 priced · 1 timed · cheapest first
  1. OpenAIopenai · listed$2.50$10.00$1.25not declared16k106 tok/s64613ms903 req100%

Uptime is OpenRouter's own figure for each seller over the trailing day, read once a day, and the column prints the latest reading, taken . The one seller with a reading was at 99% or better on each of the 23 days held. Source: OpenRouter's public endpoints API, one reading a day for each seller: 1,211 sellers carried one on the latest of the 23 days held.

Source: OpenRouter's public endpoints API. 1257 sellers across 359 models when the mirror ran, 186 of them served by more than one. List prices, not what anybody paid; a discount is the seller's own. Read . Speed is OpenRouter's own timing over one 30-minute window, read .

What each seller accepts

16 parameters · 1 seller
  1. frequency_penaltyevery seller
  2. logit_biasevery seller
  3. logprobsevery seller
  4. max_tokensevery seller
  5. predictionevery seller
  6. presence_penaltyevery seller
  7. response_formatevery seller
  8. seedevery seller
  9. stopevery seller
  10. structured_outputsevery seller
  11. temperatureevery seller
  12. tool_choiceevery seller
  13. toolsevery seller
  14. top_logprobsevery seller
  15. top_pevery seller
  16. web_search_optionsevery seller

The one seller that publishes a list accepts these 16. Each list is the seller's own declaration in OpenRouter's endpoints API, read , and nothing here tested one.

Price position

342 priced models

Blended $4.375 per million tokens, 3 in to 1 out: cheaper than 48 of the 342 priced models in the catalog. Each bar is one stretch of the catalog on a logarithmic price scale; the mark is this listing.

Measured quality

145 models with an index · 132 on a design arena board
Intelligence Indexnot scoredArtificial Analysis has not scored this model on its Intelligence Index.the intelligence leaderboard
Coding Indexnot scoredArtificial Analysis has not scored this model on its Coding Index.the coding leaderboard
Agentic Indexnot scoredArtificial Analysis has not scored this model on its Agentic Index.the agentic leaderboard

Not ranked in any Design Arena category.

Epoch Capabilities Index · a fit by a third party over every benchmark this model has results onthe whole index, with intervals

Epoch AI has not placed GPT-4o (2024-11-20) on its Capabilities Index, or places it under a name the pairing does not reach. Epoch places a model once four of its benchmarks carry a result.

Benchmark results

2 of 6 boards · 7 results
Epoch AI Benchmarking Hub · publisher-run, CC-BY-4.06 of 22 tasks · effort unstated

Mean accuracy, 0 to 1, on the task the row names, as Epoch AI runs it and averaged over repeated runs. All eighteen of their tasks, including the held-out FrontierMath tiers, named as they name them. The model id carries the effort setting the run used. Epoch AI Benchmarking Hub names this run gpt-4o-2024-11-20, with no effort setting written on it. All runs is how many runs the publisher scored on the task, every model's. Read from epoch.ai ↗, which dates its own data . Epoch AI Benchmarking Hub data, by Epoch AI, under CC BY 4.0.

Aider polyglot · submitted, Apache-2.01 of 1 task · 69 runs scored on the task · effort unstated
TaskScore
polyglot pass rate18.20

Percent of 225 Exercism exercises solved with a second attempt allowed, higher is better. The id carries the edit format, because the publisher says a model alone does not identify a run. Aider polyglot names this run gpt-4o-2024-11-20 (diff), with no effort setting written on it. Read from raw.githubusercontent.com ↗, which dates its own data . Aider polyglot benchmark, Apache-2.0, by the Aider project. Results are submitted by contributors rather than produced by the publisher.

2 of the 6 openly licensed boards Vitna mirrors carry a result for GPT-4o (2024-11-20), each printed as its publisher published it and none added to another. MTEB, LiveBench, HELM and Vectara hallucination leaderboard have not published one under a name that matches its listing, and names are matched to the catalog exactly and never guessed. A task that is a link opens its column on /capability, with every run scored on it; an effort that is a link opens its run's row there, where the run is ranked on Vitna's scale. Every board, with its licence and what its publisher measures, is on /benchmarks.

Sources

Source: OpenRouter (openrouter.ai/models), as of 17 Nov 16:29 UTC. sha256 0bb53a77713f over 853,270 bytes.
Catalog: OpenRouter's public model list.
Intelligence, coding and agentic indexes: Artificial Analysis, as published by OpenRouter.
Elo, win rate and rank: Design Arena, as published by OpenRouter.
Vitna ran none of these evaluations and adjusted none of these figures.