Unboxing the AI Stack
Model · L02 · Language Models

GPT

GPT is OpenAI’s family of large language models. The line starts with OpenAI’s June 11, 2018 work on improving language understanding with unsupervised learning, which combined two existing ideas, transformers and unsupervised pre-training: a model is first trained on a large amount of text with language modeling as the training signal, then fine-tuned for specific tasks.1 GPT-3, described in a paper first posted on May 28, 2020, had 175 billion parameters.2 OpenAI’s API catalog still lists older GPT-3.5, GPT-4 and GPT-5 versions, and as of October 13, 2026 its featured models are GPT-6 Astra (“our most capable model for the most demanding work”), GPT-6.1 Sol (“near-Astra performance for complex work at a lower cost”) and GPT-6 Luna (for focused, high-volume tasks).3 Astra has a 1,050,000-token context window, up to 128,000 output tokens and an April 30, 2026 knowledge cutoff, by OpenAI’s own model page.4

GPT models hold the two highest scores on ARC-AGI-3’s Semi-Private set on ARC Prize’s Standard harness: GPT-6 Astra at 62.71% and GPT-6.1 Sol at 52.73%, measured by ARC Prize (Highest ARC-AGI-3 Scores, by Model).5 On SWE-bench Verified, GPT 5.2 and GPT 5.2 Codex each resolved 72.8% of tasks in the shared mini-SWE-agent v2.0.0 harness, a benchmark OpenAI itself stopped reporting in February 2026, citing flawed tests and contamination (SWE-bench Verified, Pro and What Replaced Them).67 Prices run from $0.50 per 1M output tokens for GPT-6 Luna to $50 for GPT-6 Astra, both vendor-stated list prices at the short-context, standard tier (Cheapest LLM APIs per 1M Output Tokens).8 On OpenRouter, GPT-6 Luna processed 7.11 trillion tokens in the week to October 12, 2026, ranking seventh, with GPT-6.1 Sol at 2.23 trillion and GPT-5.6 Luna at 1.81 trillion (Most-Used AI Models on OpenRouter by Weekly Tokens).9

Illustration: the GPT models sit in the Language Models layer of the stack.

Key facts

MakerOpenAI3
First modelJune 2018 (a transformer with unsupervised pre-training)1
GPT-3 parameters175 billion Vendor-stated2
Current flagshipGPT-6 Astra; GPT-6.1 Sol and GPT-6 Luna below it3
GPT-6 Astra context window1,050,000 tokens Vendor-stated4
GPT-6 Astra list price (output, short context)$50 per 1M tokens Vendor-stated8
ARC-AGI-3, Standard harness62.71% (GPT-6 Astra, Max effort) Measured5
Weekly tokens on OpenRouter7.11T (GPT-6 Luna, week to Oct 12, 2026) Measured9

As of . How figures are labeled.

Appears in

Sources

  1. OpenAI, Improving language understanding with unsupervised learning, June 11, 2018, read via the r.jina.ai reader (openai.com returns 403 to our tools), retrieved 2026-10-13.
  2. Tom B. Brown et al. (OpenAI), Language Models are Few-Shot Learners, arXiv 2005.14165 (v1 May 28, 2020), retrieved 2026-10-13.
  3. OpenAI, Models (OpenAI API docs), retrieved 2026-10-13.
  4. OpenAI, GPT-6 Astra (OpenAI API docs), retrieved 2026-10-13.
  5. ARC Prize, ARC-AGI-3 Verified leaderboard data (v3.json, generated 2026-10-05), retrieved 2026-10-13.
  6. SWE-bench team, SWE-bench Leaderboards (Bash Only view, mini-SWE-agent v2.0.0 runs), retrieved 2026-10-13.
  7. OpenAI, Why we no longer evaluate SWE-bench Verified, February 23, 2026, read via the r.jina.ai reader (openai.com returns 403 to our tools), retrieved 2026-10-13.
  8. OpenAI, Pricing (OpenAI API docs), retrieved 2026-10-13.
  9. OpenRouter, AI Model Rankings (“This Week” view, usage data through Oct 12, 2026; rankings data CC BY 4.0), retrieved 2026-10-13.