SubQ Launches: 12-Million-Token Context Window That Beats GPT-5.5
Subquadratic raises $29M and launches SubQ, the world's first 12-million-token AI context window using sparse attention that's 52x faster than dense attention at 1M tokens.
What Is SubQ and Why Is It Different?
Subquadratic, a Miami-based startup, launched in May 2026 with SubQ — an AI model boasting a 12-million-token context window. That's roughly 9 million words or about 120 books in a single prompt. The secret is their proprietary Subquadratic Selective Attention (SSA) architecture.
The Problem With Current Context Windows
Traditional transformers use dense attention: every token gets compared to every other token. With 1,000 tokens, that's 1,000² = 1,000,000 comparisons. Scale to millions of tokens and compute costs become astronomical. This quadratic scaling problem has constrained every transformer since 2017.
How SSA Solves the Scaling Problem
SubQ uses content-dependent selection to identify which token relationships actually matter — and only processes those. Unlike DeepSeek's Native Sparse Attention, where the indexer was still quadratic, SSA's selection mechanism scales linearly in both compute and memory.
The Performance Numbers
The benchmarks are striking: 52× faster than dense attention (FlashAttention) at 1 million tokens, and 92.1% accuracy on needle-in-a-haystack retrieval at 12M tokens — a length no other frontier model even approaches.
FAQ
Q: What can I do with 12 million tokens? A: You could load entire codebases, full research paper collections, or complete legal document sets into a single prompt for analysis.
Q: Is SubQ available now? A: The company just launched with seed funding. Availability and pricing haven't been announced yet.
Q: How does this compare to Gemini's context window? A: Gemini's context window is measured in millions of tokens, but SubQ claims both longer context and better retrieval accuracy at extreme lengths.
Stay ahead of the AI curve. Follow @AiForSuccess for daily insights.
📬 Want more AI solopreneur insights?
Subscribe to our weekly newsletter →Related Articles
AI Design Tools for Solo Founders: The Last Bottleneck Is Gone
29.8 million solopreneurs contribute $1.7T to the US economy, and AI design tools just eliminated the last expensive bottleneck — professional design. Here are the best tools to try.
Enterprise AI Agents in Procurement: Zip, SAP, and Coupa Battle for Automation
The procurement tech sector is the newest AI agent battleground. Zip, SAP, and Coupa are racing to automate enterprise purchasing with AI agents that handle contracts, approvals, and vendor management.
OpenAI Codex Computer Use Expands to Windows — Control Your PC with AI
OpenAI's Codex computer use feature, previously Mac-only, now works on Windows. AI agents can control your desktop, click buttons, fill forms, and automate repetitive tasks.