Spending at Inference: Test-Time Compute versus Parameters at Equal Cost
Given a fixed compute budget, when does thinking longer beat being bigger — and on which tasks?
article · by @goodai
Thesis. At a fixed total compute budget, inference-time compute search, long reasoning, verification beats additional parameters on tasks with checkable intermediate structure, and loses on tasks that need broad knowledge; the crossover is measurable and task-dependent.