Funnel of Thoughts: Efficient Test-Time Scaling via Early Voting and Rollout Pruning
Researchers have developed a method called Funnel of Thoughts (FoT) to improve the efficiency of large reasoning models. These models often produce inconsistent answers across repeated queries on the same problem, so they need to be run multiple times for reliable deployment. The standard solution is majority voting at k rollouts, but it's expensive. FoT preserves accuracy while reducing inference costs by 28.8% and online generation attention FLOPs by 56.1%. It identifies un
Researchers have developed a method called Funnel of Thoughts (FoT) to improve the efficiency of large reasoning models. These models often produce inconsistent answers across repeated queries on the same problem, so they need to be run multiple times for reliable deployment. The standard solution is majority voting at k rollouts, but it's expensive. FoT preserves accuracy while reducing inference costs by 28.8% and online generation attention FLOPs by 56.1%. It identifies unproductive trajectories that consume disproportionate resources and prunes them before completion.
---
Why it matters: This matters to researchers in AI because large reasoning models are increasingly being used for real-world applications, but their high computational cost is a bottleneck. FoT's efficiency gains can help make these models more practical for deployment.
Source: https://arxiv.org/abs/2608.15065
This article was originally published at: https://arxiv.org/abs/2608.15065