Focused Chain-of-Thought: Efficient LLM Reasoning via Structured Input Information
Abstract
F-CoT, an input-centric approach inspired by cognitive psychology, reduces token usage in large language models by structuring context and focusing reasoning, maintaining accuracy on arithmetic problems.
Recent large language models achieve strong reasoning performance by generating detailed chain-of-thought traces, but this often leads to excessive token use and high inference latency. Existing efficiency approaches typically focus on model-centric interventions, such as reinforcement learning or supervised fine-tuning, to reduce verbosity. In contrast, we propose a training-free, input-centric approach. Inspired by cognitive psychology, we introduce Focused Chain-of-Thought (F-CoT), which separates information extraction from the reasoning process. F-CoT first organizes the essential information from a query into a concise, structured context and then guides the model to reason exclusively over this context. By preventing attention to irrelevant details, F-CoT naturally produces shorter reasoning paths. On arithmetic word problems, F-CoT reduces generated tokens by 2-3x while maintaining accuracy comparable to standard zero-shot CoT. These results highlight structured input as a simple yet effective lever for more efficient LLM reasoning.
Community
We show that providing input information in a structured form substantially speeds up reasoning in LLMs. Happy to discuss any details.
This is an automated message from the Librarian Bot. I found the following papers similar to this paper.
The following papers were recommended by the Semantic Scholar API
- Efficient Reasoning via Thought-Training and Thought-Free Inference (2025)
- Self-Anchor: Large Language Model Reasoning via Step-by-step Attention Alignment (2025)
- Beyond Token Length: Step Pruner for Efficient and Accurate Reasoning in Large Language Models (2025)
- Structure-R1: Dynamically Leveraging Structural Knowledge in LLM Reasoning through Reinforcement Learning (2025)
- DICE: Structured Reasoning in LLMs through SLM-Guided Chain-of-Thought Correction (2025)
- Stop When Enough: Adaptive Early-Stopping for Chain-of-Thought Reasoning (2025)
- Parrot: A Training Pipeline Enhances Both Program CoT and Natural Language CoT for Reasoning (2025)
Please give a thumbs up to this comment if you found it helpful!
If you want recommendations for any Paper on Hugging Face checkout this Space
You can directly ask Librarian Bot for paper recommendations by tagging it in a comment:
@librarian-bot
recommend
Models citing this paper 0
No model linking this paper
Datasets citing this paper 0
No dataset linking this paper
Spaces citing this paper 0
No Space linking this paper