~/writing/math-foundations-for-reasoning-models $ ls
Reasoning Models as Representation Transformation
Multi-Step Transformation
Multi-step transformation is the repeated updating of representations across several dependent steps.
~/writing/math-foundations-for-reasoning-models $ cat topic.md
Multi-Step Transformation
Definition
Multi-step transformation means the model changes representations through several dependent steps.
Simple form:
state 1 -> state 2 -> state 3 -> output
Each step can use information produced by earlier steps.
Multi-step transformation is a sequence of representation updates.
Why One Step May Not Be Enough
Some tasks require combining information gradually.
Examples:
solve a multi-part problem
compare several constraints
plan an action sequence
verify a result
use a tool and interpret its output
A single shallow transformation may lose necessary structure.
Complex tasks often require staged processing.
Dependency Between Steps
In multi-step transformation, later steps depend on earlier states.
Example:
step 1: identify constraint
step 2: apply constraint
step 3: check result
If step 1 is wrong, later steps may be affected.
Multi-step reasoning creates dependency between intermediate states.
Internal And External Steps
Some steps happen internally in model representations.
Some steps may be externalized.
Examples:
internal:
hidden representation update
external:
written scratchpad
tool call
search step
verification step
Reasoning systems often combine both.
Multi-step transformation can involve internal computation and external workspace.
Error Propagation
Because steps depend on each other, errors can propagate.
Example:
wrong intermediate assumption -> wrong plan -> wrong answer
This is why verification and self-correction matter.
They help detect and revise bad intermediate states.
Multi-step systems need ways to control accumulated error.
Final Summary
- Multi-step transformation updates representations across dependent steps.
- Later steps can depend on earlier states.
- Complex tasks often require staged processing.
- Steps can be internal or external.
- Errors can propagate, so verification matters.
~/writing/math-foundations-for-reasoning-models $ open
Continue the series.
Planning