~/writing/math-foundations-for-reasoning-models $ ls
Computation as State Transition
Tape
A tape is a model of memory where symbols are stored in ordered positions that can be accessed step by step.
~/writing/math-foundations-for-reasoning-models $ cat topic.md
What Is a Tape?
Definition
A tape is a model of memory where symbols are stored in ordered positions.
It gives memory a simple structure:
cell -> cell -> cell -> cell
Each position can hold a symbol.
Tape = ordered memory made of symbol-holding positions
Tape vs Memory
Memory is retained information from earlier steps.
A tape is one way to organize that retained information.
Memory = retained information
Tape = retained information arranged in ordered positions
Not all memory is tape-like.
A tape is useful because it makes memory concrete:
- information is stored somewhere
- each stored item has a position
- the system can focus on one position at a time
A tape is a structured form of memory, not memory in general.
Cells And Positions
The tape can be visualized as a sequence of cells:
[ ] [ ] [ ] [ ] [ ] ...
Each cell:
- holds one symbol
- has a position in the sequence
Example:
[1] [0] [1] [1] [_]
The order matters.
The first 1, the 0, and the later 1s are stored in different positions.
Tape memory is organized by position.
Symbols And Blank Cells
A tape stores symbols.
Examples:
[1] [0] [1]
The symbol _ can represent a blank cell:
[1] [0] [1] [_] [_]
A blank cell means the position is empty or unused in the current representation.
The blank is still a symbol the system can recognize.
A blank cell is not nothing. It is a recognizable empty position.
Current Position
In this model, the system has a current position on the tape.
Example:
[1] [0] [1]
^
current position
The tape contents are:
[1] [0] [1]
The current position is:
the cell containing 0
These are related, but not the same.
The same tape contents can behave differently if the current position is different.
Tape contents describe what is stored. Current position describes where the system is focused.
Local Access
In this model, the system interacts with one position at a time.
Example:
[1] [0] [1] [1]
^
current position
The system is focused on the third cell.
It does not directly operate on the whole tape at once.
Local access means the system works through memory one position at a time.
Tape Can Change Over Time
The contents of the tape can change during computation.
Example:
Before:
[1] [0] [1]
^
After:
[1] [1] [1]
^
The current position stayed the same.
The symbol at that position changed from 0 to 1.
A tape is memory that can be preserved and updated across steps.
Why Not Just Reverse The Rule?
Sometimes the current state preserves enough information to recover a previous state.
Example:
Rule: x -> x + 1
2 -> 3
If the rule is known, the previous value can be recovered:
previous value = current value - 1
previous value = 3 - 1
previous value = 2
In this simple case, a separate tape is not necessary.
The current state already carries enough information.
But this does not always work.
Example:
Rule: is even?
5 -> false
7 -> false
9 -> false
From false, the system cannot recover whether the original input was 5, 7, or 9.
The rule lost information.
If that earlier value is needed later, it must be stored somewhere.
Tape is useful when the current state alone does not preserve enough information.
When Tape Becomes Useful
Tape is not required for every computation.
Tape becomes useful when the system needs explicit structured memory.
Common reasons:
- the system needs to store more than one value
- the system needs information that cannot be recovered from the current value
- a rule loses information during computation
- the system needs a structured workspace
- the system needs to read and write different positions over time
Example:
Current value: false
Stored tape: [5] [false]
The current value false does not preserve the original input.
The tape can preserve it in another position.
This gives the system access to both:
original value: 5
computed result: false
Tape provides explicit memory when reversing the rule is not enough.
Extendable Tape
In theoretical models, the tape may be treated as extendable without a fixed limit.
Example:
[1] [0] [1] [_] [_] [_] ...
The blank cells represent available unused positions.
This does not mean real machines have infinite physical storage.
It means the model can describe computation without choosing a fixed memory limit first.
An extendable tape models memory that can keep growing as needed.
Operations Preview
The system usually interacts with the tape through simple operations.
At a high level, it can:
- observe the current symbol
- replace the current symbol
- shift the current position
These will be treated separately as:
- read operation
- write operation
- move operation
For now, the important idea is simpler:
The tape gives the system something structured to access and update.
Sequential Processing
Computation can proceed step by step across the tape.
Example:
[1] [0] [1]
^
[1] [0] [1]
^
[1] [0] [1]
^
The system moves through positions gradually.
This allows a simple local process to work over a larger memory structure.
Tape-based computation uses local steps over ordered memory.
Why Tape Matters
A tape matters because it turns memory into something explicit.
It shows:
- where symbols are stored
- how positions organize memory
- why current position matters
- how memory can be accessed locally
- how a system can process a larger structure step by step
- why information can be preserved even when a rule loses information
The tape is not the only possible model of memory.
But it is a clear model for understanding computation as state transition.
Tape makes memory concrete: stored symbols, positions, local access, and explicit preservation.
Final Summary
- A tape is a model of memory.
- It stores symbols in ordered positions.
- A tape is structured memory, not memory in general.
- Each cell holds a symbol.
- A blank cell is a recognizable empty position.
- Tape contents and current position are different parts of the model.
- The system usually accesses one position at a time.
- Tape contents can change across computation.
- Tape is not required when the current state already preserves enough information.
- Tape is useful when information must be stored explicitly instead of recovered by reversing a rule.
- The tape may be treated as extendable in theoretical models.
- Read, write, and move are operations on the tape, but each will be explained separately.
~/writing/math-foundations-for-reasoning-models $ open
Continue the series.
Read Operation