~/writing/math-foundations-for-reasoning-models $ ls
Matrices as Transformations
Eigenvector
An eigenvector is a direction that a matrix transformation only scales, without rotating away.
~/writing/math-foundations-for-reasoning-models $ cat topic.md
Eigenvector
Definition
An eigenvector is a vector whose direction is preserved by a matrix transformation.
The matrix may stretch or shrink it.
But it does not rotate it away from its original direction.
Example idea:
A * v = scaled version of v
Eigenvector = a direction that stays on its own line after transformation.
Simple Scaling Example
Let:
A =
[2 0]
[0 3]
Apply it to:
v = [1, 0]
Result:
A * v = [2, 0]
The vector changed size, but it still points along the first axis.
So [1, 0] is an eigenvector of this matrix.
If the direction stays the same, the vector may be an eigenvector.
Another Direction
Using the same matrix:
A =
[2 0]
[0 3]
Apply it to:
v = [0, 1]
Result:
A * v = [0, 3]
The direction stays along the second axis.
So [0, 1] is also an eigenvector.
Some transformations have multiple preserved directions.
Not Every Vector Is An Eigenvector
Using:
A =
[2 0]
[0 3]
apply it to:
v = [1, 1]
Result:
A * v = [2, 3]
[2, 3] is not just a scaled version of [1, 1].
The direction changed.
So [1, 1] is not an eigenvector of this matrix.
An eigenvector must keep its direction under the transformation.
Eigenvectors Are About Directions
If:
v
is an eigenvector, then a nonzero scaled version of v points in the same eigenvector direction.
Example:
[1, 0]
[5, 0]
[-2, 0]
all lie on the same line.
The important thing is the preserved direction.
Eigenvectors identify special directions of a transformation.
Zero Vector Is Excluded
The zero vector is not counted as an eigenvector.
Example:
[0, 0]
It has no direction.
Eigenvectors are about directions that are preserved.
Eigenvectors must be nonzero.
Why Eigenvectors Matter
Eigenvectors help reveal how a matrix acts on space.
They answer:
Which directions does this transformation preserve?
Which directions are only scaled?
Which directions define the transformation's structure?
Eigenvectors expose stable directions inside a transformation.
Final Summary
- An eigenvector is a nonzero vector whose direction is preserved.
- The matrix may stretch, shrink, or flip it.
- The result must stay on the same line.
- Not every vector is an eigenvector.
- Eigenvectors are about directions, not one specific length.
- They reveal stable directions of a matrix transformation.
~/writing/math-foundations-for-reasoning-models $ open
Continue the series.
Eigenvalue