~/writing/math-foundations-for-reasoning-models $ ls
Matrices as Transformations
Eigenvalue
An eigenvalue is the scale factor applied to an eigenvector by a matrix transformation.
~/writing/math-foundations-for-reasoning-models $ cat topic.md
Eigenvalue
Definition
An eigenvalue is the scale factor applied to an eigenvector.
If:
A * v = lambda * v
then:
v = eigenvector
lambda = eigenvalue
lambda is just a scalar.
Eigenvalue = how much an eigenvector is scaled.
Simple Example
Let:
A =
[2 0]
[0 3]
Apply it to:
v = [1, 0]
Result:
A * v = [2, 0]
This is:
2 * [1, 0]
So:
eigenvector = [1, 0]
eigenvalue = 2
The eigenvalue tells the scaling amount for that eigenvector.
Another Example
Using the same matrix:
A =
[2 0]
[0 3]
Apply it to:
v = [0, 1]
Result:
A * v = [0, 3]
This is:
3 * [0, 1]
So:
eigenvalue = 3
Different eigenvector directions can have different eigenvalues.
Eigenvalue Meaning
An eigenvalue describes what happens along an eigenvector direction.
If:
eigenvalue = 3
the direction is stretched by 3.
If:
eigenvalue = 1
the direction is unchanged in size.
If:
eigenvalue = 0
the direction is collapsed to zero.
If:
eigenvalue = -1
the direction is flipped.
Eigenvalues describe scaling, collapse, or flip along special directions.
Eigenvalue Depends On Eigenvector
Eigenvalues belong to eigenvector directions.
Example:
[1, 0] has eigenvalue 2
[0, 1] has eigenvalue 3
for:
[2 0]
[0 3]
The matrix does not have just one scaling behavior.
It can scale different directions differently.
Eigenvalues describe direction-specific scaling.
Not A General Scale For Every Vector
An eigenvalue does not necessarily describe what happens to every vector.
Example:
v = [1, 1]
under:
[2 0]
[0 3]
becomes:
[2, 3]
This is not a single scalar multiple of [1, 1].
So the eigenvalue idea applies to eigenvectors.
Eigenvalues apply to preserved directions, not arbitrary vectors.
Why Eigenvalues Matter
Eigenvalues help describe the internal behavior of a matrix transformation.
They answer:
Which stable directions are stretched?
Which are shrunk?
Which are flipped?
Which are collapsed?
Eigenvalues explain what happens along eigenvector directions.
Final Summary
- An eigenvalue is a scalar scale factor.
- It belongs to an eigenvector direction.
- It tells how much that direction is stretched, shrunk, flipped, or collapsed.
- Different eigenvectors can have different eigenvalues.
- Eigenvalues do not describe every vector directly.
- They reveal direction-specific behavior of a matrix.
~/writing/math-foundations-for-reasoning-models $ open
Continue the series.
Linear Transformation