~/tedtes/writing/math-foundations-for-reasoning-models

~/writing/math-foundations-for-reasoning-models $ ls

Matrices as Transformations

Identity Matrix

The identity matrix is the matrix transformation that leaves vectors unchanged.

~/writing/math-foundations-for-reasoning-models $ cat topic.md

Identity Matrix

Definition

The identity matrix is a matrix that leaves vectors unchanged.

Example in two dimensions:

I =
[1 0]
[0 1]

Apply it to:

v = [3, 5]

Result:

I * v = [3, 5]

Identity matrix = do-nothing transformation.


Why It Leaves Vectors Unchanged

Use:

I =
[1 0]
[0 1]

and:

v = [3, 5]

Compute:

first output  = 1*3 + 0*5 = 3
second output = 0*3 + 1*5 = 5

Output:

[3, 5]

The identity matrix preserves each component.


Identity Matrix Shape

Identity matrices are square.

Examples:

1 x 1:
[1]
2 x 2:
[1 0]
[0 1]
3 x 3:
[1 0 0]
[0 1 0]
[0 0 1]

They have 1s on the main diagonal and 0s elsewhere.

An identity matrix matches the dimension of the vectors it preserves.


Identity Matrix And Multiplication

The identity matrix acts like 1 for matrix multiplication.

Example:

I * A = A
A * I = A

when the shapes match.

This means applying identity before or after a transformation does not change the transformation.

Identity matrix is the neutral element for matrix multiplication.


Identity vs Zero Matrix

The identity matrix is not the zero matrix.

Identity:

[1 0]
[0 1]

Zero matrix:

[0 0]
[0 0]

Identity preserves vectors.

Zero matrix sends every vector to zero.

Example:

zero matrix * [3, 5] = [0, 0]

Identity preserves information. Zero matrix removes component values.


Why It Matters

The identity matrix gives a reference point for transformations.

It answers:

What does no transformation look like?

This matters when studying inverse matrices.

An inverse should undo a transformation and return us to identity behavior.

Identity is the baseline transformation.


Final Summary

  • The identity matrix leaves vectors unchanged.
  • It has 1s on the main diagonal and 0s elsewhere.
  • It is square.
  • It acts like 1 in matrix multiplication.
  • It is different from the zero matrix.
  • It is the baseline for understanding inverse transformations.

~/writing/math-foundations-for-reasoning-models $ open

Continue the series.

Inverse Matrix