~/writing/math-foundations-for-reasoning-models $ ls
Geometry of Data
Projection
Projection measures the part of one vector that lies in the direction of another.
~/writing/math-foundations-for-reasoning-models $ cat topic.md
Projection
Definition
Projection measures the part of one vector that lies in the direction of another vector.
Simple image:
projection = shadow of one vector on another direction
Example:
a = [3, 4]
direction = [1, 0]
The part of a along [1, 0] is:
[3, 0]
Projection extracts the component of a vector along a direction.
Projection Onto An Axis
Project:
a = [3, 4]
onto the first coordinate direction:
[1, 0]
The result is:
[3, 0]
Project onto the second coordinate direction:
[0, 1]
The result is:
[0, 4]
Projection can isolate how much a vector contributes to one direction.
Projection Uses Alignment
Projection depends on how aligned the vectors are.
If vectors point in the same direction, projection is large.
Example:
a = [5, 0]
direction = [1, 0]
projection = [5, 0]
If they are perpendicular, projection is zero.
Example:
a = [0, 5]
direction = [1, 0]
projection = [0, 0]
Projection is based on directional alignment.
Projection Length
Sometimes we only want the scalar amount in a direction.
If the direction vector has length 1, the scalar projection is:
dot(a, direction)
Example:
a = [3, 4]
direction = [1, 0]
dot(a, direction) = 3
So a has amount 3 in the [1, 0] direction.
Dot product with a unit direction gives projection amount.
Projection Vector
Projection can also return a vector.
Example:
a = [3, 4]
direction = [1, 0]
Scalar amount:
3
Projection vector:
3 * [1, 0] = [3, 0]
Projection vector keeps the projected amount in the target direction.
Projection Requires A Direction
You cannot project onto the zero vector as a direction.
Example:
direction = [0, 0]
This has no direction and length 0.
So it cannot define where the projection should land.
Projection needs a nonzero direction.
Why Projection Matters For Data
Projection helps answer:
How much of this data vector lies in this direction?
How much does this feature direction explain?
What part remains outside this direction?
This matters because vector data often contains many components, but sometimes we want to study one direction at a time.
Projection breaks vector information into directional parts.
Final Summary
- Projection measures the part of one vector along another direction.
- It is like a shadow on a direction.
- Projection depends on alignment.
- Dot product with a unit direction gives projection amount.
- Projection can return a scalar amount or a vector.
- Projection requires a nonzero target direction.
~/writing/math-foundations-for-reasoning-models $ open
Continue the series.
Similarity as Alignment