~/writing/math-foundations-for-reasoning-models $ ls
Neural Network Foundations
Neural Network as Function Composition
A neural network can be understood as several functions composed into one larger input-output function.
~/writing/math-foundations-for-reasoning-models $ cat topic.md
Neural Network as Function Composition
Definition
A neural network can be understood as a composition of functions.
Each layer is a function.
The network connects them in sequence.
input -> function 1 -> function 2 -> function 3 -> output
A neural network is a layered input-output function.
Function Composition
Function composition means the output of one function becomes the input to the next.
Example:
first function: f
second function: g
input -> f -> g -> output
Written compactly:
g(f(input))
Composition chains transformations together.
Layers as Functions
Each layer transforms values.
layer 1: input values -> hidden values
layer 2: hidden values -> new hidden values
layer 3: hidden values -> output values
The whole network is the result of composing these layer functions.
Layers are transformation steps inside a larger function.
Parameters Inside the Functions
The functions are not fixed in every detail.
They contain parameters.
weights
biases
Training changes these parameters.
So the network is a function whose behavior can be adjusted.
Neural networks are parameterized function compositions.
Why Composition Matters
Composition lets the network build transformations step by step.
raw input
-> first representation
-> second representation
-> final output
Each stage can reshape the information before passing it forward.
Function composition lets networks build layered representations.
Final Summary
- A neural network is a composition of functions.
- Each layer is a function.
- The output of one layer becomes the input to the next.
- The network contains parameters inside its functions.
- Training adjusts those parameters.
- Composition lets the network build representations step by step.
~/writing/math-foundations-for-reasoning-models $ open
Continue the series.
Bridge to Backpropagation