~/tedtes/writing/math-foundations-for-reasoning-models

~/writing/math-foundations-for-reasoning-models $ ls

Neural Network Foundations

Neuron

A neuron is a small computation unit that combines inputs, applies parameters, and produces one output.

~/writing/math-foundations-for-reasoning-models $ cat topic.md

Neuron

Definition

A neuron is a small computation unit inside a neural network.

It takes input values, combines them with parameters, and produces an output.

Basic pattern:

inputs -> weighted combination -> activation -> output

A neuron is a parameterized input-output computation.


Why It Exists

A single neuron gives the network a reusable unit of transformation.

It can ask:

which inputs matter?
how strongly should they matter?
should the result be passed forward?

The neuron does this using weights, bias, and an activation function.

A neuron turns several input values into one transformed value.


Simple Example

Suppose a neuron receives two inputs.

input 1 = 3
input 2 = 5

It may assign different importance to each input.

input 1 matters strongly
input 2 matters weakly

The neuron combines them into a single score.

combined score -> output

A neuron compresses multiple signals into one computed signal.


Neuron vs Biological Neuron

The word "neuron" is inspired by biology, but in this context it is a mathematical unit.

It is not a full biological model.

Here, a neuron means:

an input-output function with adjustable parameters

In neural networks, a neuron is a computation, not a biological explanation.


What Is Adjustable

A neuron has parameters.

Usually these include:

weights
bias

The inputs change from example to example.

The parameters are adjusted during training.

Training changes the neuron by changing its parameters.


Final Summary

  • A neuron is a small computation unit in a neural network.
  • It receives inputs and produces one output.
  • It uses weights, bias, and an activation function.
  • It is a mathematical unit, not a full biological model.
  • Inputs are processed; parameters are adjusted.
  • Networks are built by connecting many such units.

~/writing/math-foundations-for-reasoning-models $ open

Continue the series.

Weighted Sum