Derivative (First Derivative)

Definition

The first derivative measures how a function output changes with respect to its input at a point.

When people say "the derivative" without extra detail, they usually mean the first derivative.

Basic question:

If x changes a little, how does f(x) change?

First derivative = local rate of change.

---

From Change To Derivative

Start with two inputs:

x
x + change

Compare the outputs:

f(x)
f(x + change)

Average change:

change in output / change in input

The derivative asks what happens when the input change becomes extremely small.

A derivative is the limiting version of average change.

---

First Derivative vs Later Derivatives

The first derivative measures change in the original function.

Example:

f'(x)

means:

local rate of change of f(x)

A second derivative appears later and measures how the first derivative changes.

f''(x)

means:

rate of change of f'(x)

First derivative measures change; second derivative measures change of change.

---

Difference Quotient

The common form is:

(f(x + h) - f(x)) / h

where:

h = small input change

As h gets closer to 0, this ratio approaches the derivative if the limit exists.

The derivative comes from shrinking the comparison interval.

---

Simple Example

Function:

f(x) = 2x

If x increases by 1, output increases by 2.

If x increases by 0.1, output increases by 0.2.

The output always changes twice as much as the input.

First derivative:

f'(x) = 2

The derivative tells the sensitivity of output to input.

---

Derivative Can Depend On The Point

Function:

f(x) = x^2

Near x = 1, the function changes moderately.

Near x = 10, the function changes much faster.

First derivative:

f'(x) = 2x

So:

f'(1) = 2
f'(10) = 20

Some functions change at different rates in different places.

---

Positive, Negative, And Zero Derivatives

A derivative can be positive, negative, or zero.

positive -> output increases as input increases
negative -> output decreases as input increases
zero -> output is locally flat

Example:

f'(x) = 0

means the function is flat at that point, but not necessarily flat everywhere.

The derivative describes local direction of change.

---

Why Derivatives Matter

Learning often asks:

How does error change if a parameter changes?

That is a derivative question.

Example:

change weight slightly -> observe change in loss

If we know the direction of change, we can later choose updates more intelligently.

Derivatives turn change into usable information.

---

Final Summary

• The first derivative measures local rate of change.
• It comes from shrinking average change toward an instant.
• It can be positive, negative, or zero.
• It can vary from point to point.
• When people say "derivative" by default, they usually mean first derivative.
• First derivatives help measure how outputs respond to input or parameter changes.