~/tedtes/writing/math-foundations-for-reasoning-models

~/writing/math-foundations-for-reasoning-models $ ls

Calculus and Gradients

Local Maximum

A local maximum is a point whose value is higher than nearby values.

~/writing/math-foundations-for-reasoning-models $ cat topic.md

Local Maximum

Definition

A local maximum is a point where the function value is higher than nearby values.

Basic shape:

up -> top -> down

Local maximum = highest point in a nearby region.


Simple Example

Function:

f(x) = -x^2

At x = 0:

f(0) = 0

Nearby values are lower:

f(-1) = -1
f(1) = -1

So x = 0 is a local maximum.

The function is higher there than around it.


Local vs Global Maximum

A local maximum is highest nearby.

A global maximum is highest over the whole domain.

local maximum -> highest in a neighborhood
global maximum -> highest overall

A function can contain many local maxima.

Local high point does not always mean highest possible point.


Derivative Around A Local Maximum

For a smooth one-dimensional function, the derivative often changes like this:

positive -> zero -> negative

Meaning:

function increases before the point
function is flat at the point
function decreases after the point

A local maximum often appears where increasing turns into decreasing.


Local Maximum In A Surface

For a two-input function, imagine the top of a hill.

At the top:

moving in nearby directions lowers the value

That point is a local maximum.

In multiple dimensions, a local maximum is higher than nearby points in all directions.


Why Local Maxima Matter

If the goal is to maximize a function, a local maximum may be useful.

If the goal is to minimize loss, a local maximum is usually the wrong direction.

The same calculus object can matter differently depending on the objective.

Whether a maximum is good or bad depends on what the system is trying to optimize.


Not Every Flat Point Is A Maximum

Zero derivative is not enough.

A flat point could be:

local minimum
local maximum
saddle point
plateau

Surrounding behavior decides the type.

A local maximum depends on nearby values, not just flatness.


Final Summary

  • A local maximum is higher than nearby values.
  • It is not necessarily the highest value overall.
  • Smooth local maxima often have zero derivative.
  • In multiple dimensions, nearby movement in every direction lowers the value.
  • The importance of a local maximum depends on the objective.

~/writing/math-foundations-for-reasoning-models $ open

Continue the series.

Saddle Point