~/tedtes/writing/math-foundations-for-reasoning-models

~/writing/math-foundations-for-reasoning-models $ ls

Structured Neural Architectures

Filter

A filter is a learned pattern used by a convolution to detect a specific local signal.

~/writing/math-foundations-for-reasoning-models $ cat topic.md

Filter

Definition

A filter is a learned pattern used in a convolution.

It is applied to small local regions of the input.

Basic idea:

filter + local input region -> response value

A filter detects whether a local pattern is present.


What A Filter Learns

A filter learns weights.

Those weights define what local pattern it responds to.

Example:

filter weights:
some values positive
some values negative
some values near zero

The learned weights determine what kind of local structure produces a high response.

A filter is a trainable local pattern detector.


One Filter, Many Positions

The same filter is applied across many positions.

position 1 -> response
position 2 -> response
position 3 -> response

This means the filter can detect the same pattern wherever it appears.

A filter is reused across the input.


Multiple Filters

A convolutional layer can use many filters.

Each filter can learn a different pattern.

Example:

filter 1 -> detects pattern A
filter 2 -> detects pattern B
filter 3 -> detects pattern C

Together, they produce multiple feature maps.

Multiple filters let a layer detect multiple local patterns.


Final Summary

  • A filter is a learned local pattern.
  • It is used inside convolution.
  • It produces response values at different positions.
  • The same filter is reused across the input.
  • Multiple filters detect multiple kinds of patterns.
  • Filters are learned through training.

~/writing/math-foundations-for-reasoning-models $ open

Continue the series.

Kernel