Author name: Distill

Uncategorised

Weight Banding

Weights in the final layer of common visual models appear as horizontal bands. We investigate how and why.

Uncategorised

Branch Specialization

When a neural network layer is divided into multiple branches, neurons self-organize into coherent groupings.

Uncategorised

Visualizing Weights

We present techniques for visualizing, contextualizing, and understanding neural network weights.

Uncategorised

Curve Circuits

Reverse engineering the curve detection algorithm from InceptionV1 and reimplementing it from scratch.

Scroll to Top