/

Distill

25 stories

Distill

DistillResearchUnderstanding Convolutions on Graphs Understanding the building blocks and design choices of graph neural networks.

September 2
Distill

DistillResearchA Gentle Introduction to Graph Neural Networks What components are needed for building learning algorithms that leverage the structure and properties of graphs?

September 2
Distill

DistillResearchDistill Hiatus After five years, Distill will be taking a break.

July 2
Distill

DistillResearchAdversarial Reprogramming of Neural Cellular Automata Reprogramming Neural CA to exhibit novel behaviour, using adversarial attacks.

May 6
Distill

DistillResearchWeight Banding Weights in the final layer of common visual models appear as horizontal bands. We investigate how and why.

April 8
Distill

DistillResearchBranch Specialization When a neural network layer is divided into multiple branches, neurons self-organize into coherent groupings.

April 5
Distill

DistillResearchMultimodal Neurons in Artificial Neural Networks We report the existence of multimodal neurons in artificial neural networks, similar to those found in the human brain.

March 4
Distill

DistillResearchSelf-Organising Textures Neural Cellular Automata learn to generate textures, exhibiting surprising properties.

February 11
Distill

DistillResearchVisualizing Weights We present techniques for visualizing, contextualizing, and understanding neural network weights.

February 4
Distill

DistillResearchCurve Circuits Reverse engineering the curve detection algorithm from InceptionV1 and reimplementing it from scratch.

January 30
Distill

DistillResearchHigh-Low Frequency Detectors A family of early-vision neurons reacting to directional transitions from high to low spatial frequency.

January 27
Distill

DistillResearchNaturally Occurring Equivariance in Neural Networks Neural networks naturally learn many transformed copies of the same feature, connected by symmetric weights.

December 8
Distill

DistillResearchUnderstanding RL Vision With diverse environments, we can analyze, diagnose and edit deep reinforcement learning models using attribution.

November 17
Distill

DistillResearchCommunicating with Interactive Articles Examining the design of interactive articles by synthesizing theory from disciplines such as education, journalism, and visualization.

September 11
Distill

DistillResearchThread: Differentiable Self-organizing Systems A collection of articles and comments with the goal of understanding how to design robust and general purpose self-organizing systems.

August 27
Distill

DistillResearchSelf-classifying MNIST Digits Training an end-to-end differentiable, self-organising cellular automata for classifying MNIST digits.

August 27
Distill

DistillResearchCurve Detectors Part one of a three part deep dive into the curve neuron family.

June 17
Distill

DistillResearchExploring Bayesian Optimization How to tune hyperparameters for your machine learning model using Bayesian optimization.

May 5
Distill

DistillResearchAn Overview of Early Vision in InceptionV1 An overview of all the neurons in the first five layers of InceptionV1, organized into a taxonomy of 'neuron groups.'

April 1
Distill

DistillResearchVisualizing Neural Networks with the Grand Tour By focusing on linear dimensionality reduction, we show how to visualize many dynamic phenomena in neural networks.

March 16
Distill

DistillResearchThread: Circuits What can we learn if we invest heavily in reverse engineering a single neural network?

March 10
Distill

DistillResearchZoom In: An Introduction to Circuits By studying the connections between neurons, we can find meaningful algorithms in the weights of neural networks.

March 10
Distill

DistillResearchGrowing Neural Cellular Automata Training an end-to-end differentiable, self-organising cellular automata model of morphogenesis, able to both grow and regenerate specific patterns.

February 11
Distill

DistillResearchVisualizing the Impact of Feature Attribution Baselines Exploring the baseline input hyperparameter, and how it impacts interpretations of neural network behavior.

January 10