Distill
25 stories
Distill
DistillResearchUnderstanding Convolutions on Graphs Understanding the building blocks and design choices of graph neural networks.
Distill
DistillResearchA Gentle Introduction to Graph Neural Networks What components are needed for building learning algorithms that leverage the structure and properties of graphs?
Distill
DistillResearchDistill Hiatus After five years, Distill will be taking a break.
Distill
DistillResearchAdversarial Reprogramming of Neural Cellular Automata Reprogramming Neural CA to exhibit novel behaviour, using adversarial attacks.
Distill
DistillResearchWeight Banding Weights in the final layer of common visual models appear as horizontal bands. We investigate how and why.
Distill
DistillResearchBranch Specialization When a neural network layer is divided into multiple branches, neurons self-organize into coherent groupings.
Distill
DistillResearchMultimodal Neurons in Artificial Neural Networks We report the existence of multimodal neurons in artificial neural networks, similar to those found in the human brain.
Distill
DistillResearchSelf-Organising Textures Neural Cellular Automata learn to generate textures, exhibiting surprising properties.
Distill
DistillResearchVisualizing Weights We present techniques for visualizing, contextualizing, and understanding neural network weights.
Distill
DistillResearchCurve Circuits Reverse engineering the curve detection algorithm from InceptionV1 and reimplementing it from scratch.
Distill
DistillResearchHigh-Low Frequency Detectors A family of early-vision neurons reacting to directional transitions from high to low spatial frequency.
Distill
DistillResearchNaturally Occurring Equivariance in Neural Networks Neural networks naturally learn many transformed copies of the same feature, connected by symmetric weights.
Distill
DistillResearchUnderstanding RL Vision With diverse environments, we can analyze, diagnose and edit deep reinforcement learning models using attribution.
Distill
DistillResearchCommunicating with Interactive Articles Examining the design of interactive articles by synthesizing theory from disciplines such as education, journalism, and visualization.
Distill
DistillResearchThread: Differentiable Self-organizing Systems A collection of articles and comments with the goal of understanding how to design robust and general purpose self-organizing systems.
Distill
DistillResearchSelf-classifying MNIST Digits Training an end-to-end differentiable, self-organising cellular automata for classifying MNIST digits.
Distill
DistillResearchCurve Detectors Part one of a three part deep dive into the curve neuron family.
Distill
DistillResearchExploring Bayesian Optimization How to tune hyperparameters for your machine learning model using Bayesian optimization.
Distill
DistillResearchAn Overview of Early Vision in InceptionV1 An overview of all the neurons in the first five layers of InceptionV1, organized into a taxonomy of 'neuron groups.'
Distill
DistillResearchVisualizing Neural Networks with the Grand Tour By focusing on linear dimensionality reduction, we show how to visualize many dynamic phenomena in neural networks.
Distill
DistillResearchThread: Circuits What can we learn if we invest heavily in reverse engineering a single neural network?
Distill
DistillResearchZoom In: An Introduction to Circuits By studying the connections between neurons, we can find meaningful algorithms in the weights of neural networks.
Distill
DistillResearchGrowing Neural Cellular Automata Training an end-to-end differentiable, self-organising cellular automata model of morphogenesis, able to both grow and regenerate specific patterns.
Distill
DistillResearchVisualizing the Impact of Feature Attribution Baselines Exploring the baseline input hyperparameter, and how it impacts interpretations of neural network behavior.
Nothing matches this filter yet.