Understanding Deep Learning Through Neuron Deletion

Deep neural networks are composed of many individual neurons, which combine in complex and counterintuitive ways to solve challenging tasks, ranging from machine translation to Go. This complexity grants neural networks their power but also earns them their reputation as confusing and opaque black boxes. Understanding how deep neural networks function is critical for explaining their decisions and enabling us to build more powerful systems.

For instance, imagine the difficulty of trying to build a clock without understanding how individual gears fit together. One approach to understanding neural networks, both in neuroscience and deep learning, is to investigate the role of individual neurons, especially those which are easily interpretable.

Source: deepmind.com