Despite billions of dollars spent and decades of research, computation in the human brain remains largely a mystery. Meanwhile, we have made great strides in the development of artificial neural networks, which are designed to loosely mimic how brains compute. We have learned a lot about the nature of neural computation from these artificial brains and it鈥檚 time to take what we鈥檝e learned and apply it back to the biological ones.
, making a better understanding of computation in the brain a pressing problem. Given the ability of modern artificial neural networks to solve complex problems, a framework for neuroscience guided by machine learning insights may unlock valuable secrets about our own brains and how they can malfunction.
Our thoughts and behaviours are generated by computations that take place in our brains. To effectively treat neurological disorders that alter our thoughts and behaviours, like schizophrenia or depression, we likely have to understand how the computations in the brain go wrong.
However, understanding neural computation has proven to be an immensely difficult challenge. When neuroscientists record activity in the brain, it is .
In a paper published in Nature Neuroscience, my co-authors and I argue that the lessons we have learned from artificial neural networks can .
Brain network models
Artificial neural networks are computational models that loosely mimic the integration and activation properties of real neurons. They have become ubiquitous in the field of artificial intelligence.
To construct artificial neural networks, you start by first designing the network architecture: how the different components of the network are connected to one another. Then, you define the learning goal for the architecture, such as 鈥渓earn to predict what you鈥檙e going to see next.鈥� Then, you define a rule that tells the network how to change in order to achieve that goal using the data it receives.
What you do not do is specify how each neuron in the network is going to function. You leave it up to the network to determine how each neuron should function to best accomplish the task. I believe the development of the brain is probably the product of a similar process, .
Assigning neuron roles
This calls into question the usefulness of trying to determine the functions of individual neurons in the brain, when it is possible that these neurons are the result of an optimization process much like what we see with artificial neural networks.
The different components of artificial neural networks are often very hard to understand. There鈥檚 no simple verbal or simple mathematical description that explains exactly what they do.
In our paper, we propose that the same holds true for the brain, and so we have to move away from trying to understand the role of each neuron in the brain and instead look at the brain鈥檚 architecture, that is its network structure; the optimization goals, either at the evolutionary timescale or within the person鈥檚 lifetime; and the rules by which the brain updates itself 鈥� either over generations or within a lifetime 鈥� to meet those goals. By defining these three components, we may get a much better understanding of how the brain works than by trying to state what each neuron does.
Optimizing frameworks
One successful application of this approach has shown that the dopamine releasing neurons in the brain appear to encode information about unexpected rewards, e.g. unexpected delivery of some food. This sort of signal, called a reward prediction error, is often used to train artificial neural networks to maximize the rewards they get.
For example, by programming an artificial neural network to interpret points received in a video game as a reward, you can use reward prediction errors to train the network how to play the video game. In the real brain, as in the artificial neural networks, even if we don鈥檛 understand what each individual signal means, we can understand the role of these neurons and the neurons that receive their signals in relation to the learning goal of maximizing rewards.
While current theories in systems neuroscience are beautiful and insightful, I believe a cohesive framework founded in the way in which evolution and learning shape our brain could fill in a lot the blanks we have been struggling with.
To make progress in systems neuroscience, it will take both bottom-up descriptive work, such as tracing out the connections and gene expression patterns of cells in the brain, and top-down theoretical work, using artificial neural networks to understand learning goals and learning rules.
Given the ability of modern artificial neural networks to solve complex problems, a framework for systems neuroscience guided by machine learning insights may unlock valuable secrets about the human brain.
is an assistant professor at The Neuro and the School of Computer Science of . This article is republished from under a Creative Commons license. Read the .
