The importance of computational neuroscience

Before I get started, I’d just like to quickly point to a video piece we managed to get into New Scientist!  Please see here for this very exciting media coverage!

 

Now, I wanted to write a little bit about how Inside TRAK has been useful for demonstrating why computational neuroscience is important.  You can think of computational neuroscience as a field in which we are concerned with the information processing capabilities of the brain.  We aim to understand behaviour in terms of the chemical and electrical activity of different components of the central nervous system (brain and spinal cord).  This doesn’t just mean associating certain behaviours with particular regions of the brain, though this is an important part of neuroscience and often helps guide computational work.  Rather, we look at the manner in which different regions of the brain react to different types of information, where and how this information is further propagated, and we attempt to understand how the processing that we observe might be responsible for the behaviours we observe.  This can be contrasted with psychology, for example, which tends to use a more abstract level of explanation.  So, whereas a psychologist may be more concerned with explanations of behaviour in terms of constructs like attitudes and emotions, a computational neuroscientist may prefer to interpret those same behaviours in terms of the efficiency with which certain neurons propagate information in different contexts.  It is important to realise however, that these approaches are complimentary, and can help guide each other towards better and more comprehensive theories of why we behave the way we do.  

 

In computational neuroscience, sometimes we focus on the significance of the activity of individual neurons; other times on that of the average activity in larger structures composed of millions of neurons.  The latter is referred to as the ‘systems level’, and is the level with which Inside TRAK is concerned.   Comp neuro research involves creating models of these brain systems and using them to simulate the brain activity that we observe in the biological system.  This clearly requires a detailed understanding of the neural systems in question.  Using brain imaging and other techniques, experimental neuroscientists have gathered mountains of data revealing which parts of the brain are active when we perform particular tasks. Simulations that reproduce this neural activity – like the one powering Inside TRAK – help us to test theories of how our brains work.  Inside TRAK is a great example of this.  As the model that’s powering it is based on the real neural systems we know to be involved in deciding where we look, if the model can’t drive the robot to look around, we know that we’re interpreting something wrong.  Perhaps it’s just a trivial problem; perhaps our model is too high level and we haven’t modelled sufficient detail.  Alternatively, we may have completely misunderstood something about the way the system works. 

 

However, this is by no means the only reason why it’s important.  It’s not until you try to emulate a behaviour that you are forced to address the assumptions and omissions you might have made in your theory.  I like to call it the ‘magic box’ problem.  It’s all too easy for us to brush over what’s really happening in the brain by explaining behaviour in terms of things we all instinctively think we understand, but find it very hard to explain what we really mean.  If we think about this in terms of Inside TRAK, we might say that the robot weighs up the pros and cons of looking left or right, and that’s how it decides to look one way or the other.  We may feel as though we’ve explained what’s going on as ‘weigh-up-pros-and-cons’ is a very instinctive process to us.  This, however, is the ‘magic box’.  Several options are introduced to the magic box, something happens inside it, and out pops the decision.  Until we can simulate what’s happening in that box in terms of the brain though, we don’t understand what the brain is doing.   Observing the behaviour of models we have built also helps us to generate predictions about what is happening in the brain, as we can poke and prod it in ways we can’t do with biological systems.  We can systematically vary parameters that are representative of very real things in the brain, and examine the subsequent behavioural effects in order to further understand the biological systems on which our models are based.   I could go on, but this post is probably dragging as it is, so I’ll stop there and point you to an excellent essay by Joshua Epstein about why modelling is important.  It’s neither long nor boring (possibly unlike this post), so I really recommend it.  

 

Next post: a more detailed look at the function of iTRAK with some pretty pictures and everything.

 

 

Art and science on radio Sheffield

The iTRAK exhibition has been going down a storm, with a packed opening event and TRAK incidentally participating in seminars held at Access Space.

 

A more extended post will be coming shortly, but for now here’s a recording of Jon Chambers, one of the model’s developers, and Dora Militaru, the artist, talking to Kate Lindeholm from BBC radio Sheffield.

Inside_TRAK_Radio_Sheffield.mp3 (6.62 mb)

InsideTRAK Launches

Welcome to the beginning of InsideTRAK – a three-week long exhibition in Sheffield, with a brand new artistic concept and fusion of science and the arts.

What is TRAK?

TRAK is a robotic ‘eye’ – more specifically, it’s a camera mounted on a pan-tilt frame.  It can move around with roughly the same degrees of freedom as our own eyes can.  The really interesting thing about TRAK though, is that it is driven by a computer simulation of the human ‘oculomotor’ system.  This is the part of our brain which decides what to look at, and directs our eyes to look at it.  At the exhibition, you can interact with TRAK, and try to influence the way it looks around the room.

 

Why is that interesting?

While the problem of where to look might not seem difficult, it is actually a phenomenally complex task.  Our visual environment is extremely rich, often ambiguous, constantly changing, and full of information – some of it important, some of it not.  Somehow, we are able to ignore the not so important and be ready to respond to unexpected and possibly life-saving visual information.  Our brains solve this problem in a remarkably efficient way, though a significant proportion of the brain is involved in solving this problem, and many different sub-functions are brought together.  Some of the brain regions involved are:

 

V1, or ‘primary visual cortex’.  This is at the brain’s surface, at the lower back of the brain.  It deals with very primitive visual information, like edges.

IT or ‘inferotemporal cortex’.  This is also a surface structure, but at the sides of the head.  This deals with more complex visual information, and is important for object recognition.

Basal ganglia.  This is a group of structures buried deep in the brain.  The basal ganglia are believed to be involved in solving the ‘action selection’ problem, or deciding which action to perform at any given time.  In this case, we’re looking at where to move our eyes.

LIP, or ‘lateral intraparietal cortex’.  Again at the brain’s surface, this is involved with locating the position of interesting things in our visual field.

 

What’s all this got to do with robots?

By simulating these and other brain regions involved, we are able to create a system that drives the robot eye to look around its environment in the same way that we do.  This is not like building an artificially intelligent robot eye.  The really interesting this about TRAK is that it might make the same mistakes that a human would, and get confused about what it’s looking at if the environment is too ambiguous.  It will also get bored of repetitive, predictable things happening, so you have to mix it up!

 

Sounds like it performs worse than an ordinary computer program.  Why bother?

‘Worse’ is the wrong way of looking at it.  We’re not trying to design a perfect system.  An important part of studying brain systems is being aware of the ‘bugs’ in them.  Only when we see the same bugs in our simulations can we be sure we’re really beginning to understand how those brain systems work.  Building computer simulations is thus a really interesting and important way of testing how good our knowledge about these systems really is.   If our systems don’t work the same way brains do, we’ve done something wrong and we need to revise our theory.

 

Okay, you’ve convinced me on the science.  What about the art?

The simulated brain activity that is observed as TRAK’s visual environment changes and as it looks around can be seen in the form of ‘maps’ of TRAK’s visual field.  Depending on the brain region, these maps will show different types of neural activity.  They’re pretty exciting to look at.  We’ve projected them onto a big sculpture of the brain.  So not only can visitors to the exhibition interact with TRAK by visually stimulating it providing an artistic concept, they can also see the results of that interaction projected across the brain, providing an aesthetic visual element too.

 

Sounds brilliant.  Where can I find it?

It’s on at Access Space, 1 Sidney Street, Sheffield, S1 4RG.  Access Space’s website can be found here.  They’re a new media lab and worth checking out in their own right.

 

And when is it on?

It starts tonight, 9th July, at 5:30pm.  It’s on until 30th July.

 

Where can I find out more information about it?

The exhibition has a dedicated website here, with information about the clever people involved in setting it up.

The University of Sheffield has kindly put up our press release covering the exhibition, too.

TRAK is also tweeting – do follow for updates.

And of course, this blog and the Brainwaves events page will be updated as the exhibition progresses.

 

Anything else I should know?

There will be some talks and workshops by the developers and artistic team on Friday, 16th July from 2pm.