Andrew Schwartz
Keynote speakers
- Kenji Doya
- Alon Halevy
- Astrid Prinz
- Andrew Schwartz
- Shankar Subramaniam
- Arthur Toga
Workshop speakers
- Bart ter Haar Romeny
- Uri Eden
- Klaus Linkenkaer-Hansen
- Tim Clark
- Alan Ruttenberg
- Jeffrey Grethe
- Arnd Roth
- Wulfram Gerstner
- Peter Hunter
- Markus Diesmann
- Andrey Semin
- Pietro Liò
- Albert Cardona
- Giorgio Ascoli
- Rolf Kötter
Andrew Schwartz
Title: Useful signals from motor cortex
University of Pittsburgh, Pittsburgh, USA
Abstract: Over the years, we have shown that detailed predictive information of the arm's trajectory can be extracted from populations of single unit recordings from motor cortex. Using drawing movements as a behavioral paradigm, these signals have been shown to contain instantaneous velocity information and many of the invariants describing animate movement. Furthermore, this technique can be used to study visuo-perceptual processes taking place as objects are drawn. By developing techniques to record these populations and process the signal in real-time, we have been successful in demonstrating the efficacy of these recordings as a control signal for intended movements in 3D space.
Having shown that closed-loop control of a cortical prosthesis can produce very good brain-controlled movements in virtual reality, we have been extending this work to robot control. We are using an anthropomorphic robot arm with our closed-loop system to show how monkeys can control the robot's movement with direct brain-control in a self-feeding task. The animals control the arm continuously in 3D space to reach out to the food and retrieve it to their mouths. Since the recorded signals are a high fidelity representation of the intended behavior and contain features of animate movement, neural prosthetic devices derived from this technology are capable of producing agile, natural movement. Current experiments are designed to extract wrist, hand and finger movement from populations of cortical activity and use this to control a mechanical facsimile of the appendage.
Recently we have been using the brain-control paradigm to examine learning as it takes place across the network of recorded neurons. Our paradigm allows us to drive neurons to adapt new tuning functions and we can track this process continuously as it takes place. This shows that there are distinct global and local processes taking place as subjects regulate their neural activity when learning to operate novel tools.
Bio sketch: Dr. Schwartz received his Ph.D. from the University of Minnesota in 1984. He then went on to a postdoctoral fellowship at the Johns Hopkins School of Medicine where he worked with Dr. Apostolos Georgopoulos, who was developing the concept of directional tuning and population-based movement representation in the motor cortex.
In 1988, Dr. Schwartz began his independent research career at the Barrow Neurological Institute in Phoenix. There, he developed a paradigm to explore the continuous cortical signals generated throughout volitional arm movements. This was done using monkeys trained to draw shapes while recording single-cell activity from their motor cortices. After developing the ability to capture a high fidelity representation of movement intention from the motor cortex, Schwartz teamed up with engineering colleagues at Arizona State University to develop cortical neural prosthetics. The work has progressed to the point that monkeys can now use these recorded signals to control motorized arm prostheses to reach out grasp a piece of food and return it to the mouth.
Schwartz moved from the Barrow Neurological Institute to the Neurosciences Institute in San Diego in 1995 and then to the University of Pittsburgh in 2002. In addition to the prosthetics work, he continues to use systems approaches to study basic mechanisms of volitional performance.