present literature - thomas jefferson universitybrain machine interfaces the link between...
TRANSCRIPT
![Page 1: Present Literature - Thomas Jefferson UniversityBrain Machine Interfaces The link between Neurosurgery and Artificial Intelligence Steven Falowski, MD Ashwini Sharan, MD Thomas Jefferson](https://reader030.vdocuments.site/reader030/viewer/2022040414/5f19d87e761e60268b0b998e/html5/thumbnails/1.jpg)
Brain Machine Interfaces The link between Neurosurgery
and Artificial Intelligence
Steven Falowski, MD Ashwini Sharan, MD
Thomas Jefferson University Hospital
![Page 2: Present Literature - Thomas Jefferson UniversityBrain Machine Interfaces The link between Neurosurgery and Artificial Intelligence Steven Falowski, MD Ashwini Sharan, MD Thomas Jefferson](https://reader030.vdocuments.site/reader030/viewer/2022040414/5f19d87e761e60268b0b998e/html5/thumbnails/2.jpg)
Present Literature
![Page 3: Present Literature - Thomas Jefferson UniversityBrain Machine Interfaces The link between Neurosurgery and Artificial Intelligence Steven Falowski, MD Ashwini Sharan, MD Thomas Jefferson](https://reader030.vdocuments.site/reader030/viewer/2022040414/5f19d87e761e60268b0b998e/html5/thumbnails/3.jpg)
Media
![Page 4: Present Literature - Thomas Jefferson UniversityBrain Machine Interfaces The link between Neurosurgery and Artificial Intelligence Steven Falowski, MD Ashwini Sharan, MD Thomas Jefferson](https://reader030.vdocuments.site/reader030/viewer/2022040414/5f19d87e761e60268b0b998e/html5/thumbnails/4.jpg)
History
René Descartes l Founder of “Modern Philosophy" and “Modern Mathematics”
l Bodies are complex machines
l Invented the Cartesian coordinate system
![Page 5: Present Literature - Thomas Jefferson UniversityBrain Machine Interfaces The link between Neurosurgery and Artificial Intelligence Steven Falowski, MD Ashwini Sharan, MD Thomas Jefferson](https://reader030.vdocuments.site/reader030/viewer/2022040414/5f19d87e761e60268b0b998e/html5/thumbnails/5.jpg)
The Beginning
DBS l Pain Disorders l Chronic Pain l Psychiatric Disorders
![Page 6: Present Literature - Thomas Jefferson UniversityBrain Machine Interfaces The link between Neurosurgery and Artificial Intelligence Steven Falowski, MD Ashwini Sharan, MD Thomas Jefferson](https://reader030.vdocuments.site/reader030/viewer/2022040414/5f19d87e761e60268b0b998e/html5/thumbnails/6.jpg)
Where are we Now?
• DBS/Neuromodulation l Parkinson's l Epilepsy: Vagus Nerve Stimulator
• Neuroprosthetics
![Page 7: Present Literature - Thomas Jefferson UniversityBrain Machine Interfaces The link between Neurosurgery and Artificial Intelligence Steven Falowski, MD Ashwini Sharan, MD Thomas Jefferson](https://reader030.vdocuments.site/reader030/viewer/2022040414/5f19d87e761e60268b0b998e/html5/thumbnails/7.jpg)
Neuroprosthetics
Artificial devices used to replace damaged or missing parts of the brain l Cochlear Implant l Visual prosthesis/retinal implants
![Page 8: Present Literature - Thomas Jefferson UniversityBrain Machine Interfaces The link between Neurosurgery and Artificial Intelligence Steven Falowski, MD Ashwini Sharan, MD Thomas Jefferson](https://reader030.vdocuments.site/reader030/viewer/2022040414/5f19d87e761e60268b0b998e/html5/thumbnails/8.jpg)
Cochlear Implant
Stimulates nerves Need some nerve fibers First implanted in 1978
![Page 9: Present Literature - Thomas Jefferson UniversityBrain Machine Interfaces The link between Neurosurgery and Artificial Intelligence Steven Falowski, MD Ashwini Sharan, MD Thomas Jefferson](https://reader030.vdocuments.site/reader030/viewer/2022040414/5f19d87e761e60268b0b998e/html5/thumbnails/9.jpg)
Retinal Implants
Used in diseases of progressive blindness Degradation of photoreceptor cells l macular degeneration l retinitis pigmentosa Two chip System l Recognition l Transmission
![Page 10: Present Literature - Thomas Jefferson UniversityBrain Machine Interfaces The link between Neurosurgery and Artificial Intelligence Steven Falowski, MD Ashwini Sharan, MD Thomas Jefferson](https://reader030.vdocuments.site/reader030/viewer/2022040414/5f19d87e761e60268b0b998e/html5/thumbnails/10.jpg)
The Idea
Now l Neuromodulation l Neuroprosthetics
Future l Enhancement l Replacement
![Page 11: Present Literature - Thomas Jefferson UniversityBrain Machine Interfaces The link between Neurosurgery and Artificial Intelligence Steven Falowski, MD Ashwini Sharan, MD Thomas Jefferson](https://reader030.vdocuments.site/reader030/viewer/2022040414/5f19d87e761e60268b0b998e/html5/thumbnails/11.jpg)
Where we are Going
Neurocontrol l Functional Electrical Stimulation Brain Machine Interface
![Page 12: Present Literature - Thomas Jefferson UniversityBrain Machine Interfaces The link between Neurosurgery and Artificial Intelligence Steven Falowski, MD Ashwini Sharan, MD Thomas Jefferson](https://reader030.vdocuments.site/reader030/viewer/2022040414/5f19d87e761e60268b0b998e/html5/thumbnails/12.jpg)
FES “Cyborg” l Kevin Warwick/University of
Reading l Implanted electrode array into
his forearm
Used recordings for different functions Controlled an artificial hand
![Page 13: Present Literature - Thomas Jefferson UniversityBrain Machine Interfaces The link between Neurosurgery and Artificial Intelligence Steven Falowski, MD Ashwini Sharan, MD Thomas Jefferson](https://reader030.vdocuments.site/reader030/viewer/2022040414/5f19d87e761e60268b0b998e/html5/thumbnails/13.jpg)
Brain Machine Interface
Neural Networks Four main Functions l Motor l Sensory l Behavior l Intelligence/Cognition
![Page 14: Present Literature - Thomas Jefferson UniversityBrain Machine Interfaces The link between Neurosurgery and Artificial Intelligence Steven Falowski, MD Ashwini Sharan, MD Thomas Jefferson](https://reader030.vdocuments.site/reader030/viewer/2022040414/5f19d87e761e60268b0b998e/html5/thumbnails/14.jpg)
Neural Networks
Backpropagation 1. Present a training sample to the neural network. 2. Compare the network's output to the desired output from that sample.
Calculate the error in each output neuron. 3. For each neuron, calculate what the output should have been, and a scaling
factor, how much lower or higher the output must be adjusted to match the desired output. This is the local error.
4. Adjust the weights of each neuron to lower the local error. 5. Assign "blame" for the local error to neurons at the previous level, giving
greater responsibility to neurons connected by stronger weights. 6. Repeat the steps above on the neurons at the previous level, using each
one's "blame" as its error.
![Page 15: Present Literature - Thomas Jefferson UniversityBrain Machine Interfaces The link between Neurosurgery and Artificial Intelligence Steven Falowski, MD Ashwini Sharan, MD Thomas Jefferson](https://reader030.vdocuments.site/reader030/viewer/2022040414/5f19d87e761e60268b0b998e/html5/thumbnails/15.jpg)
Neural Networks
Based on the Perceptron Perceptrons can be added in series or parallel. Summation of input and output vectors More networks=increase speed
![Page 16: Present Literature - Thomas Jefferson UniversityBrain Machine Interfaces The link between Neurosurgery and Artificial Intelligence Steven Falowski, MD Ashwini Sharan, MD Thomas Jefferson](https://reader030.vdocuments.site/reader030/viewer/2022040414/5f19d87e761e60268b0b998e/html5/thumbnails/16.jpg)
Neural Networks
![Page 17: Present Literature - Thomas Jefferson UniversityBrain Machine Interfaces The link between Neurosurgery and Artificial Intelligence Steven Falowski, MD Ashwini Sharan, MD Thomas Jefferson](https://reader030.vdocuments.site/reader030/viewer/2022040414/5f19d87e761e60268b0b998e/html5/thumbnails/17.jpg)
Comparison
Conventional computers l use an algorithm l Restricts it to problems with known solutions
Neural Networks l Learn by trial and error
l Functions by example
![Page 18: Present Literature - Thomas Jefferson UniversityBrain Machine Interfaces The link between Neurosurgery and Artificial Intelligence Steven Falowski, MD Ashwini Sharan, MD Thomas Jefferson](https://reader030.vdocuments.site/reader030/viewer/2022040414/5f19d87e761e60268b0b998e/html5/thumbnails/18.jpg)
Brain Implants
Biological neural networks: Stimulate one or groups of neurons Made of silicon or platinum Mimic neurons Replace damaged or dead brain cells
![Page 19: Present Literature - Thomas Jefferson UniversityBrain Machine Interfaces The link between Neurosurgery and Artificial Intelligence Steven Falowski, MD Ashwini Sharan, MD Thomas Jefferson](https://reader030.vdocuments.site/reader030/viewer/2022040414/5f19d87e761e60268b0b998e/html5/thumbnails/19.jpg)
Important Considerations
Complexity of neural connections Stable connection Plasticity of the human brain
![Page 20: Present Literature - Thomas Jefferson UniversityBrain Machine Interfaces The link between Neurosurgery and Artificial Intelligence Steven Falowski, MD Ashwini Sharan, MD Thomas Jefferson](https://reader030.vdocuments.site/reader030/viewer/2022040414/5f19d87e761e60268b0b998e/html5/thumbnails/20.jpg)
Answers?
Create bridges for damaged cells Compatible brain tissue or molecules that will adhere to brain tissue Sensory Substitution
![Page 21: Present Literature - Thomas Jefferson UniversityBrain Machine Interfaces The link between Neurosurgery and Artificial Intelligence Steven Falowski, MD Ashwini Sharan, MD Thomas Jefferson](https://reader030.vdocuments.site/reader030/viewer/2022040414/5f19d87e761e60268b0b998e/html5/thumbnails/21.jpg)
Another Consideration
“Brain in a vat” theory Can stimulate and train the brain increasing capacity
![Page 22: Present Literature - Thomas Jefferson UniversityBrain Machine Interfaces The link between Neurosurgery and Artificial Intelligence Steven Falowski, MD Ashwini Sharan, MD Thomas Jefferson](https://reader030.vdocuments.site/reader030/viewer/2022040414/5f19d87e761e60268b0b998e/html5/thumbnails/22.jpg)
Brain Machine Interface
Four main Functions l Motor l Sensory l Behavior l Intelligence/Cognition
![Page 23: Present Literature - Thomas Jefferson UniversityBrain Machine Interfaces The link between Neurosurgery and Artificial Intelligence Steven Falowski, MD Ashwini Sharan, MD Thomas Jefferson](https://reader030.vdocuments.site/reader030/viewer/2022040414/5f19d87e761e60268b0b998e/html5/thumbnails/23.jpg)
Motor: Transforming Thoughts
Cyberkinetics developed a system called BrainGate l Microchip on the motor cortex l Transmission to a digitizer and then computer system for translation
![Page 24: Present Literature - Thomas Jefferson UniversityBrain Machine Interfaces The link between Neurosurgery and Artificial Intelligence Steven Falowski, MD Ashwini Sharan, MD Thomas Jefferson](https://reader030.vdocuments.site/reader030/viewer/2022040414/5f19d87e761e60268b0b998e/html5/thumbnails/24.jpg)
Transforming Thoughts1
Neural Signals l Uses a device implanted beneath the skull Helsinki University l Virtual keyboard NY Rochester Institute of Technology l Computerbrain interface Colorado State University l EEG recording of various tasks
l Writing, visualizing numbers l Uses a computer interface
![Page 25: Present Literature - Thomas Jefferson UniversityBrain Machine Interfaces The link between Neurosurgery and Artificial Intelligence Steven Falowski, MD Ashwini Sharan, MD Thomas Jefferson](https://reader030.vdocuments.site/reader030/viewer/2022040414/5f19d87e761e60268b0b998e/html5/thumbnails/25.jpg)
Transforming Thoughts2
Initial goal is interaction with computers and basic functions Future goal is to implant electrical probes directly into muscles
![Page 26: Present Literature - Thomas Jefferson UniversityBrain Machine Interfaces The link between Neurosurgery and Artificial Intelligence Steven Falowski, MD Ashwini Sharan, MD Thomas Jefferson](https://reader030.vdocuments.site/reader030/viewer/2022040414/5f19d87e761e60268b0b998e/html5/thumbnails/26.jpg)
Monkey think, Monkey Do
Dr. Nicolelis/Duke University Implant allowing monkey to control a game using thoughts Monkey could play using only visual feedback
![Page 27: Present Literature - Thomas Jefferson UniversityBrain Machine Interfaces The link between Neurosurgery and Artificial Intelligence Steven Falowski, MD Ashwini Sharan, MD Thomas Jefferson](https://reader030.vdocuments.site/reader030/viewer/2022040414/5f19d87e761e60268b0b998e/html5/thumbnails/27.jpg)
How it works
Microelectrodes along the frontal and parietal lobes Computer system recognizes patterns of signals when monkey moves
![Page 28: Present Literature - Thomas Jefferson UniversityBrain Machine Interfaces The link between Neurosurgery and Artificial Intelligence Steven Falowski, MD Ashwini Sharan, MD Thomas Jefferson](https://reader030.vdocuments.site/reader030/viewer/2022040414/5f19d87e761e60268b0b998e/html5/thumbnails/28.jpg)
Relevance
Transmitted to a robotic arm l Can control another device to move objects
l Can then use artificial limbs in paralyzed people
![Page 29: Present Literature - Thomas Jefferson UniversityBrain Machine Interfaces The link between Neurosurgery and Artificial Intelligence Steven Falowski, MD Ashwini Sharan, MD Thomas Jefferson](https://reader030.vdocuments.site/reader030/viewer/2022040414/5f19d87e761e60268b0b998e/html5/thumbnails/29.jpg)
Brain Machine Interface
Four main Functions l Motor
l Sensory l Behavior l Intelligence/Cognition
![Page 30: Present Literature - Thomas Jefferson UniversityBrain Machine Interfaces The link between Neurosurgery and Artificial Intelligence Steven Falowski, MD Ashwini Sharan, MD Thomas Jefferson](https://reader030.vdocuments.site/reader030/viewer/2022040414/5f19d87e761e60268b0b998e/html5/thumbnails/30.jpg)
Artificial Vision
Research involves using either sensory substitution versus direct cortical stimulation
![Page 31: Present Literature - Thomas Jefferson UniversityBrain Machine Interfaces The link between Neurosurgery and Artificial Intelligence Steven Falowski, MD Ashwini Sharan, MD Thomas Jefferson](https://reader030.vdocuments.site/reader030/viewer/2022040414/5f19d87e761e60268b0b998e/html5/thumbnails/31.jpg)
Brain Machine Interface
Four main Functions l Motor l Sensory
l Behavior l Intelligence/Cognition
![Page 32: Present Literature - Thomas Jefferson UniversityBrain Machine Interfaces The link between Neurosurgery and Artificial Intelligence Steven Falowski, MD Ashwini Sharan, MD Thomas Jefferson](https://reader030.vdocuments.site/reader030/viewer/2022040414/5f19d87e761e60268b0b998e/html5/thumbnails/32.jpg)
Behavior
l OCD(ventral striatum and midline thalamus)
l Depression
![Page 33: Present Literature - Thomas Jefferson UniversityBrain Machine Interfaces The link between Neurosurgery and Artificial Intelligence Steven Falowski, MD Ashwini Sharan, MD Thomas Jefferson](https://reader030.vdocuments.site/reader030/viewer/2022040414/5f19d87e761e60268b0b998e/html5/thumbnails/33.jpg)
Depression
Constant, weak electrical stimulus to area 25
Study of six patients l 4 improved
![Page 34: Present Literature - Thomas Jefferson UniversityBrain Machine Interfaces The link between Neurosurgery and Artificial Intelligence Steven Falowski, MD Ashwini Sharan, MD Thomas Jefferson](https://reader030.vdocuments.site/reader030/viewer/2022040414/5f19d87e761e60268b0b998e/html5/thumbnails/34.jpg)
Brain Machine Interface
Four main Functions l Motor l Sensory l Behavior
l Intelligence/Cognition
![Page 35: Present Literature - Thomas Jefferson UniversityBrain Machine Interfaces The link between Neurosurgery and Artificial Intelligence Steven Falowski, MD Ashwini Sharan, MD Thomas Jefferson](https://reader030.vdocuments.site/reader030/viewer/2022040414/5f19d87e761e60268b0b998e/html5/thumbnails/35.jpg)
Artificial Hippocampus
Studied at the University of Southern California Hippocampus is very ordered and structured Strictly involved in formation of new memories
![Page 36: Present Literature - Thomas Jefferson UniversityBrain Machine Interfaces The link between Neurosurgery and Artificial Intelligence Steven Falowski, MD Ashwini Sharan, MD Thomas Jefferson](https://reader030.vdocuments.site/reader030/viewer/2022040414/5f19d87e761e60268b0b998e/html5/thumbnails/36.jpg)
Artificial Hippocampus
2003 Devised a mathematical model of hippocampus l Slices of rat hippocampus were stimulated with electrical signals
l Each electrical input produces a corresponding output.
l Programmed onto a chip
![Page 37: Present Literature - Thomas Jefferson UniversityBrain Machine Interfaces The link between Neurosurgery and Artificial Intelligence Steven Falowski, MD Ashwini Sharan, MD Thomas Jefferson](https://reader030.vdocuments.site/reader030/viewer/2022040414/5f19d87e761e60268b0b998e/html5/thumbnails/37.jpg)
Artificial Hippocampus
2004 Used a grid of miniature electrodes to feed signals in and out of the microchip l Compared rat hippocampus slices to the chip l Signals matched in shape, timing and statistics
Next Step:implant in rats and then in Monkeys
![Page 38: Present Literature - Thomas Jefferson UniversityBrain Machine Interfaces The link between Neurosurgery and Artificial Intelligence Steven Falowski, MD Ashwini Sharan, MD Thomas Jefferson](https://reader030.vdocuments.site/reader030/viewer/2022040414/5f19d87e761e60268b0b998e/html5/thumbnails/38.jpg)
![Page 39: Present Literature - Thomas Jefferson UniversityBrain Machine Interfaces The link between Neurosurgery and Artificial Intelligence Steven Falowski, MD Ashwini Sharan, MD Thomas Jefferson](https://reader030.vdocuments.site/reader030/viewer/2022040414/5f19d87e761e60268b0b998e/html5/thumbnails/39.jpg)
Problems
Making long range connections to other parts of the brain Bypassing healthy tissue Development of scar tissue as well as cell death of previous neurons l electrodes coated with proteins that should mimic healthy tissue
![Page 40: Present Literature - Thomas Jefferson UniversityBrain Machine Interfaces The link between Neurosurgery and Artificial Intelligence Steven Falowski, MD Ashwini Sharan, MD Thomas Jefferson](https://reader030.vdocuments.site/reader030/viewer/2022040414/5f19d87e761e60268b0b998e/html5/thumbnails/40.jpg)
Artificial Intelligence(AI)
Intelligence exhibited by an artificial entity. l Behavior l Learning l Adaptation
![Page 41: Present Literature - Thomas Jefferson UniversityBrain Machine Interfaces The link between Neurosurgery and Artificial Intelligence Steven Falowski, MD Ashwini Sharan, MD Thomas Jefferson](https://reader030.vdocuments.site/reader030/viewer/2022040414/5f19d87e761e60268b0b998e/html5/thumbnails/41.jpg)
Artificial Intelligence(AI)
Research in AI is concerned with producing machines to automate tasks requiring intelligent behavior. l Planning l Scheduling l Problem solving
![Page 42: Present Literature - Thomas Jefferson UniversityBrain Machine Interfaces The link between Neurosurgery and Artificial Intelligence Steven Falowski, MD Ashwini Sharan, MD Thomas Jefferson](https://reader030.vdocuments.site/reader030/viewer/2022040414/5f19d87e761e60268b0b998e/html5/thumbnails/42.jpg)
Schools of Thought
Conventional AI l AKA: Machine Learning
l Demonstrates applied reasoning
l Example: Clippy
Computational Intelligence l Interactive l Learning l Example: Consumer product control systems
![Page 43: Present Literature - Thomas Jefferson UniversityBrain Machine Interfaces The link between Neurosurgery and Artificial Intelligence Steven Falowski, MD Ashwini Sharan, MD Thomas Jefferson](https://reader030.vdocuments.site/reader030/viewer/2022040414/5f19d87e761e60268b0b998e/html5/thumbnails/43.jpg)
Present Uses
Government uses AI computers to schedule units Gaming l Virtual reality l Image Processing Robotics Automation
![Page 44: Present Literature - Thomas Jefferson UniversityBrain Machine Interfaces The link between Neurosurgery and Artificial Intelligence Steven Falowski, MD Ashwini Sharan, MD Thomas Jefferson](https://reader030.vdocuments.site/reader030/viewer/2022040414/5f19d87e761e60268b0b998e/html5/thumbnails/44.jpg)
Where AI is heading..
Space Exploration Deep Ocean Exploration
Virtual Reality “Android Robots” Douglas LenatA common sense knowledge base
![Page 45: Present Literature - Thomas Jefferson UniversityBrain Machine Interfaces The link between Neurosurgery and Artificial Intelligence Steven Falowski, MD Ashwini Sharan, MD Thomas Jefferson](https://reader030.vdocuments.site/reader030/viewer/2022040414/5f19d87e761e60268b0b998e/html5/thumbnails/45.jpg)
Steven Levy
Based on Biological behaviors “Natural” rules
![Page 46: Present Literature - Thomas Jefferson UniversityBrain Machine Interfaces The link between Neurosurgery and Artificial Intelligence Steven Falowski, MD Ashwini Sharan, MD Thomas Jefferson](https://reader030.vdocuments.site/reader030/viewer/2022040414/5f19d87e761e60268b0b998e/html5/thumbnails/46.jpg)
Steven Levy
Life “in silico” Computer viruses are close to becoming “life” Artificial organisms that meet criteria of living creatures
![Page 47: Present Literature - Thomas Jefferson UniversityBrain Machine Interfaces The link between Neurosurgery and Artificial Intelligence Steven Falowski, MD Ashwini Sharan, MD Thomas Jefferson](https://reader030.vdocuments.site/reader030/viewer/2022040414/5f19d87e761e60268b0b998e/html5/thumbnails/47.jpg)
Artificial Intelligence in Medicine (AIM)
More evidence based medicine=more information=more reliance on computers Can the medical profession rely on the computer to make the right clinical assessment? Diagnosis is a process, not an event and fortunately, human cognition is still superior to machine intelligence
![Page 48: Present Literature - Thomas Jefferson UniversityBrain Machine Interfaces The link between Neurosurgery and Artificial Intelligence Steven Falowski, MD Ashwini Sharan, MD Thomas Jefferson](https://reader030.vdocuments.site/reader030/viewer/2022040414/5f19d87e761e60268b0b998e/html5/thumbnails/48.jpg)
Ethical Issues
There is little or no reason to create mechanical laborers (that can think independently) What is considered the type of human being to design as an “Android” Inability to understand complex interactions
![Page 49: Present Literature - Thomas Jefferson UniversityBrain Machine Interfaces The link between Neurosurgery and Artificial Intelligence Steven Falowski, MD Ashwini Sharan, MD Thomas Jefferson](https://reader030.vdocuments.site/reader030/viewer/2022040414/5f19d87e761e60268b0b998e/html5/thumbnails/49.jpg)
Ethical Considerations
Can you give consent? Could implants force some people to remember things they would rather forget
![Page 50: Present Literature - Thomas Jefferson UniversityBrain Machine Interfaces The link between Neurosurgery and Artificial Intelligence Steven Falowski, MD Ashwini Sharan, MD Thomas Jefferson](https://reader030.vdocuments.site/reader030/viewer/2022040414/5f19d87e761e60268b0b998e/html5/thumbnails/50.jpg)
Conclusions
Still in its infancy Very little animal or human models Designing software to mimic reasoning and deductive ability is no easy task.
![Page 51: Present Literature - Thomas Jefferson UniversityBrain Machine Interfaces The link between Neurosurgery and Artificial Intelligence Steven Falowski, MD Ashwini Sharan, MD Thomas Jefferson](https://reader030.vdocuments.site/reader030/viewer/2022040414/5f19d87e761e60268b0b998e/html5/thumbnails/51.jpg)
Final Thoughts
Materialists: world is objective matter Idealists: world is acquired from mind Kant:The Metaphysical