center for brain and cognitive science mind reading for cognitive systems yong-ho lee center for...

Center for Brain and Cognitive Science

Mind Reading for Cognitive Systems

Yong-Ho LeeCenter for Brain & Cognitive Research

Korea Research Institute of Standards and Science


ACS: Artificial Cognitive System

ACS

Natural Cognition

Natural & LifeSciences,Neuroscience

Computing,Sensing,Imaging

Cogno-

Bio-Info-

Cognitive system in FP6

http://kr.blog.yahoo.com/ekdrn

Artificial Cognitive System Human Cognitive System


“Cognitive systems are natural or artificial

information processing systems,

including those responsible for perception,

learning, reasoning and decision making and

for communication and action.”

- Foresight Cognitive Systems Project-

What is a cognitive system?


Self-organization in the nervous system 1014 connections between 1010 neurons in neo-cortex

Human computers : 1012 processors Sensory processing : sight, hearing, touch and so on Social cognition Interaction, Planning and Motivation Memory, Reasoning and Learning Advanced Neuroscience Technologies

Foresight Cognitive Systems Project


Mind reading

Interface & Interaction

Brain signals or Biological signals

Information


Imaging tools

fMRI MEG

EEG

PET

NIRS

ECoG

Metabolism Electrophysiology

Brain reading tools?


Windows to the Brain

Metabolic change

Electric activity

Cognitive process : Changes of brain activity in time and space


Functional MRI

+ High spatial resolution- Poor temporal resolution

Most common device for brain study

Imaging of hemodynamic change High-field MRI


In viewing pictures of different categories (face, house, and painting)

Maël Lebreton et al, Neuron (2009)

fMRI

Different activation area in the brain


Hemoglobin

Near IR Scattered

Blood vessel

Skin

Brain

NIRS : Near InfraRed Spectroscopy

Dong-il SHIMADZU Corp.


Deoxy Hb

Oxy Hb

780nm, 805nm, 830nm

Absorption spectrum of Hemoglobin

Near IR

Total HbOxy Hb

Deoxy Hb

Task 　　　 Task 　　　Task

Dong-il SHIMADZU Corp.

Relative change of Hb

Finger tapping task

NIRS signals


EEG HydroCel Geodesic Sensor

http://www.egi.com/clinical-division-clinical-products/c-gsh

Electroencephalography

Source localization

Besa, MEGIS Software GmbH

Susceptive to electric conductivity inhomogeneity of the brain


MEG System

MEG (Magnetoencephalography)

Localization of active currents

+ High temporal resolution + Measure neural current + Moderate spatial resolution - Need inverse problem process - Poor sensitivity to deep sources


Brain: Real time processor in ms time scale

►EEG, MEG-non invasive information with high temporal resolution

Temporal resolution : Role of MEG

Timing of human cortical functions during cognition


- Simultaneous imaging of neural current & anatomical structure

- Measurement field : ~ μT

- Nuclear magnetic resonance frequency = ~ Neural activity frequency

- Imaging of neural current distribution

Direct Imaging of Neural Current

Imaging of neural activity


Magnetically shielded room

Stimulus control

Insert

Dewar

RF shielding

Stimulus

FLL circuits

Controller

Filter/AmpSQUID

Signal processingSource analysis

Bp

Bm

Gradient fields

Data acquisition system

Controlled current source

Direct Imaging of Neural Current


New MRI : MRI at microTesla field

Ultra-low field MRI


http://article.joins.com/article/photo/article.asp?Total_ID=3311491&p_cat=life

Biological signals - Heart rate - Respiration rate - Face temperature

Mind reading device - Molintent

<Camera and Sensor system>


Game : Connecting Your Brain to the Game

http://www.emotiv.com/

Application of Mind Reading

Brain-Computer InterfaceLie DetectionPreference Survey…

http://www.neurosciencemarketing.com/

Neuromarketing


Control of a Robot Arm by Human Thought Alone

Brain-Machine Interface

<fMRI image>

http://www.studybusiness.com/HTML/TRM/02173-06-2006-TRM-11-K.htm

<Pattern analysis>

<Control of Robot Arm>


Control of a Robot by Human Thought Alone

Brain-Machine Interface

Matching accuracy > 90%

http://www.youtube.com/watch?v=O6yI_4FHSKI

EEG + NIRS


Mind Reading : Until now, reading of only simple thought is possible Both temporal and spatial resolution are important Neural current vs. Metabolic change Golden standard method to be used as the reference for brain

activation patterns when several imaging modalities are combined?

Ethic issue

Summary

center for brain and cognitive science mind reading for cognitive systems yong-ho lee center for...

Documents