neural decoding: classifiers in actionmespanol/classsiam.pdfneural decoding: classifiers in action...
TRANSCRIPT
![Page 1: Neural Decoding: Classifiers in actionmespanol/ClassSIAM.pdfNeural Decoding: Classifiers in action Malena I. Español Kreiman Lab - Summer 2007 Experiment Kreiman Lab - Summer 2007](https://reader034.vdocuments.site/reader034/viewer/2022050323/5f7c9853ca4e0602de18757e/html5/thumbnails/1.jpg)
Neural Decoding: Classifiers in action
Malena I. Español
![Page 2: Neural Decoding: Classifiers in actionmespanol/ClassSIAM.pdfNeural Decoding: Classifiers in action Malena I. Español Kreiman Lab - Summer 2007 Experiment Kreiman Lab - Summer 2007](https://reader034.vdocuments.site/reader034/viewer/2022050323/5f7c9853ca4e0602de18757e/html5/thumbnails/2.jpg)
Kreiman Lab - Summer 2007
Experiment
![Page 3: Neural Decoding: Classifiers in actionmespanol/ClassSIAM.pdfNeural Decoding: Classifiers in action Malena I. Español Kreiman Lab - Summer 2007 Experiment Kreiman Lab - Summer 2007](https://reader034.vdocuments.site/reader034/viewer/2022050323/5f7c9853ca4e0602de18757e/html5/thumbnails/3.jpg)
Kreiman Lab - Summer 2007
Experiment
•
•
•
We have many electrodes (channels)
![Page 4: Neural Decoding: Classifiers in actionmespanol/ClassSIAM.pdfNeural Decoding: Classifiers in action Malena I. Español Kreiman Lab - Summer 2007 Experiment Kreiman Lab - Summer 2007](https://reader034.vdocuments.site/reader034/viewer/2022050323/5f7c9853ca4e0602de18757e/html5/thumbnails/4.jpg)
Kreiman Lab - Summer 2007
Experiment
We show several pictures
•
•
•
•
•
•
•
•
•
![Page 5: Neural Decoding: Classifiers in actionmespanol/ClassSIAM.pdfNeural Decoding: Classifiers in action Malena I. Español Kreiman Lab - Summer 2007 Experiment Kreiman Lab - Summer 2007](https://reader034.vdocuments.site/reader034/viewer/2022050323/5f7c9853ca4e0602de18757e/html5/thumbnails/5.jpg)
Kreiman Lab - Summer 2007
Categorization: Object
![Page 6: Neural Decoding: Classifiers in actionmespanol/ClassSIAM.pdfNeural Decoding: Classifiers in action Malena I. Español Kreiman Lab - Summer 2007 Experiment Kreiman Lab - Summer 2007](https://reader034.vdocuments.site/reader034/viewer/2022050323/5f7c9853ca4e0602de18757e/html5/thumbnails/6.jpg)
Kreiman Lab - Summer 2007
ResponseOptions:
N Areas N Highs (sign(x).max(|x|))Spectral Power (FFT+sum)(mean,std, median)(mean,max, maxposition)(mean, max, median)(min, max, max-min)(minposition, maxposition, minpos-maxpos)(max, maxposition, FFT+sum(Gamma))
![Page 7: Neural Decoding: Classifiers in actionmespanol/ClassSIAM.pdfNeural Decoding: Classifiers in action Malena I. Español Kreiman Lab - Summer 2007 Experiment Kreiman Lab - Summer 2007](https://reader034.vdocuments.site/reader034/viewer/2022050323/5f7c9853ca4e0602de18757e/html5/thumbnails/7.jpg)
Kreiman Lab - Summer 2007
ProcessSplit points in categoriesCount how many there are in eachCompute the smallest number sTake s points of each categoryChoose s/2 for training and s/2 for testingConstruct classifier using training pointsTest performance using testing pointsBootstrapping: shuffle categories
![Page 8: Neural Decoding: Classifiers in actionmespanol/ClassSIAM.pdfNeural Decoding: Classifiers in action Malena I. Español Kreiman Lab - Summer 2007 Experiment Kreiman Lab - Summer 2007](https://reader034.vdocuments.site/reader034/viewer/2022050323/5f7c9853ca4e0602de18757e/html5/thumbnails/8.jpg)
Kreiman Lab - Summer 2007
One Vs All (OVA)
Compute a binary classifier (one class vs. the rest of the classes) for each class.Take a test point and apply each binary classifier.Choose the class corresponding to the highest outcome.
![Page 9: Neural Decoding: Classifiers in actionmespanol/ClassSIAM.pdfNeural Decoding: Classifiers in action Malena I. Español Kreiman Lab - Summer 2007 Experiment Kreiman Lab - Summer 2007](https://reader034.vdocuments.site/reader034/viewer/2022050323/5f7c9853ca4e0602de18757e/html5/thumbnails/9.jpg)
Kreiman Lab - Summer 2007
Categorization
We have 7 categories:
1.Animals – 2.Chairs – 3.Faces –4.Fruits – 5.Legos – 6.Shoes – 7.Vehicles5 categories:
1.Animals – 2.Chairs – 3.Faces –4.Fruits – 5. old(7). Vehicles
![Page 10: Neural Decoding: Classifiers in actionmespanol/ClassSIAM.pdfNeural Decoding: Classifiers in action Malena I. Español Kreiman Lab - Summer 2007 Experiment Kreiman Lab - Summer 2007](https://reader034.vdocuments.site/reader034/viewer/2022050323/5f7c9853ca4e0602de18757e/html5/thumbnails/10.jpg)
Kreiman Lab - Summer 2007
Spectral Analysis
QuickTime™ and aTIFF (Uncompressed) decompressor
are needed to see this picture.
timeQuickTime™ and a
TIFF (Uncompressed) decompressorare needed to see this picture.
QuickTime™ and aTIFF (Uncompressed) decompressor
are needed to see this picture. QuickTime™ and aTIFF (Uncompressed) decompressor
are needed to see this picture.
QuickTime™ and aTIFF (Uncompressed) decompressor
are needed to see this picture.
QuickTime™ and aTIFF (Uncompressed) decompressor
are needed to see this picture.
∑4-7.5 Hz∑ 8-13.5 Hz∑ 14-29.5 Hz∑ 30-58 Hz∑ 62-100 Hz
logFFT 2
![Page 11: Neural Decoding: Classifiers in actionmespanol/ClassSIAM.pdfNeural Decoding: Classifiers in action Malena I. Español Kreiman Lab - Summer 2007 Experiment Kreiman Lab - Summer 2007](https://reader034.vdocuments.site/reader034/viewer/2022050323/5f7c9853ca4e0602de18757e/html5/thumbnails/11.jpg)
Kreiman Lab - Summer 2007
Looking at the Data
Subject 7 Subject 8
Using MATLAB function “imagesc” we can take a quick look at the feature matrix
![Page 12: Neural Decoding: Classifiers in actionmespanol/ClassSIAM.pdfNeural Decoding: Classifiers in action Malena I. Español Kreiman Lab - Summer 2007 Experiment Kreiman Lab - Summer 2007](https://reader034.vdocuments.site/reader034/viewer/2022050323/5f7c9853ca4e0602de18757e/html5/thumbnails/12.jpg)
Kreiman Lab - Summer 2007
Choosing Channels
Weight of Binary Classifier for Faces vs. RestUsing FFT
Average of categories of Channel 67 with p-value
Subject 9
![Page 13: Neural Decoding: Classifiers in actionmespanol/ClassSIAM.pdfNeural Decoding: Classifiers in action Malena I. Español Kreiman Lab - Summer 2007 Experiment Kreiman Lab - Summer 2007](https://reader034.vdocuments.site/reader034/viewer/2022050323/5f7c9853ca4e0602de18757e/html5/thumbnails/13.jpg)
Kreiman Lab - Summer 2007
Choosing Bands
Channel 2 : 30-58 Hz64-100 Hz
Channel 3: 14-29.5 Hz
Subject 8
Channel 2
Channel 3Binary Classifier for Faces vs. Rest
![Page 14: Neural Decoding: Classifiers in actionmespanol/ClassSIAM.pdfNeural Decoding: Classifiers in action Malena I. Español Kreiman Lab - Summer 2007 Experiment Kreiman Lab - Summer 2007](https://reader034.vdocuments.site/reader034/viewer/2022050323/5f7c9853ca4e0602de18757e/html5/thumbnails/14.jpg)
Kreiman Lab - Summer 2007
Subject 10Channels:
42, 73, 76
73-77
73-76, 88
41, 73, 75, 88
41, 73, 81, 87
All Channels
Performance
0.582+- 0.016
Performance perCategory
1. 58 %2. 52 %3. 76 %4. 56 %5. 50 %
SelectedChannels
Performance
0.6463+- 0.015
Performance perCategory
1. 65 %2. 60 %3. 79 %4. 63 %5. 56 %
![Page 15: Neural Decoding: Classifiers in actionmespanol/ClassSIAM.pdfNeural Decoding: Classifiers in action Malena I. Español Kreiman Lab - Summer 2007 Experiment Kreiman Lab - Summer 2007](https://reader034.vdocuments.site/reader034/viewer/2022050323/5f7c9853ca4e0602de18757e/html5/thumbnails/15.jpg)
Kreiman Lab - Summer 2007
Subject 6
33, 41, 42, 43, 50
33
42, 49, 57
34, 42, 50
33, 42, 49
42
42, 50
![Page 16: Neural Decoding: Classifiers in actionmespanol/ClassSIAM.pdfNeural Decoding: Classifiers in action Malena I. Español Kreiman Lab - Summer 2007 Experiment Kreiman Lab - Summer 2007](https://reader034.vdocuments.site/reader034/viewer/2022050323/5f7c9853ca4e0602de18757e/html5/thumbnails/16.jpg)
Kreiman Lab - Summer 2007
Subject 6All ChannelsPerformance
0.4178+- 0.008
Performance perCategory
1. 47 %2. 38 %3. 49 %4. 39 %5. 41 %6. 44 %7. 34 %
Selected ChannelsPerformance
0.4973+- 0.015
Performance perCategory
1. 54 %2. 45 %3. 61 %4. 48 %5. 47 %6. 50 %7. 43 %
![Page 17: Neural Decoding: Classifiers in actionmespanol/ClassSIAM.pdfNeural Decoding: Classifiers in action Malena I. Español Kreiman Lab - Summer 2007 Experiment Kreiman Lab - Summer 2007](https://reader034.vdocuments.site/reader034/viewer/2022050323/5f7c9853ca4e0602de18757e/html5/thumbnails/17.jpg)
Kreiman Lab - Summer 2007
Subject 7Channels:
13, 101
100
75, 79, 80, 100, 101
12, 97, 99
75, 98
All Channels
Performance
0.3603+- 0.0252
Performance perCategory
1. 40 %2. 34 %3. 43 %4. 34 %5. 28 %
SelectedChannels
Performance
0.4530+- 0.029
Performance perCategory
1. 48 %2. 37 %3. 61 %4. 40 %5. 41 %
![Page 18: Neural Decoding: Classifiers in actionmespanol/ClassSIAM.pdfNeural Decoding: Classifiers in action Malena I. Español Kreiman Lab - Summer 2007 Experiment Kreiman Lab - Summer 2007](https://reader034.vdocuments.site/reader034/viewer/2022050323/5f7c9853ca4e0602de18757e/html5/thumbnails/18.jpg)
Kreiman Lab - Summer 2007
Subject 10: HighsChannels:
42, 73, 76
73-77
73-76, 88
41, 73, 75, 88
41, 73, 81, 87
All Channels
Performance
0.582+- 0.016
Performance perCategory
1. 58 %2. 52 %3. 76 %4. 56 %5. 50 %
SelectedChannels
Performance
0.6463+- 0.015
Performance perCategory
1. 65 %2. 60 %3. 79 %4. 63 %5. 56 %
![Page 19: Neural Decoding: Classifiers in actionmespanol/ClassSIAM.pdfNeural Decoding: Classifiers in action Malena I. Español Kreiman Lab - Summer 2007 Experiment Kreiman Lab - Summer 2007](https://reader034.vdocuments.site/reader034/viewer/2022050323/5f7c9853ca4e0602de18757e/html5/thumbnails/19.jpg)
Kreiman Lab - Summer 2007
Implementation
Important information:sr (Samples per second)Number of channelsNumber of categoriesNumber of trials
![Page 20: Neural Decoding: Classifiers in actionmespanol/ClassSIAM.pdfNeural Decoding: Classifiers in action Malena I. Español Kreiman Lab - Summer 2007 Experiment Kreiman Lab - Summer 2007](https://reader034.vdocuments.site/reader034/viewer/2022050323/5f7c9853ca4e0602de18757e/html5/thumbnails/20.jpg)
Kreiman Lab - Summer 2007
References Neural coding: computational and biophysical perspectives by GKA Theory of Object Recognition: Computations and Circuits in the Feedforward Path of the Ventral Stream in Primate Visual Cortex by Serre, Kough, Cadieu, Knoblich, Kreiman and PoggioAn Introduction to Support Vector Machines by Cristianini, Shawe-Taylor