pcp quality assessment protocol
TRANSCRIPT
![Page 1: PCP Quality Assessment Protocol](https://reader034.vdocuments.site/reader034/viewer/2022050914/58ee69c71a28abc23c8b46a7/html5/thumbnails/1.jpg)
The Preprocessed Connectomes Project
Quality Assessment Protocol - a resource for measuring the
quality of MRI data
Cameron CraddockComputational Neuroimaging Lab
Center for Biomedical Imaging and NeuromodulationNathan S. Kline Institute for Psychiatric Research
Center for the Developing BrainChild Mind Institute
![Page 2: PCP Quality Assessment Protocol](https://reader034.vdocuments.site/reader034/viewer/2022050914/58ee69c71a28abc23c8b46a7/html5/thumbnails/2.jpg)
Neuroimaging meets big data
1,112 rs-fMRI and MRI datasets539 w/ASD, 573 Typical
1,629 Healthy Controls3,357 MRI scans
5,093 rs-fMRI scans
![Page 3: PCP Quality Assessment Protocol](https://reader034.vdocuments.site/reader034/viewer/2022050914/58ee69c71a28abc23c8b46a7/html5/thumbnails/3.jpg)
Sharing preprocessed data
• Make data available to a wider audience of researchers
• Evaluate reproducibility of analysis results
http://preprocessed-connectomes-project.github.io/
![Page 4: PCP Quality Assessment Protocol](https://reader034.vdocuments.site/reader034/viewer/2022050914/58ee69c71a28abc23c8b46a7/html5/thumbnails/4.jpg)
Which of the data do you include in an analysis?
• Use it all and hope that the introduced error will be swamped out by the large number of samples? – data quality vs. size trade-off
• Only use the best data as determined by visual inspection?– Limited by intra- and inter- rater reliability– Is the human eye good enough to identify data that is good
enough? (what is “good enough” for data?)• Choose data based on quantitative metrics?
– Which Metrics?– What thresholds?
![Page 5: PCP Quality Assessment Protocol](https://reader034.vdocuments.site/reader034/viewer/2022050914/58ee69c71a28abc23c8b46a7/html5/thumbnails/5.jpg)
Motion Crisis
![Page 6: PCP Quality Assessment Protocol](https://reader034.vdocuments.site/reader034/viewer/2022050914/58ee69c71a28abc23c8b46a7/html5/thumbnails/6.jpg)
Motion Crisis 2016
![Page 7: PCP Quality Assessment Protocol](https://reader034.vdocuments.site/reader034/viewer/2022050914/58ee69c71a28abc23c8b46a7/html5/thumbnails/7.jpg)
Manualized manual inspection
https://github.com/SIMEXP/niak_manual/blob/master/qc_manual_v1.0/qc_manual_niak.pdf
![Page 8: PCP Quality Assessment Protocol](https://reader034.vdocuments.site/reader034/viewer/2022050914/58ee69c71a28abc23c8b46a7/html5/thumbnails/8.jpg)
Quality Assessment Protocol
http://preprocessed-connectomes-project.github.io/quality-assessment-protocol/
![Page 9: PCP Quality Assessment Protocol](https://reader034.vdocuments.site/reader034/viewer/2022050914/58ee69c71a28abc23c8b46a7/html5/thumbnails/9.jpg)
Quality Assessment Protocol (2)- Open source pipeline for calculating quality assessment measures
from raw MRI data- Implemented in Python using Nipype
- Fast execution on cluster and multi-core computers- Restart processing without having to redo everything
- Uses AFNI and custom Python functions- Runs on Mac OSX, Linux, BSD, and Unix
![Page 10: PCP Quality Assessment Protocol](https://reader034.vdocuments.site/reader034/viewer/2022050914/58ee69c71a28abc23c8b46a7/html5/thumbnails/10.jpg)
Spatial Measures• sMRI & fMRI• Foreground to Background Energy
Ratio• Contrast to Noise Ratio (sMRI only)• Entropy Focus Criterion• Smoothness (FWHM)• % Artifact Voxels• Signal-to-Noise Ratio• Ghost-to-Signal Ratio (fMRI only)
Mortamet et al 2009
![Page 11: PCP Quality Assessment Protocol](https://reader034.vdocuments.site/reader034/viewer/2022050914/58ee69c71a28abc23c8b46a7/html5/thumbnails/11.jpg)
Spatial Measures• sMRI & fMRI• Foreground to Background Energy
Ratio• Contrast to Noise Ratio (sMRI only)• Entropy Focus Criterion• Smoothness (FWHM)• % Artifact Voxels• Signal-to-Noise Ratio• Ghost-to-Signal Ratio (fMRI only)
![Page 12: PCP Quality Assessment Protocol](https://reader034.vdocuments.site/reader034/viewer/2022050914/58ee69c71a28abc23c8b46a7/html5/thumbnails/12.jpg)
Temporal Measures • Global Correlation (GCOR)• Standardized DVARS• Median distance index• Mean Functional
Displacement• # Voxels with FD > 0.2m• % Voxels with FD > 0.2m
![Page 13: PCP Quality Assessment Protocol](https://reader034.vdocuments.site/reader034/viewer/2022050914/58ee69c71a28abc23c8b46a7/html5/thumbnails/13.jpg)
Reports
![Page 14: PCP Quality Assessment Protocol](https://reader034.vdocuments.site/reader034/viewer/2022050914/58ee69c71a28abc23c8b46a7/html5/thumbnails/14.jpg)
Repository of data measures
• Normative datasets to help learn thresholds for quality control– ABIDE– CoRR
http://preprocessed-connectomes-project.github.io/quality-assessment-protocol/
![Page 15: PCP Quality Assessment Protocol](https://reader034.vdocuments.site/reader034/viewer/2022050914/58ee69c71a28abc23c8b46a7/html5/thumbnails/15.jpg)
B
Correlation Between Measures
A
Correlation between measures for structural (A) and functional (B) data. ABIDE on lower triangle, CoRR on upper triangle. X values are insignificant at FDR corrected q < 0.05.
![Page 16: PCP Quality Assessment Protocol](https://reader034.vdocuments.site/reader034/viewer/2022050914/58ee69c71a28abc23c8b46a7/html5/thumbnails/16.jpg)
Most discriminative measures
Green is good data, red is poor data as determined by manual assessments from four expert raters (consensus).
![Page 17: PCP Quality Assessment Protocol](https://reader034.vdocuments.site/reader034/viewer/2022050914/58ee69c71a28abc23c8b46a7/html5/thumbnails/17.jpg)
Test-Retest Reliability
![Page 18: PCP Quality Assessment Protocol](https://reader034.vdocuments.site/reader034/viewer/2022050914/58ee69c71a28abc23c8b46a7/html5/thumbnails/18.jpg)
Acknowledgements• Steve Giavasis, MS @ Child Mind Institute – developer• Sang Han Lee, PhD @ Nathan Kline Institute – analysis• John Pellman, BA @ Child Mind Institute –
documentation and support• Zarrar Shehzad, MA @ Yale – initial implementation• Chris Gorgelewski, PD @ Stanford – contributor
![Page 19: PCP Quality Assessment Protocol](https://reader034.vdocuments.site/reader034/viewer/2022050914/58ee69c71a28abc23c8b46a7/html5/thumbnails/19.jpg)
06.26 - 06.30 OHBM Hackathon,
Lausanne09.18 - 09.20
Brainhack Vienna10.10 - 10.12
Brainhack LA
![Page 20: PCP Quality Assessment Protocol](https://reader034.vdocuments.site/reader034/viewer/2022050914/58ee69c71a28abc23c8b46a7/html5/thumbnails/20.jpg)