dio oversight: forensics during the 20 years that osi/ori have existed, investigators have developed...
DESCRIPTION
Here is a DIO scan of a spreadsheet submitted by a respondent that was unaccompanied by an instrument printout. Under pressure, he subsequently provided similar data that was accompanied by printouts from a scintillation counter.TRANSCRIPT
![Page 1: DIO Oversight: Forensics During the 20 years that OSI/ORI have existed, investigators have developed a number of computer-assisted tools and approaches](https://reader035.vdocuments.site/reader035/viewer/2022062503/5a4d1af37f8b9ab05997f5ab/html5/thumbnails/1.jpg)
DIO Oversight: Forensics During the 20 years that OSI/ORI have
existed, investigators have developed a number of computer-assisted tools and approaches to help strengthen institutional findings.
The following slides will provide a few examples of this.
![Page 2: DIO Oversight: Forensics During the 20 years that OSI/ORI have existed, investigators have developed a number of computer-assisted tools and approaches](https://reader035.vdocuments.site/reader035/viewer/2022062503/5a4d1af37f8b9ab05997f5ab/html5/thumbnails/2.jpg)
Detection of Fabricated Detection of Fabricated NumbersNumbers
If sets of transcribed If sets of transcribed numbers are provided as “raw are provided as “raw data” rather than instrument printouts, consider data” rather than instrument printouts, consider whether the numbers might have been fabricatedwhether the numbers might have been fabricated..
Research by ORI and others shows that insignificant (right-most) digits in numbers, if real, e.g. from instruments, are uniformly distributed while numbers made up by people often are non-uniform.
![Page 3: DIO Oversight: Forensics During the 20 years that OSI/ORI have existed, investigators have developed a number of computer-assisted tools and approaches](https://reader035.vdocuments.site/reader035/viewer/2022062503/5a4d1af37f8b9ab05997f5ab/html5/thumbnails/3.jpg)
Here is a DIO scan of a spreadsheet submitted by a
respondent that was unaccompanied by
an instrument printout.
Under pressure, he subsequently
provided similar data that was
accompanied by printouts from a
scintillation counter.
![Page 4: DIO Oversight: Forensics During the 20 years that OSI/ORI have existed, investigators have developed a number of computer-assisted tools and approaches](https://reader035.vdocuments.site/reader035/viewer/2022062503/5a4d1af37f8b9ab05997f5ab/html5/thumbnails/4.jpg)
The tool used by DIOThe tool used by DIO
![Page 5: DIO Oversight: Forensics During the 20 years that OSI/ORI have existed, investigators have developed a number of computer-assisted tools and approaches](https://reader035.vdocuments.site/reader035/viewer/2022062503/5a4d1af37f8b9ab05997f5ab/html5/thumbnails/5.jpg)
The DigiProbe ScreenThe DigiProbe ScreenStart with the numbers copied into a text file
![Page 6: DIO Oversight: Forensics During the 20 years that OSI/ORI have existed, investigators have developed a number of computer-assisted tools and approaches](https://reader035.vdocuments.site/reader035/viewer/2022062503/5a4d1af37f8b9ab05997f5ab/html5/thumbnails/6.jpg)
ORI 4/05 6
Data Sets 4-11
Digit
0 1 2 3 4 5 6 7 8 9
Freq
uenc
y
0
10
20
30
40
50
60
Right-most digit; p = 0.778Second right-most (10s), p = 0.787
Data Sets 1-3 (no counter tapes)
Digit
0 1 2 3 4 5 6 7 8 9
Freq
uenc
y
0
10
20
30
40
50
60
70 Right-most digit; p = < 0.00001Second right-most (10s), p = <0.00001
Bar graphs effectively illustrate the distribution of digits for the two right most positions for the data sets without counter tapes (left) and those with counter tapes (right).
![Page 7: DIO Oversight: Forensics During the 20 years that OSI/ORI have existed, investigators have developed a number of computer-assisted tools and approaches](https://reader035.vdocuments.site/reader035/viewer/2022062503/5a4d1af37f8b9ab05997f5ab/html5/thumbnails/7.jpg)
DIO analysis of the distribution of the two right most digits in data sets 1-11(group V)
Data set Total Digits p value1 100, 100 <0.00001, <0.000012 156, 156 <.00001, 0.000023 156, 156 0.02519, 0.004514 56, 56 0.57784, 0.470875 42, 42 0.22426, 0.224266 78, 78 0.46860, 0.570697 93, 93 0.27719, 0.978328 74, 74 0.07906, 0.517899 77, 77 0.33904,0.4044110 42, 39 0.19768, 0.2421911 50, 50 0.81654, 0.779191-3 412, 412 <0.00001, <0.000014-11 512, 509 0.77754, 0.78696
Probabilities obtained with DigiProbe for the 11 assays and for the assays with and without counter tapes grouped together.
![Page 8: DIO Oversight: Forensics During the 20 years that OSI/ORI have existed, investigators have developed a number of computer-assisted tools and approaches](https://reader035.vdocuments.site/reader035/viewer/2022062503/5a4d1af37f8b9ab05997f5ab/html5/thumbnails/8.jpg)
ObservationsObservationsThe most compelling evidence for misconduct in The most compelling evidence for misconduct in this case was obtained from the fabricated data this case was obtained from the fabricated data sets not examined by the university.sets not examined by the university.
This conclusion is made significantly stronger by the presence of “control data” from companion assays for which counter tapes were available.
In no instance was the distribution of non-leading digits non-uniform when tapes were available, and in each of the three assays without tapes, digits were non-uniform at both positions.
![Page 9: DIO Oversight: Forensics During the 20 years that OSI/ORI have existed, investigators have developed a number of computer-assisted tools and approaches](https://reader035.vdocuments.site/reader035/viewer/2022062503/5a4d1af37f8b9ab05997f5ab/html5/thumbnails/9.jpg)
0.010.020.030.040.050.060.070.080.0
1 2 3 4 5 6 7 8 9 102 Year Reporting Period ('89-90 to '07-08)
ORI Cases With Questioned Images
![Page 10: DIO Oversight: Forensics During the 20 years that OSI/ORI have existed, investigators have developed a number of computer-assisted tools and approaches](https://reader035.vdocuments.site/reader035/viewer/2022062503/5a4d1af37f8b9ab05997f5ab/html5/thumbnails/10.jpg)
Examples of analyzing images
Several examples follow which illustrate how ORI can examine images provided by institutions during their investigation.
Many of ORI’s cases involve images that are duplicated from paper to paper or paper to grant application. This may be duplicate publication, but when such images are said to be the result of different experiments, one of the images, at minimum, has been potentially falsified.
The first example, however, is a little different.
![Page 11: DIO Oversight: Forensics During the 20 years that OSI/ORI have existed, investigators have developed a number of computer-assisted tools and approaches](https://reader035.vdocuments.site/reader035/viewer/2022062503/5a4d1af37f8b9ab05997f5ab/html5/thumbnails/11.jpg)
ORI 4/05 11
![Page 12: DIO Oversight: Forensics During the 20 years that OSI/ORI have existed, investigators have developed a number of computer-assisted tools and approaches](https://reader035.vdocuments.site/reader035/viewer/2022062503/5a4d1af37f8b9ab05997f5ab/html5/thumbnails/12.jpg)
ORI 4/05 12
Screen shot from Photoshop showing analysis under way – the small circle in the Color Picker is the brush size moved to a color approximately matching the image’s background.
![Page 13: DIO Oversight: Forensics During the 20 years that OSI/ORI have existed, investigators have developed a number of computer-assisted tools and approaches](https://reader035.vdocuments.site/reader035/viewer/2022062503/5a4d1af37f8b9ab05997f5ab/html5/thumbnails/13.jpg)
ORI 4/05 13
The result of removing most of the “scribbling.”
![Page 14: DIO Oversight: Forensics During the 20 years that OSI/ORI have existed, investigators have developed a number of computer-assisted tools and approaches](https://reader035.vdocuments.site/reader035/viewer/2022062503/5a4d1af37f8b9ab05997f5ab/html5/thumbnails/14.jpg)
Corner of Film
In this case, 1 film was used to represent 2 experiments
the same film used for mouse and mouse Myo D and Myo G
This is why the RIO sent the previous sample to ORI for Review
![Page 15: DIO Oversight: Forensics During the 20 years that OSI/ORI have existed, investigators have developed a number of computer-assisted tools and approaches](https://reader035.vdocuments.site/reader035/viewer/2022062503/5a4d1af37f8b9ab05997f5ab/html5/thumbnails/15.jpg)
Scanned film separated by hue
Result: writing in red erased from film then re-labeled