autism & beyond: lessons from the development of a ... · autism & beyond an apple...

36
Autism & Beyond: Lessons from the Development of a ResearchKit App for Autism Screening Helen Egger MD, Duke Health Ricky Bloomfield MD, Duke Health Guillermo Sapiro PhD, Pratt School of Engineering and The Autism & Beyond Team 12 th AMC Conference on Managing Security & Privacy in an Environment of Increased Risk and Threats June 27 th , 2016 The Friday Center Chapel Hill, North Carolina

Upload: others

Post on 13-Oct-2020

3 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Autism & Beyond: Lessons from the Development of a ... · Autism & Beyond an Apple ResearchKit app for parents . OCTOBER 15 2015 MAY 5 2016 . Aim 1. Will parents upload videos? Will

Autism & Beyond: Lessons from the Development of a ResearchKit App for Autism Screening

Helen Egger MD, Duke Health

Ricky Bloomfield MD, Duke Health Guillermo Sapiro PhD, Pratt School of Engineering

and The Autism & Beyond Team

12th AMC Conference on Managing Security & Privacy in an Environment of Increased Risk and

Threats June 27th, 2016

The Friday Center Chapel Hill, North Carolina

Page 2: Autism & Beyond: Lessons from the Development of a ... · Autism & Beyond an Apple ResearchKit app for parents . OCTOBER 15 2015 MAY 5 2016 . Aim 1. Will parents upload videos? Will

Bringing early childhood mental health, information science, computer engineering, big data, and global health together

Page 3: Autism & Beyond: Lessons from the Development of a ... · Autism & Beyond an Apple ResearchKit app for parents . OCTOBER 15 2015 MAY 5 2016 . Aim 1. Will parents upload videos? Will
Page 4: Autism & Beyond: Lessons from the Development of a ... · Autism & Beyond an Apple ResearchKit app for parents . OCTOBER 15 2015 MAY 5 2016 . Aim 1. Will parents upload videos? Will
Page 5: Autism & Beyond: Lessons from the Development of a ... · Autism & Beyond an Apple ResearchKit app for parents . OCTOBER 15 2015 MAY 5 2016 . Aim 1. Will parents upload videos? Will

1 in 9

Page 6: Autism & Beyond: Lessons from the Development of a ... · Autism & Beyond an Apple ResearchKit app for parents . OCTOBER 15 2015 MAY 5 2016 . Aim 1. Will parents upload videos? Will

700 Synapse/Sec

Rate of brain growth in the first few years

of life

5.3 Years Mean age of autism diagnosis in the U.S.

18 Months Age at which

autism can be detected

Page 7: Autism & Beyond: Lessons from the Development of a ... · Autism & Beyond an Apple ResearchKit app for parents . OCTOBER 15 2015 MAY 5 2016 . Aim 1. Will parents upload videos? Will

Lack of child psychiatrists locally and globally

There are 50-60 child psychiatrists in sub-Saharan Africa.

There are nearly 400 million children.

Page 8: Autism & Beyond: Lessons from the Development of a ... · Autism & Beyond an Apple ResearchKit app for parents . OCTOBER 15 2015 MAY 5 2016 . Aim 1. Will parents upload videos? Will

Early Identification Improves outcomes

Page 9: Autism & Beyond: Lessons from the Development of a ... · Autism & Beyond an Apple ResearchKit app for parents . OCTOBER 15 2015 MAY 5 2016 . Aim 1. Will parents upload videos? Will

Current Approaches DON’T SCALE

Page 10: Autism & Beyond: Lessons from the Development of a ... · Autism & Beyond an Apple ResearchKit app for parents . OCTOBER 15 2015 MAY 5 2016 . Aim 1. Will parents upload videos? Will

Access to knowledge empowers parents, teachers and clinicians to get children the help they need.

Information science and mobile technology are key to transformative change.

Page 11: Autism & Beyond: Lessons from the Development of a ... · Autism & Beyond an Apple ResearchKit app for parents . OCTOBER 15 2015 MAY 5 2016 . Aim 1. Will parents upload videos? Will

PRIDE Study

iPad

Pediatric clinic

Provider

Paper consent

Autism & Beyond

iPhone

Children’s homes

Parent

Consent within app

Page 12: Autism & Beyond: Lessons from the Development of a ... · Autism & Beyond an Apple ResearchKit app for parents . OCTOBER 15 2015 MAY 5 2016 . Aim 1. Will parents upload videos? Will

Can we make digital tools that use computer vision to automatically code a child’s behaviors and emotions?

Page 13: Autism & Beyond: Lessons from the Development of a ... · Autism & Beyond an Apple ResearchKit app for parents . OCTOBER 15 2015 MAY 5 2016 . Aim 1. Will parents upload videos? Will

The PRIDE Study Developing an iPad tool to improve autism screening in pediatric clinics

Page 14: Autism & Beyond: Lessons from the Development of a ... · Autism & Beyond an Apple ResearchKit app for parents . OCTOBER 15 2015 MAY 5 2016 . Aim 1. Will parents upload videos? Will

Child watches video designed to elicit social-emotional

responses while camera

records the child’s behavior

Page 15: Autism & Beyond: Lessons from the Development of a ... · Autism & Beyond an Apple ResearchKit app for parents . OCTOBER 15 2015 MAY 5 2016 . Aim 1. Will parents upload videos? Will

Responding to a story: typical child

Page 16: Autism & Beyond: Lessons from the Development of a ... · Autism & Beyond an Apple ResearchKit app for parents . OCTOBER 15 2015 MAY 5 2016 . Aim 1. Will parents upload videos? Will

Responding to a story: child with autism

Page 17: Autism & Beyond: Lessons from the Development of a ... · Autism & Beyond an Apple ResearchKit app for parents . OCTOBER 15 2015 MAY 5 2016 . Aim 1. Will parents upload videos? Will

Software detects toddler’s emotional

expressions in real time

Page 18: Autism & Beyond: Lessons from the Development of a ... · Autism & Beyond an Apple ResearchKit app for parents . OCTOBER 15 2015 MAY 5 2016 . Aim 1. Will parents upload videos? Will

Computer and human raters agree

Page 19: Autism & Beyond: Lessons from the Development of a ... · Autism & Beyond an Apple ResearchKit app for parents . OCTOBER 15 2015 MAY 5 2016 . Aim 1. Will parents upload videos? Will

Toddler orients to name

Page 20: Autism & Beyond: Lessons from the Development of a ... · Autism & Beyond an Apple ResearchKit app for parents . OCTOBER 15 2015 MAY 5 2016 . Aim 1. Will parents upload videos? Will
Page 21: Autism & Beyond: Lessons from the Development of a ... · Autism & Beyond an Apple ResearchKit app for parents . OCTOBER 15 2015 MAY 5 2016 . Aim 1. Will parents upload videos? Will

Children with autism less likely to respond when name called or respond more slowly

Median in Control is .98 sec

Median in Autism is 1.58 sec

Page 22: Autism & Beyond: Lessons from the Development of a ... · Autism & Beyond an Apple ResearchKit app for parents . OCTOBER 15 2015 MAY 5 2016 . Aim 1. Will parents upload videos? Will

Autism & Beyond an Apple ResearchKit app for parents

Page 23: Autism & Beyond: Lessons from the Development of a ... · Autism & Beyond an Apple ResearchKit app for parents . OCTOBER 15 2015 MAY 5 2016 . Aim 1. Will parents upload videos? Will
Page 24: Autism & Beyond: Lessons from the Development of a ... · Autism & Beyond an Apple ResearchKit app for parents . OCTOBER 15 2015 MAY 5 2016 . Aim 1. Will parents upload videos? Will
Page 25: Autism & Beyond: Lessons from the Development of a ... · Autism & Beyond an Apple ResearchKit app for parents . OCTOBER 15 2015 MAY 5 2016 . Aim 1. Will parents upload videos? Will
Page 26: Autism & Beyond: Lessons from the Development of a ... · Autism & Beyond an Apple ResearchKit app for parents . OCTOBER 15 2015 MAY 5 2016 . Aim 1. Will parents upload videos? Will
Page 27: Autism & Beyond: Lessons from the Development of a ... · Autism & Beyond an Apple ResearchKit app for parents . OCTOBER 15 2015 MAY 5 2016 . Aim 1. Will parents upload videos? Will
Page 28: Autism & Beyond: Lessons from the Development of a ... · Autism & Beyond an Apple ResearchKit app for parents . OCTOBER 15 2015 MAY 5 2016 . Aim 1. Will parents upload videos? Will
Page 29: Autism & Beyond: Lessons from the Development of a ... · Autism & Beyond an Apple ResearchKit app for parents . OCTOBER 15 2015 MAY 5 2016 . Aim 1. Will parents upload videos? Will
Page 30: Autism & Beyond: Lessons from the Development of a ... · Autism & Beyond an Apple ResearchKit app for parents . OCTOBER 15 2015 MAY 5 2016 . Aim 1. Will parents upload videos? Will

OCTOBER 15 2015 MAY 5 2016

Page 31: Autism & Beyond: Lessons from the Development of a ... · Autism & Beyond an Apple ResearchKit app for parents . OCTOBER 15 2015 MAY 5 2016 . Aim 1. Will parents upload videos? Will

Aim 1. Will parents upload videos? Will the video

quality be good enough for analysis?

The child’s face is detected in

90% of the frames

80% of parents upload full

videos

Page 32: Autism & Beyond: Lessons from the Development of a ... · Autism & Beyond an Apple ResearchKit app for parents . OCTOBER 15 2015 MAY 5 2016 . Aim 1. Will parents upload videos? Will
Page 33: Autism & Beyond: Lessons from the Development of a ... · Autism & Beyond an Apple ResearchKit app for parents . OCTOBER 15 2015 MAY 5 2016 . Aim 1. Will parents upload videos? Will

Featured in the March 2016 Apple Keynote

Page 34: Autism & Beyond: Lessons from the Development of a ... · Autism & Beyond an Apple ResearchKit app for parents . OCTOBER 15 2015 MAY 5 2016 . Aim 1. Will parents upload videos? Will

•SOUTH AFRICA

•ARGENTINA •TURKEY • INDIA

Page 35: Autism & Beyond: Lessons from the Development of a ... · Autism & Beyond an Apple ResearchKit app for parents . OCTOBER 15 2015 MAY 5 2016 . Aim 1. Will parents upload videos? Will

www.autismandbeyond.researchkit.duke.edu

Page 36: Autism & Beyond: Lessons from the Development of a ... · Autism & Beyond an Apple ResearchKit app for parents . OCTOBER 15 2015 MAY 5 2016 . Aim 1. Will parents upload videos? Will