behavioral assessment methods for rdoc constructs€¦ · a report by the national advisory mental...

Post on 20-Jul-2020

6 Views

Category:

Documents

0 Downloads

Preview:

Click to see full reader

TRANSCRIPT

Behavioral Assessment Methods for RDoC ConstructsAugust 2016

NATIONAL INSTITUTE OF MENTAL HEALTH

A Report by the National Advisory Mental Health Council Workgroup on Tasks and Measures for Research Domain Criteria (RDoC)

Department of Health and Human ServicesPublic Health ServiceNational Institutes of HealthNational Institute of Mental Health

BehavioralAssessmentMethodsforRDoCConstructs

1

TABLEOFCONTENTS

SectionI:ExecutiveSummary...............................................................................................................2

INTRODUCTION............................................................................................................................................2

THEWORKGROUPONTASKSANDMEASURESFORRDOC....................................................................................3

NIMH’sRequestforInformation..........................................................................................................3

WorkgroupCharge..............................................................................................................................4

SUMMARYOFRECOMMENDATIONSANDCONCLUSIONS......................................................................................6

GeneralIssues......................................................................................................................................6

Domain-specificTaskRecommendations............................................................................................7

NEXTSTEPS...............................................................................................................................................20

SectionII:DomainSpecificReports....................................................................................................22

NEGATIVEVALENCESYSTEMSFINALREPORT...................................................................................................23

POSITIVEVALENCESYSTEMSFINALREPORT....................................................................................................34

COGNITIVESYSTEMSFINALREPORT...............................................................................................................85

SYSTEMSFORSOCIALPROCESSESFINALREPORT..............................................................................................95AROUSALANDREGULATORYSYSTEMSFINALREPORT.....................................................................................105

AppendixA:RDoCMatrixDomain,ConstructsandSubconstructDefinitions....................................153

AppendixB:NAMHCRoster.............................................................................................................159

AppendixC:WorkgroupRoster........................................................................................................161

AppendixD:WorkgroupAgenda......................................................................................................163

BehavioralAssessmentMethodsforRDoCConstructs

2

SECTIONI:EXECUTIVESUMMARY

Introduction

TheNationalInstituteofMentalHealth(NIMH)launchedtheResearchDomainCriteria(RDoC)in2009inresponsetothe2008NIMHStrategicPlan’scallfornewwaysofclassifyingmentalillnessesthatarebasedondimensionsofobservablebehavioralandneurobiologicalmeasures.RDoCisaresearchframeworkdesignedtointegratemanylevelsofinformation(fromgenomicstoself-report)tobetterunderstandthebasicdimensionsoffunctioningunderlyingthefullrangeofhumanbehavior,fromnormaltoabnormal.NIMHenvisionsthattheRDoCinitiativewilldeterminehowaclassificationapproachbasedonbiology,behavior,andcontextcanbeusefulformentaldisorders,thusinformingdiagnosticsystemsofthefuture.

Sinceitsinception,RDoChasprogressedasasignificanteffortfortheInstitute,impactingbasic,translational,andservices/interventionresearchpriorities.Initially,aseriesofcollaborativeworkshopswasheldinordertosummarizethestateoftheknowledgerelatedtofivemain“domains”anddefineassociatedconstructsforeach(seeAppendixA).ThecurrentRDoCframeworkconsistsofamatrixinwhichtherowsrepresentspecifiedfunctionalConstructs,conceptssummarizingdataaboutaspecifiedfunctionaldimensionofbehavior,characterizedinaggregatebythegenes,molecules,circuits,etc.,whichimplementit.Constructsareinturngroupedintohigher-levelDomainsoffunctioning,reflectingcontemporaryknowledgeaboutmajorsystemsofcognition,motivation,andsocialbehavior.Initspresentform,therearefiveDomainsintheRDoCmatrix:NegativeValenceSystems,PositiveValenceSystems,CognitiveSystems,SystemsforSocialProcesses,andArousal/RegulatorySystems.ThematrixcolumnsspecifyUnitsofAnalysisusedtostudytheConstructs,andincludegenes,molecules,cells,circuits,physiology,behavior,andself-reports.Thematrixalsohasaseparatecolumntospecifywell-validatedparadigmsusedinstudyingeachConstruct.Theseparadigmsmayberelevantformorethanoneunitofanalysisandratherthanlisttheminseparatecolumns,theyareincludedundertheParadigmsheading.Inthebodyofthematrixarespecificelementswhichareempiricallyassociatedwiththeconstructandaregroupedundertheappropriateunitofanalysis.

TheRDoCmatrixprovidesoneframeworkfororganizingNIMHresearchefforts,freeingscientistsfromtraditionalcategoriesthatareoftenheterogeneousandoverlapping.RDoCaimstosupportresearchthatconsidersmentalillnessesintermsoffundamentalbehavioral-neuralsystems(e.g.,fearorworkingmemory)ratherthantraditionaldiagnosticcategories.Thelong-termgoalistodevelopascientificbasethatcaninformfutureneuroscience-baseddiagnosticsystemsformentalillnesses.TogenerateasystematicRDoCdatabaseforthispurpose,itisimportanttodevelopasetofparadigmsandmeasuresthataregenerallyacceptedbythefieldandwhichcanfacilitatecomparisonsacrossstudiesandsharingofdata.However,ifNIMHprematurelyestablishesforabatteryofaffective,behavioral,andcognitivetasksforuseinRDoCresearch,itrunstheriskofhamperingfuturemethodologicalinnovationandrevisionstotheRDoCconstructs,whichwouldhavedeleteriouseffectsonthelong-termdevelopmentofRDoC.Areasonablecompromiseistoestablishasetofstandardizedparadigmsandmeasures

BehavioralAssessmentMethodsforRDoCConstructs

3

whichareappropriateforassessingRDoCconstructs,butwhicharenotrequiredtobeusedinRDoCresearch.SuchalistwouldofferthefieldsomestandardizationthatcanfosterdatasharingthroughtheRDoCDatabase(RDoCdb),butwouldrequireregularrevisioninordertoincorporatenewdevelopmentsandfindings.

Toinitiatethedevelopmentofstandardizedparadigmsandmeasures,NIMH’sRDoCUnitproposedtheconceptclearance,FirstGenerationResearchDomainCriteria(RDoC)MeasurementElements,totheNationalAdvisoryMentalHealthCouncil(NAMHC;seeAppendixB).TheCouncilapprovedthisconceptatitsMay29,2015meeting.Theaimofthisinitiativewastosupporttheidentificationoftwotofourparadigmsand/ormeasuresthatwouldbeoptimalforeachRDoCconstruct.Thesemeasureswouldprovideresearchersachoiceamongagroupofvettedelements,whilestillmaintainingadegreeofstandardization.Identifyingconstructsforwhichnoappropriatemeasuresexisthelpstoidentifyareasinneedoffurtherassessmentdevelopment.

TheWorkgrouponTasksandMeasuresforRDoC

DuringtheFebruary4,2016NAMHCmeeting,NIMHActingDirectorBruceCuthbert,Ph.D.,announcedtheformationoftheWorkgrouptoimplementtheFirstGenerationRDoCMeasurementElementsconcept.Agroupof34researchersfrom34uniqueinstitutionswasestablished(seeAppendixCforaroster),witheachparticipantagreeingtoparticipateinonedomain-specificsubgroup.Aleaderwasassignedforeachdomainsubgroup,andtookontheresponsibilityofleadingthediscussionsandhelpingtoassembleandcoordinatethedomainsubgroup’sfinalrecommendations.TheNationalAdvisoryMentalHealthCouncilWorkgrouponTasksandMeasuresforResearchDomainCriteriaconvenedanin-personmeetingonApril5and6,2016(seeAppendixDforthemeetingagenda)attheNeuroscienceCenterinRockville,Maryland.DeannaBarch,Ph.D.,ProfessoratWashingtonUniversityandMariaOquendo,M.D.,ProfessoratColumbiaUniversity,co-chairedtheWorkgroup.

NIMH’sRequestforInformationInpreparationfortheworkgroupmeeting,NIMHpublishedarequestforinformation(RFI)titled“BuildingaSetofRecommendedTasksandMeasuresfortheRDoCMatrix”onMarch25,2016,toseekinputfromthefield.ResponsestotheRFIweredueApril22,2016.ThroughtheRFI,NIMHgatheredinformationaboutexistingtasksandmeasurementtoolsthatwererecommendedforinclusionintheRDoCmatrix,aswellasgeneralsuggestionsaboutthemostimportantcriteriaforconsiderationinselectingcandidatetests.

AsofMay10,2016,NIMHreceived60responses.Ofthese,asubsetof42wereclassifiedasrelevantandontopic.Sevenofthesesuggestedgeneralcriteriatoconsiderwhenselectingatask.Theremainingresponsesincludedrecommendationsforspecifictasks,acrossallfivedomains.

BehavioralAssessmentMethodsforRDoCConstructs

4

WorkgroupChargeThechargetotheWorkgroupwastorecommendasetoftwotofourtasksforeachconstructthatmeetallormanyofthefollowingcriteria.ThesecriteriaweredevelopedbasedondiscussionsamongtheRDoCworkgroupmemberspriortothestartofthemeeting,andmodifiedthroughinformationgainedfromtheRFIandfromdiscussionsatthestartofthein-personCouncilworkgroupmeeting.

• HowstrongistheevidencethatthetaskprovidesavalidmeasureoftheRDoCconstruct?• Howgoodistheevidenceaboutthepsychometriccharacteristicsofthetask(e.g.,internal

reliability,test-retestreliability,floorandceilingeffects,practiceeffects,availabilityofalternateforms,andlongitudinalstability)?

• Isthetaskfreefromfloor/ceilingeffectssothatitcanbeusedacrossindividualswiththefullrangeofperformance/impairmentonthetasks?

• Areparametersforadministeringthetask(e.g.,numberoftrials,stimuluscharacteristics,andprimarydependentmeasure)standardizedonanempiricalbasis?

• Towhatextentisthetask(ordifferentversionsofthetask)suitableforuseacrosslaboratory-basedstudies,clinicaltrials(asameasureoftargetengagementorclinicaloutcome),and/orhigh-throughputscreeningsettings?Isthetasksuitableforuseinhumansubjectsinavarietyoflaboratoryenvironments?Isthetaskfeasibleforadministrationacrosssites?Whatworkisneededtomakethetaskreadyforuseinclinicaltrials?

• Canthetaskbeused(oradaptedforuse)withchildrenandotherspecialpopulations?Canitbeusedacrossdifferentculturalsettings?

• Canthetaskbeusedasastand-alonebehavioraltask?• Areadequatenormativedataavailableacrossage,gender,education,ethnicity,and

socioeconomicstatus?• Isthetaskwidelyusedcurrentlyorhasitsusebeenlimitedtoafewresearchgroups?• Isthetasksensitivetowithin-personchange?• Aretherelationshipsbetweentaskperformanceandclinicalfeature(s)known?• Isthetaskfreelydistributed(i.e.,notcopyrighted)?• DoesthetaskassessmultipleRDoCconstructsorisitspecifictojustone?Ifitassesses

multipleconstructs,doesitallowforunambiguousconclusionsaboutthetargetedconstruct?

Duringthedomain-specificbreakoutsessions,theworkgroupmemberswereaskedtorateeachproposedtaskormeasurementtooloneachcriterionusingascaleof1to5(1=noevidence,3=someevidence,5=strongevidence),inordertofacilitatedirectcomparisonsamongtaskcharacteristics.Otherproposedtaskcharacteristicsconsideredimportantwhenevaluatingatask,butnotrequiredforbehavioralmeasuresofRDoCconstructs,are:

• Canthetaskbeusedwithmethodstointerrogatebraincircuitry(e.g.,functionalmagneticresonanceimaging[fMRI]andEEG)?

• Canthetask(oritsanalog)beusedinanimals?Isananimalversionavailable?• Aretherelationshipsbetweentaskperformanceandneuralsignal(s)known?

BehavioralAssessmentMethodsforRDoCConstructs

5

IndiscussingtheWorkgroup’schargeandcriteriafortasknomination,themembersoftheworkgroupdevelopedthefollowingsuggestions:

• Donotspendtimeattheworkgroupmeetingrevisitingtheorganizationofthematrixorthedefinitionsoftheconstructs.Suggestionsforchangesarewelcomebutthefocusofthediscussionsshouldbeonmeasuresfortheconstructsastheyarecurrentlydefined.

• Whereverpossible,themeasuresshouldallowforbehavioralassessment,asopposedtofocusedsolelyonbiologicalsignals(e.g.,neuroimaging).However,itwasrecognizedthatsomeconstructs(e.g.,sleepcycles)cannotbemeasuredbehaviorally.NIMHwillobtainrecommendationsfortasksandmeasuresrelatedtolevelsofanalysis—includingelectrophysiologyandneuroimagingmeasures—infuturemeetings.

• Whenchoosingamongmeasures,ataskthatrelatestoclinicalfeatures(particularlyfunctionalstatus)ispreferred.

• Regardingtheuseoradaptationoftasksforchildrenandotherspecialpopulations,workgroupmembersshouldconsiderwhetherthetestissensitivetonormativedevelopmentalchange.Withataskthatbothchildrenandadultscanperform,itwouldbehelpfultobeabletodeterminewhetherthegroupsareusingthesameordifferentstrategies.

• Workgroupmembersshouldconsiderthatsomemeasuresareinfluencedbyculture.• Workgroupmembersshouldconsidertheacceptabilityoftaskstosubjects.Somemightbe

toodifficultandperceiveddifficultymayvaryacrosspopulationgroups.• Thenewwebdesignofthematrixallowsfortheadditionofinformation(e.g.,referencesto

publications)aboutelements.Therefore,workgroupmembersshouldidentifyinformationabouttasksthatcanbeaddedtothematrix.

• Whennominatingatask,theworkgroupshouldnotewherepossible:

– theparticularpsychometricpropertiesofthetaskorparadigm(whereinformationisavailable)andthesubpopulationsthathavebeentested;

– whetherthetaskmeasuresastateortrait;– theappropriateuseofthetask(e.g.,whetheritissuitableforlongitudinalresearch

versussingleadministration);– whethertheparametersforadministeringatask(e.g.,numberoftrials,stimulus

characteristics,andprimarydependentmeasures)havebeenstandardizedbasedonempiricalevidence;

– variationintheparametersneededtoobtainthedesiredlevelofsensitivityacrosspopulations;and

– thesettingsinwhichthetaskcanbeused(e.g.,laboratoryorclinical).

ThetaskscurrentlylistedintheRDoCmatrixprovidedastartingpointfortheworkgroup’sdeliberations.Membersoftheworkgroupwerealsoencouragedtoidentifyothertaskswhichmaybewell-suitedforspecificconstructsandtoidentifyconstructsforwhichnewtasksareneeded.Theworkgroupwasinformedthatasuccessfulreportwouldprovide(1)alistofcurrently-availabletasksandmeasuresthatarerecommendedforinclusionintheRDoCbattery,(2)alistoftasksthatcouldbeappropriateforinclusionbutareinneedoffurther

BehavioralAssessmentMethodsforRDoCConstructs

6

optimizationandasummaryoftheworkneededinordertooptimizethem,and(3)alistofconstructsforwhichnoappropriatetasksareavailable.Workgroupmemberswerealsoaskedtoprovidealistofparadigmsthatwereconsideredforinclusionbutnotrecommended,includingtherationaleforexclusion.

Theintentoftheserecommendationsfromtheworkgroupisnottobeoverlyprescriptive;thegoalistofacilitateuseofcommondataelementswherefeasible.Thelistofrecommendedtaskswillbedynamic,asresearchersinthefieldwillbeabletomakethecaseforothertasksormeasuresthatalsomeetthecriteria.

SummaryofRecommendationsandConclusions

GeneralIssuesIntheirdiscussionsoftasksandmeasures,alldomainsubgroupsencounteredaparticularchallenge:theabsenceofpsychometricdata.Formanyoftherecommendedtaskstherearenonormativedata.Thefieldwouldbenefitfromadditionaldata,andfurtheranalysis,inordertounderstandthebasicpsychometricpropertiesofpopulartasksincurrentuse.Similarly,manyofthetasksdonothaveempiricallyderivedadministrationparameters,andlackstandardizationacrosssites.Furtheroptimizationandstandardizationtoensurethatalllabsusingacertaintaskaremeasuringthesamephenomenonwouldbeuseful.

Itisalsonotedthatanumberofthedomainsubgroupsfocusedonbehavioralmeasuresanddidnotconsiderself-reportmeasures,inlargepartbecauseoftimeconstraintsattheworkgroupmeeting.Thelackofself-reportrecommendationsshouldnotbeinterpretedtomeanthattheworkgroupconsideredthesetobeinvalidornotrecommended,butperhapsshouldbethefocusofafuturemeeting.

Anotherissuethatcameupinmanydomainsubgroupswasthequestionofhowtoaddressregulatoryprocesses,includingemotionregulation.Emotionregulationiscurrentlyconsideredtobeanimplicitcomponentofanypertinentconstruct;forexample,controloffearbehaviororcontrolofimpulsivebehavior.Thus,emotionregulationwasnotoriginallydefinedasadistinctconstructinanydomain.However,thedomainsubgroupssuggestedthatitmayneedamoreexplicitroleinthematrix.Assuch,thedomainsubgroupssuggestedthatmorefocuseddiscussionofmethodsforassessingthiscriticalconceptwereneeded.

Lastly,manydomainsubgroupsnotedthattheorganizationofdomains,definitionsoftheconstructs,oroverallscope/coverageofthefieldwouldbenefitfromupdating.Somedomainsubgroups(i.e.,PositiveValence)madespecificsuggestionsastohowtochangetheDomain,whereasotherdomainsubgroups(i.e.,NegativeValence)simplynotedthattheorganizationanddefinitionsweredifficult,butworkedwithintheguidelinestorecommendtasksfortheexistingmatrix.Itisrecommended,however,thatthedefinitionsandorganizationsoftheconstructsbeevaluatedinafuturemeeting.DuringtheMay26,2016NAMHCmeeting,NIMHActingDirectorBruceCuthbert,Ph.D.,announcedtheformationofanewWorkgrouponRevisionstotheRDoCMatrix.ThechargetothisgroupwillbetoadvisetheNIMHon

BehavioralAssessmentMethodsforRDoCConstructs

7

modificationstotheRDoCmatrix,includingadditionofnewdomainsandconstructs.ManyoftherecommendationsaboutdomainorganizationmadebytheworkgrouponTasksandMeasuresforRDoCwillbepassedalongtothisnewlyformedworkgroupfortheirdiscussion.

Domain-specificTaskRecommendationsEachofthedomainsubgroupsprovidedanextensivefinalreport.Hereweprovideexecutivesummaries.ThefullreportscanbefoundinSectionII:DomainSpecificReports.

NegativeValenceSystems(SeeSectionIIforfullreport)TheNegativeValenceSystemssubgroupnoteddifficultieswiththewaythedomainwasdefinedandorganized.Theysuggestthatseveraloftheconstructdefinitionsdonotlendthemselvestoalaboratorymeasurementmodelthatwouldelicittheindividualdifferencesofinterest.Forexample,manyoftheirrecommendationsforSustainedThreatandLossactuallyinduceanalogsfortheaffectivestate,ormeasuredownstreamconsequences,anddonottapthedefinedconstructdirectly.Additionally,theysuggestthatthedomainislackingincoverageacrossthetopicarea,andshouldmoreexplicitlydovetailwithPositiveValenceSystems,asthereisagreatdealofoverlapinthetasksandmeasuresthatcouldbeused.Theysupporttheadditionofconstructsof“emotionallability”,“pain”,and“affectivedecisionmaking”.

BehavioralAssessmentMethodsforRDoCConstructs

8

NegativeValenceSystemsRecommendedTaskParadigms

Construct/Sub-construct Task Keyreferences

1.AcuteThreat

TrierSocialStressTest Kirschbaumetal.1993Allenetal.2014

BehavioralApproachTest nonelisted

ColdPressorTest Edelsonetal.1986Velascoetal.1997Rolkeetal.2006

CO2Challenge nonelisted

StrangerTests Bussetal.2003Pfeiferetal.2002

FearConditioningTasks Norrholmetal.2008Zeidanetal.2012

2.PotentialThreat

NoShock,PredictableShock,UnpredictableShock(NPUThreatTask)

Schmitzetal.2012

3.SustainedThreat

None(seefullreportfordiscussionofwhynonewererecommended)

4.Loss(analogofresponsetoloss

Sadnesselicitingfilmclips(butonlywithw/immersioninstructionsandfacialexpressionormoodratingsasdependentvariablesofinterest)

Samsonetal.2015Joormannetal.2007

5.FrustrativeNonreward

PointsSubtractionAggressionParadigm(PSAP)

Cherek,1981Genioleetal.2016

LaboratoryTemperamentAssessmentBatterytasksofBoxEmptyandTransparentBox

Gagneetal.2011

BehavioralAssessmentMethodsforRDoCConstructs

9

NegativeValenceSystemsRecommendedSelfReportMeasures

Construct/Sub-construct Task Keyreferences

1.AcuteThreat

SubjectiveUnitofDiscomfortScore(SUDS) Wolpe,1990Kaplanetal.1995

FearSurveySchedule Wolpe&Lang,1977

2.PotentialThreat

IntoleranceofUncertaintyScale(12itemversion)

Carletonetal.2007

BehavioralInhibitionScale(BIS) Carver&White,1994

FearofNegativeEvaluationScale Watson&Friend,1969

AnxietySensitivityIndex Tayloretal.2007

LifeEventsandDifficultiesSchedule(LEDS) Brown&Harris,1978

3.SustainedThreat

YouthLifeStressInterview Rudolph&Flynn,2007

ChildhoodTraumaQuestionnaire Bernstein&Fink,1998

LEDSdifficulties Brown&Harris,1978

TraumaticEventsScreeningInventory(TESI) Ippenetal.2002

RiskyFamilies Tayloretal.2004

StressandAdversityInventory(STRAIN) Slavich&Epel,2010

4.Loss(analogofresponsetoloss)

LEDS(socialexperienceoflossandpotentialthreat)

Brown&Harris,1978

STRAIN Slavich&Epel,2010

5.FrustrativeNonreward

FrustrativeNonrewardResponsivenessSubscale

Wrightetal.2009

QuestionnaireofDailyFrustrations Baarsetal.2011

BehavioralAssessmentMethodsforRDoCConstructs

10

PositiveValenceSystems(SeeSectionIIforfullreport)Thelistofsuggestedtasksandmeasuresforthisdomainreflectsaslightregroupingandrenamingoftheconstructstomoreclearlymatchtheexistingempiricalliterature,whichthePositiveValenceSystemssubgroupsuggestsreducespotentialredundanciesacrosstheconstructs,andisolates“purer”constructs.Theypropose3totalConstructs;“RewardResponsiveness”,“RewardLearning”and“RewardValuation,”eachwith3newsub-constructs.Thedomainsubgroupdiscussedthefactthatmanytasksthatweredevelopedearlyandhavebeenwidelyusedoftenconflatemultiplesub-constructs.Thus,manyofthesetasksmightsubsumedifferentsub-constructsinthesametask.Newparadigmshavelessaccumulateddatabutaremorepreciseindifferentiatingsub-constructs.Aswiththeotherdomains,theworkgroupalsonotedthatmuchmoredataareneededonpsychometricsandnormsformostifnotallofthetasks.Additionally,thegroupsuggestedthattheregulationofthePositiveValenceSystemsconstructs(e.g.,modulationofPVSconstructsbyhomeostaticdriveslikehunger,sleep,thirst,sex)wouldinvolveprocessesthatarebettercapturedbyCognitiveSystemsandArousalandRegulatorySystems,andsotheydidnotincludetasksthatprobedtheseregulatoryprocessesintheirdeliberations.

BehavioralAssessmentMethodsforRDoCConstructs

11

PositiveValenceSystemsRecommendedTaskParadigms

Construct/Sub-construct Task Keyreferences

1.RewardResponsiveness

1.1.InitialResponsetoReward

SimpleGuessingTask Delgadoetal.2000Carlsonetal.2011

1.2.RewardAnticipation MonetaryIncentiveDelayTask Knutsonetal.2000

1.3.RewardSatiation Fixed-ratioSatiationSchedule Sherman&Thomas1968

2.RewardLearning

2.1.Habit DevaluationTask Gillanetal.2011

HabitTask McKimetal.2016

HabitLearningTask Tricomietal.2009

2.2.ProbabilisticandReinforcementLearning

ProbabilisticRewardTask Pizzagallietal.2005

PavlovianConditioning O’Dohertyetal.2004

Driftingdoublebandit Dawetal.2011

ProbabilisticStimulusSelectionTask Franketal.2004

2.3.RewardPredictionError RutledgePassiveLotteryTask Rutledgeetal.2010

Driftingdoublebandit Dawetal.2011

3.RewardValuation

3.1.Reward(probability) ProbabilityChoiceTask Levyetal.2010

WillingnessToPayTask Beckeretal.1963

3.2.Delay DelayedDiscountingTask Kable&Glimcher2007Johnson&Bickel2002Green&Myerson2004

3.3.Effort EffortExpenditureforRewardTask Treadwayetal.2009

BehavioralAssessmentMethodsforRDoCConstructs

12

CognitiveSystems(SeeSectionIIforfullreport)TheCognitiveSystemsDomainsubgroupgroupdiscussedthefactthatmanycognitiveconstructsoverlap(forexample,workingmemoryandcognitivecontrol),andthatthisisthenatureofcognitionandtosomeextentunavoidable.ThereisadditionaloverlapbetweentheCognitiveSystemsDomainandotherdomains(forexample,vigilanceisanaspectofattentionandalsoanindexofarousal.)Thedomainsubgroupalsonotedthatsomekeycognitiveconstructswerenotcurrentlyrepresentedinthematrix,suchasreasoningandinference.ThedomainsubgrouphassuggestedanupdateoftheAttentionconstruct,inlightofcurrentworkincognitiveneuroscienceandsuggeststhreesubconstructs,“Controlledvs.AutomaticAttention,”“CapacityandInterferenceControl,”and“Vigilance(SustainedAttention).”Anotherobservationwasthattheconstruct“LanguageBehavior”waslesswellelaboratedthanotherconstructs.Thisdomainsubgroupfelt,giventhespecializednatureofthefieldoflinguisticsandtheinteractionsbetweenlinguisticandcognitivesystems,thatidentifyingsubconstructsandparadigmsfromthisconstructwouldbebestaccomplishedbyanewsubgroupwithmoreexpertiseinthearea.

BehavioralAssessmentMethodsforRDoCConstructs

13

CognitiveSystemsRecommendedTaskParadigms

Construct/Sub-construct Task Keyreferences

1.Attention

1.1.Overt/Covert Spatialandnon-spatialcuingtasks Carteretal.1992

AttentionNetworksTask(ANTS) Macleodetal.2010

Visualsearchparadigm Goldetal.2007

1.2.CapacityandInterferenceControl

Attentionalblinkduringrapidserialvisualpresentation

Mathisetal.2011

Dualtaskparadigms Nuechterleinetal.2006

1.3.Vigilance Taskswith‘catch’trials(changedetectionworkingmemory,perceptualthresholdeffects)

Barchetal.2011

Mind-wanderingtasks Smallwood&Schooner,2015

2.Perception

2.1.Visual Contrast-ContrastTask Barchetal.2011

JitteredOrientationvisualintegrationtask(JOVI)

Silversteinetal.2011

3.DeclarativeMemory

RelationalandItemSpecificEncodingTask(RISE)

Raglandetal.2012

MnemonicSimilarityTest Bakkeretal.2008

4.CognitiveControl

4.1.GoalSelection,Updating,RepresentationandMaintenance

ContinuousPerformanceTests(AXandDPX)

Lopez-Garciaetal.2015

Preparingtoovercomeprepotencytask(POP)

Snitzetal.2005

4.2ResponseSelection,ResponseInhibition/Suppression

Go/No-gotasks Boucheretal.2007

StopSignalTasks Luijtenetal.2014

4.3PerformanceMonitoring FlankerTaskversions None

SimonTaskversions None

BehavioralAssessmentMethodsforRDoCConstructs

14

Construct/Sub-construct Task Keyreferences

StroopTaskversions Kernsetal.2004

5.WorkingMemory

5.1.ActiveMaintenance MatchtoSample Horwitz&Tagaments,1999

Sternbergtasks Nelsonetal.2003

ChangeDetection Barchetal.2011

ContinuousPerformanceTests(AXandDPX)

Lopez-Garciaetal.2015

5.2FlexibleUpdating NBacktasks Jonidesetal.2008

Self-orderedPointing Gillett,2007

5.3LimitedCapacity ChangeDetection Barchetal.2011

5.4InterferenceControl Nbacktasks Jonidesetal.2008

Sternbergtasks Nelsonetal.2003

BehavioralAssessmentMethodsforRDoCConstructs

15

SystemsforSocialProcesses(SeeSectionIIforfullreport)TheSystemsforSocialProcessessubgroupsuggestedsomechangestothedomain’sorganization,andsuggestedadding“RejectionSensitivity”and“SocialMotivation”assubconstructsundertheAffiliationandAttachmentconstruct.Thegroupnotedthatthe“SocialCommunication–ProductionofFacialCommunication”subconstructwouldbenefitfromfurtherdevelopmentregardingmethodsofelicitingemotionsandmeasuringfacialexpressions.Beyondfacialcommunication,thereisasignificantneedtodeveloptechniquesandinstrumentsthatcapturethedimensionalityoffunctioningacrossthelifespan,aswellasinstrumentsthatmaximizeecologicalvalidity.

ThedomainsubgroupstronglyrecommendedeliminatingtheStrangeFaces(separation-reunion)task,theStillFace,andtheFordCorollaryDischargeparadigmsfromthelistofparadigmscurrentlylistedintheRDoCmatrix.Thegroupidentifiedsignificantproblemswiththesetasks;howeverthisdoesnotmeantheyendorsealloftheremainingtasksinthecurrentmatrix.

BehavioralAssessmentMethodsforRDoCConstructs

16

SystemsforSocialProcessesRecommendedTaskParadigms

Construct/Sub-construct Task Keyreferences

1.AffiliationandAttachment

1.1RejectionSensitivity Cyberball

Hartgerinketal.2015Bolling,2011

1.2SocialMotivation One-armedBanditTask Linetal.2012

2.SocialCommunication

2.1.ReceptionofFacialCommunication

ER-40–PennEmotionRecognitionTest Erwinetal.1992

GazeCuing Gross&Levenson,2008

2.2.ProductionofFacialCommunication

None

2.3.Non-facialcommunication(mergedreceptionandproduction)

TASIT1 McDonaldetal.2003

3.PerceptionandUnderstandingofSelf

3.1.Agency None

3.2.SelfKnowledge Self-ReferentialMemoryParadigm Kelley,etal.2002

4.PerceptionandUnderstandingofOthers

4.1.AnimacyPerception PointLightDisplaysofBiologicalMotion

Bjornsdotteretal.2016

4.2.ActionPerception HowpartofHow/Whytask Spunt&Adolphs,2014

4.3.UnderstandingMentalStates HintingTask Corcoran&Frith,2003

ReadingtheMindintheEyes Vellanteetal.2013

BehavioralAssessmentMethodsforRDoCConstructs

17

SystemsforSocialProcessesRecommendedSelfReportMeasures

Construct/Sub-construct Task Keyreferences

1.AffiliationandAttachment

1.2SocialMotivation MultidimensionalScaleofPerceivedSocialSupport

Zimetetal.1988

2.SocialCommunication

2.3.Non-facialcommunication(mergedreceptionandproduction)

SocialResponsivenessScale Constantinoetal.2003

BehavioralAssessmentMethodsforRDoCConstructs

18

ArousalandRegulatorySystems(SeeSectionIIforfullreport)TheArousalandRegulatorySystemssubgroupworkeddirectlyfromconstructsalreadydefinedintheRDoCmatrix,anddidnotsuggestanyrevisionsoreditstothoseconstructs.Thegrouppointedoutsomeissueswiththegeneralconceptof“arousal,”indicatingthatitisnotwell-definedinthematrix,andthatthetermgenerallycutsacrossmanyconstructsindomains,includingattention,motivation,andanxiety,amongothers.Thegroupalsonotedthattheconstructsaresubservedbyawidearrayofneurobiologicalprocessesandfunctions,whichaddstothecomplexityoftryingtodisentanglearousalfromotherdomainsofthematrix.

Theynotethatmanyofthemeasuresthatwereconsidereddonothaveagreeduponstandardsforadministrationoranalysis,andmostneedmorenormativedata.Thereareseveralrecommendedmeasuresandtasksthatincludebothautonomicnervoussystemandthecentralnervoussystem.Thegroupsuggeststhatpolysomnography,orsleepEEG,isaveryusefulandwidelyusedtoolfortheSleep-Wakefulnessconstructandamuchbettermeasurethanhomerecordings,butacknowledgethatitistimeconsumingandexpensive.Lastly,thegroupnotesthattherearenotmanygoodself-reportmeasuresinthisdomainanddevelopmentworkonthesemaybeofbenefittothefield.

BehavioralAssessmentMethodsforRDoCConstructs

19

ArousalandRegulatorySystemsRecommendedTasks

Construct/Sub-construct Task Keyreferences

1.Arousal

HeartRateVariability(HRV)* Beauchaineetal.2015

ElectrodermalResponding(EDR)* Boucseinetal.2012

Pupillometry* Beattyetal.,2000

CardiacPre-ejectionPeriod(PEP)* Sherwoodetal.1990

PsychomotorVigilanceTask† Basneretal.2011

2.Sleep-Wakefulness

Latencytopersistentsleep(LPS),Waketimeaftersleeponset(WASO),Totalsleeptime(TST)

Iberetal.2007

SleepSpindles‡ Iberetal.2007

Non-REMSleep,SleepEEGSlowWaveActivity

Dijketal,1993

MultipleSleepLatencyTest(MSLT)‡ Littneretal.2005

InsomniaSeverityIndex§ Bastien,2001

FingerTappingMotorSequenceTask(MST)

Karnietal.1998

3.CircadianRhythms

DimLightMelatoninOnset(DLMO) Burgessetal.2015

LongitudinalActigraphy Briscoeetal.2014

Morningness-EveningnessQuestionnaire(MEQ)

§

HorneandOstberg,1976

MunichChronotypeQuestionnaire§ Roennebergetal,2003

*Autonomicmeasure†Cognitivemeasure‡Allmeasuredbypolysomnography§Self-Reportmeasure

BehavioralAssessmentMethodsforRDoCConstructs

20

NextSteps

BoththeproceedingsofthisworkshopandtheadvancesinthefieldoverthepastseveralyearssuggestanumberofimportantnextstepsintheRDoCInitiative.Weoutlinethembrieflyhere:

CriticalEvaluationofCurrentRDoCDomainsandConstructs:ThefieldislearningagreatdealaboutthetypesofdomainsandconstructsincludedinRDoCasthepaceofresearchontheseconstructshasevolved.Thedomainsubgroupreportsmakeitclearthatchangesarelikelyneededtosomeofthedomainsandconstructsgivennewknowledgeabouttheirvalidityandtheirorganization.SuchchangesarelikelytomaketheRDoCframeworkmoreusefulintermsofgeneratinginformationaboutputativebrain-behaviordimensionsrelevanttopsychopathology.Thus,anewroundofworkshopstoevaluateandinstantiatethesechangeswouldbeuseful.Aswithworkshopsonotherlevelsofanalysis,shouldsuchworkshopsbeenvisioned,wewouldrecommendanearlystarttogatheringinformationfromthefield,ideallythroughtheuseofamorefocusedsurveyinlieuofanRFIapproach,whichthoughhelpful,ismoregeneral.

DevelopmentofNewRDoCDomainsorConstructs:Resultsofthedomainsubgroups’workindicatesomeareaswherenewconstructsordomainsareneeded,forexample,emotionregulation.ThiscriticallyimportantconstructisnotcurrentlywellcapturedinanyexistingRDoCdomain,andfurtherconsiderationcouldhelpdetermineifitwouldbebeneficialtomodifythecurrentviewofemotionregulationasimplicitinrelevantconstructs(e.g.,fear,reward-relatedactivity,lackofcognitivecontrol).Itisessentialtodevelopaprocessbywhichnewdomainsorconstructscouldbeproposedandtheevidencefortheirvaliditysystematicallyevaluated.Suchaprocesswouldbenefitfromexplicitconsiderationofrecommendedtasksandparadigmsacrossdifferentlevelsofanalysis,similartotheprocessundertakenbythecurrentworkgrouptoidentifybehavioraltasksandparadigms.

Relatedtobothoftheserecommendations,anewCouncilworkgroupthatwilladviseNIMHregardingchangesandupdatestotheRDoCmatrixwasestablishedinMay2016andwillhaveitsfirstmeetinginSeptember2016.

AnalogousProcessforOtherLevelsofAnalysis:Thisworkgroupfocusedonmeasureswith“behavioral”outputs,primarilyduetotheneedtofocustheevaluationeffortstomeettimeandpracticalityconstraints.However,asnotedinseveraldomainsubgroupreports,insomecases,adifferentlevelofanalysismayeitherbetheonlywaytomeasureagivenconstruct,ormaybeabetterwaytomeasurethatconstruct.Assuch,additionalworkgroupsthatgothroughasimilarprocesswithmeasuresatotherlevelsofanalysis,suchasneuroimagingmeasuresand/orperipheralphysiology,willbeessential.Similarly,fewdomainsubgroupshadtimetosystematicallyevaluateself-reportmeasuresformanyconstructs,andaworkgroupspecificallyfocusedonself-reportwouldalsobebeneficial.Shouldsuchworkshopsbeenvisioned,wewouldrecommendanearlystarttogatheringinformationfromthefield,ideallythroughtheuseofamorefocusedsurveyinlieuofanRFIapproach,whichthoughhelpful,ismoregeneral.

BehavioralAssessmentMethodsforRDoCConstructs

21

DevelopmentalConsiderations:Thefieldisincreasinglyfocusedonearlydetectionandidentification.Toaccomplishthisgoal,researchonRDoCrelatedconstructsneedstobeconductedinchildren,includingveryyoungchildren.Forexample,theNegativeValenceSystemssubgroupwasabletoprovideastrongintegrationofdevelopmentalconsiderations.Itishighlylikelythatmanypromisingparadigmsvalidatedinadultswillonlyworkeffectivelywithchildreniftheyareeithermodified(simplerinstructionsortasks,developmentallyappropriatematerials,etc.),oruseadifferentapproachtomeasurement(observationalmeasures,etc.).Suchdevelopmentalconsiderationswillcontinuetolagbehindifnotspecificallyprioritized,eitherthroughfocusedworkshopsorthroughresearchwiththespecificgoalofmakingdevelopmentallyappropriatemodificationstoparadigmsusefulinadultpopulations.SimilarconcernsmayarisewhenextendingRDoCrelatedworkintogeriatricpopulations,whereothertypesoflifespanappropriatetaskmodificationsmaybeneeded.

StandardizationandPsychometricEvaluation:Afewoftherecommendedtasksdescribedabovehavestandardizedversionswithatleastsomedataabouttheirpsychometricproperties.However,everydomainsubgroupnotedthatevenformanypromisingparadigmsorclassesofparadigms,littlestandardizationofadministrationparametersexistsandinmanycases,littlepsychometricdataexist.Inordertoachievethecommondataelementsgoal,itwillbecrucialfortheretobe:(1)standardizationwithappropriateattentiontopotentialvariationneededasafunctionofpopulationand(2)evaluationofthepsychometricpropertiesofthesetasks.Itisunlikelythatcommondataelementswillbeadoptedformanyconstructsuntilthisworkisdone.Finalmeasuresthatarewidelyandfreelyavailableonflexibleandeasy-to-useplatformswillfacilitatedatasharingandintegration,buttheymustbeundergirdedbythiskeygroundwork.

Insummary,developmentoftheRDoCsystemwillrequirefocusedattentiontoensurethatthedomainsandconstructsremaininformedbynewevidenceandarerefinedasmoreworkisconducted.Thekeygoalofidentifyingcommondataelementstofacilitatedatasharingandcomparisonsacrosslaboratorieswillnecessitatesimilarprocessestotheonesdescribedherefordifferentlevelsofanalysis.Althoughincremental,suchstepsarecriticaltoenhancingthequalityofdataavailabletoaddresstheunderlyingneurobiologicalmechanismsofbehaviorrangingfromnormaltoabnormal.

BehavioralAssessmentMethodsforRDoCConstructs

22

SECTIONII:DOMAINSPECIFICREPORTS

Thefollowingreportsweregeneratedbyeachdomainsubgroup,basedontheirdiscussionsbothatthemeeting,andafterthemeetingwascomplete.

BehavioralAssessmentMethodsforRDoCConstructs

23

NegativeValenceSystemsFinalReport

C.EmilyDurbin,Ph.D.,IanH.Gotlib,Ph.D.SheriL.Johnson,Ph.D.,MercedesPerez-Rodriguez,M.D.,Ph.D.,StewartShankman,Ph.D.(chair)

I.GENERALCOMMENTSTheNVSsubgroupwaschargedwithdevelopingalistforthefiveconstructslistedwithinNVSdomain-(1)AcuteThreat;(2)PotentialThreat;(3)SustainedThreat;(4)Loss;and(5)FrustrativeNonreward.Giventhischargeanddiscussionattheoutsetofthemeeting,theNVSgroupdecidedtoworkstrictlyfromtheconstructsandexistingdefinitionslistedintheRDoCmatrix(http://www.nimh.nih.gov/research-priorities/rdoc/constructs/rdoc-matrix.shtml)andnotattempttorevise,add,orclarifytheconstructsinthematrix.

AfirstimportantissuethatsignificantlyguidedtheNVSsubgroup’sdiscussionwasthefactthatforseveralconstructs,thecommitteechargeprovedtobedifficult;thedefinitionsoftheconstructsdidnotalwayslendthemselvestoameasurementmodelinwhichtheelicitingcontextsfortheindividualdifferencesofinterestcouldberecreatedviaspecificlaboratoryorinvivoparadigms.Forexample,SustainedThreat(NVSconstruct#3)isdefinedas“Anaversiveemotionalstatecausedbyprolonged[i.e.,weekstomonths]exposuretointernaland/orexternalcondition(s),state(s),orstimulithatareadaptivetoescapeoravoid.”Wefeltthattherearenoparadigmsthatcouldbeusedethicallytoassessdirectlytheeffectsofsustainedthreatinhumans.Weacknowledgethattherearereal-lifesituationsthatmightbeusedasquasi-experimentalparadigmstoassesstheeffectsofsustainedthreatinhumans(e.g.,combatexposure,naturaldisasters).Inaddition,whilewecouldidentifyparadigmsthatassess‘downstreamconsequences’ofsustainedthreat(e.g.,attentionalvigilancetoemotionalstimuli),thespecificityoftheseconsequencestosustainedthreat(asopposedtoacutethreat,potentialthreat,orthreatingeneral)wasnotclear.ThegrouphadasimilardifficultywiththeconstructofLoss.LossisdefinedintheRDoCmatrixas“astateofdeprivationofamotivationallysignificantcon-specific,object,orsituation…andmayincludepermanentorsustainedlossofshelter,behavioralcontrol,status,lovedones,orrelationships.”Wefeltthatthisspecificaffectivestatecouldnotbeinducedthroughtheuseoflaboratory/invivoparadigmsinhumans–thus,welistedparadigmsthatinduceanalogsforthisaffectivestateaswellasstressfullifeeventsinterviewsthatprobepastexperiencesofloss.ItisimportanttohighlightthatthisissuedidnotapplytoourdiscussionofparadigmsthatassessAcuteThreat,PotentialThreat,andFrustrativeNonrewardbecausetherearewell-establishedparadigmsthatassesseachofthesethreeconstructs.

TherewasasecondimportantissuethatsignificantlyguidedtheNVSsubgroup’sdiscussion.Theoverallworkgroupwasinstructedspecificallytoidentifyonlyparadigmsforwhichtherewereclearbehavioraloutputs.Thus,forexample,paradigmsthatelicitedonlyaneuralresponseandnobehavioraloutput(e.g.,HaririHammerTask1)werenotincluded.Althoughthisparametermadesensegiventhebroaderaimsoftheworkgroup,andthefactthatfuturemeetingwouldfocusonadditionallevelsofanalysis,thishadtheeffectofnarrowingthetypesofparadigmsthatcouldbelisted.

BehavioralAssessmentMethodsforRDoCConstructs

24

Finally,althoughtheNVSdomainsubgroupwasabletoprovideratingsformostofthe18criteriaforeachproposedparadigm,thegroupwasstruckbytheconsistentlylowratingsforseveralofthecriteria.Forexample,thefieldlacksnormativedataformanyoftheparadigms(criterion#8).Inaddition,whilethereareconventionsinthefieldforhowseveraloftheparadigmsshouldbeadministered(e.g.,numberoftrials,duration,etc.),mostoftheseparametershavenotbeenempiricallydeterminedorassessed(criterion#4).TheNVSsubgroupfeltthattheseareimportantareasforfutureresearch.

II.ORGANIZATIONOFTHEDOMAIN1. Concretesuggestionsforchangestoconstructs:additionsanddeletions.

Aswenotedabove,ourgroupdidnotspendagreatdealoftimediscussingthestructureandorganizationofdomains;however,wepresentbelowseveralspecificsuggestionsthataroseduringourmeeting.

(A)TheNVSandpositivevalencesystem(PVS)domainsarecloselyrelatedinthatbothrefertoresponsestomotivationallysalientstimuli,butofdifferentvalences.Paradigmsthatprovideopportunitiesforobservingbehavioralprofilesrelevanttoonedomainoftenhaveconditions(orversions)thatelicitevidenceofindividualdifferencesintheotherdomainaswell.IdentifyingareasofoverlapanddistinctionbetweentheNVSandPVSconstructs,bothconceptuallyintermsofpsychologicalprocessesandmethodologicallyintermsofbestpracticesforestablishingconvergentanddiscriminantvalidity,shouldbeapriorityforfuturework.

(B)Furtherconsiderationshouldbegiventoaddingthefollowingconstructstothenegativevalencedomain:1)emotionallability(andotheraspectsofthetimecourseofaffectiverespondingsuchasaffectivechronometry);2)pain,and;(3)affectivedecisionmaking.

2. Rationaleforrecommendedchanges.Thesuggestedconstructslistedabovearehighlyrelevantforseverementalillness,havewell-studiedneuralcircuits,andarenotrepresentedinotherdomainsoftheRDoC.

III.RECOMMENDEDTASKS1. Paradigms(SeeAppendixNVS-Iforratingsoftaskcriteriaforthefollowingparadigm

recommendations).

ACUTETHREAT:1)TrierSocialStressTestandsimilarsocialperformancetasks2,3;2)BehavioralApproachTest(e.g.,fear&disguststimuli);3)ColdPressor(andotherpaintolerancetasks)4-6;4)CO2Challenge7,8;5)StrangerTasks9,10;6)FearConditioningTasks(animportantcorrelateofAcuteThreat)11,12

POTENTIALTHREAT:NoShock,PredictableShock,UnpredictableShock(NPU-ThreatTask)13

BehavioralAssessmentMethodsforRDoCConstructs

25

SUSTAINEDTHREAT:None

LOSS(analogofresponsetoloss):Sadness-elicitingfilmclips,butonlywithw/immersioninstructionsandfacialexpressionormoodratingsasdependentvariablesofinterest14,15

FRUSTRATIVENONREWARD:1)PointsSubtractionAggressionParadigm(PSAP)16,17;2)LaboratoryTemperamentAssessmentBatterytasksofBoxEmptyandTransparentBox18

2. Self-Report

ACUTETHREAT:manipulationcheckmeasures(e.g.,SUDS19,20),traitorexperiencemeasuresorfearedstimulusidentificationmeasures(e.g.,FearSurveySchedule21)

POTENTIALTHREAT-IntoleranceofUncertaintyScale(12itemversion22),BehavioralInhibitionScale(BIS)23,FearofNegativeEvaluationScale24,AnxietySensitivityIndex25,LifeEventsandDifficultiesSchedule(LEDS)26

SUSTAINEDTHREAT=YouthLifeStressInterview27,ChildhoodTraumaQuestionnaire28,LEDSdifficulties,TESI29,RiskyFamilies30,StressandAdversityInventory(STRAIN)31

LOSS=LEDS(socialexperienceoflossandpotentialthreat)26,STRAIN31

FRUSTRATIVENONREWARD=FrustrativeNonrewardResponsivenessSubscale32;QuestionnaireofDailyFrustrations33

IV.TASKSTHATREQUIREFURTHEREVALUATIONConstruct:AcuteThreat

Paradigm:IAPSpicturesorViewingofEmotionInducingFilms

Thisparadigmhasthepotentialtomeasureacutethreat,buttheNVSsubgroupfeltthatthiswouldonlybethecaseifthestimulussetwasrestrictedtoparticularlythreateningstimuliandnotsimplythosethataremorebroadly‘negative’invalence.Asanexample,trauma-specificstimuli(e.g.,helicopters,humvees)forveteranswithtrauma-relatedpsychopathologywouldbeanappropriateuseofthisparadigmtomeasureAcuteThreat.

Construct:SustainedThreat(moreaccurately,consequencesofexperiencingsustainedthreat)

Paradigm:Dot-ProbeTask(toassessvigilanceorattentionalcapture),ExogenousCuingTask(toassessinabilitytodisengagefromparticularclassesofstimuli),FacialMorphingTask(fordetectingthreatthresholds)

Asdiscussedabove,theconstructsmeasuredbythesetasksdonotdirectlymeasureindividuals’responsetoasustainedthreat,butrather,assessconstructsthatareconsequencesofhavingpreviouslyexperiencedsustainedthreat(atleastgiventhe

BehavioralAssessmentMethodsforRDoCConstructs

26

definitionofSustainedThreatintheRDoCmatrix).TheNVSsubgrouphadanadditionalconcernwiththeDotProbetask.Despiteitswidespreaduse,severalstudieshaveraisedquestionsaboutitsreliability(e.g.,Staugaard,2009-PsychologicalScienceQuarterly,althoughseePriceetal.,2015-PsychologicalAssessmentforarecentreportinwhichadequatereliabilitywasobtainedusingnovelmethods).Thereare,however,multiplevariantsofthedot-probetask(e.g.,supraliminalpresentation,subliminalpresentation,verbalvs.pictorialstimuli,etc.),andthepsychometricpropertiesofthedifferentversionsofthedot-probearelikelytodiffer.Thedot-probetaskdid,however,achievehighratingsforseveraloftheothercriteria.ThisraisedanotherissueconcerningwhethercertaincriteriashouldbeweightedmoreheavilythanothersindeterminingwhetheraparadigmshouldberecommendedforaspecificRDoCconstruct.CriteriaratingsfortheDot-ProbeandExogenousCuingTasksareprovidedinAppendixNVS-II.

V.TASKSTHATARENOTRECOMMENDEDTheNVSsubgroupdecidedtofocusonexemplartasksforeachconstructratherthandiscussparadigmsthatareinuseandthenattempttofitthemtospecificRDoCconstruct.BelowarealistofparadigmsthatthegroupdiscussedbutthatwerejudgedtonotfitdirectlyintothedefinitionsofthefiveNVSRDoCconstructs,and/orthatmaybebetterrepresentedbyotherRDoCconstructs.

1. Explicit(butnotimplicit)emotionregulationparadigms-includinginstructionsofdistance,suppress,accept,maintain.Excludedbecausetheseparadigmsappeartoaddressregulation,whichisnotoneofthecurrentNegativeValenceRDOCconstructs.

2. Darknessinhumans/lightinrodents(excludedduetolittlebehavioralyieldasaparadigm)

3. FlankerTasktoAssessResponsetoErrors–Unclearwhetheritelicitsathreatresponse(asperthedefinitionsofthethreeRDoCthreatconstructs).Despiteclearlybeingnegativeinvalence,thisparadigmmayperhapsbelongwithmeasuresofcognitivecontrol.

4. Losslearning/lossaversion–Didnotfitwellwithacutethreatorbrain’sdefensivemotivationsystemmorebroadly.Perhapsismoreappropriatewithinthecognitivesystem.

5. QuestionnairesassessingSymptomDimensions(e.g.,guilt,shame,bereavement)ThesequestionnaireswereexcludedastheytapoutcomesoftheRDoCconstructsratherthaninductionsoftheRDoCconstructs

6. Autobiographicalmemoryprobes(formeasuringlossandthreat)–Theseparadigmscanelicitsensationsofloss,threat,etc.thatareidiographicinnature.However,theNVSsubgroupexcludedthemgiventhedifficultyofstandardizationforstrictlybehavioraloutcomemeasures.Theseparadigmsmaybeuseful,however,forelicitingbroadernegativeaffectivestates.

VI.REFERENCES1. HaririAR,TessitoreA,MattayVS,FeraF,WeinbergerDR.TheAmygdalaResponseto

EmotionalStimuli:AComparisonofFacesandScenes.NeuroImage.2002;17(1):317-323.

BehavioralAssessmentMethodsforRDoCConstructs

27

doi:10.1006/nimg.2002.1179.2. KirschbaumC,PirkeKM,HellhammerDH.The“TrierSocialStressTest”–AToolfor

InvestigatingPsychobiologicalStressResponsesinaLaboratorySetting.Neuropsychobiology.1993;28(1-2):76-81.doi:10.1159/000119004.

3. AllenAP,KennedyPJ,CryanJF,DinanTG,ClarkeG.Biologicalandpsychologicalmarkersofstressinhumans:FocusontheTrierSocialStressTest.Neuroscience&BiobehavioralReviews.2014;38:94-124.doi:10.1016/j.neubiorev.2013.11.005.

4. EdelsonJT,RobertsonGL.Theeffectofthecoldpressortestonvasopressinsecretioninman.Psychoneuroendocrinology.1986;11(3):307-316.doi:10.1016/0306-4530(86)90016-8.

5. VelascoM,GómezJ,BlancoM,RodriguezI.Thecoldpressortest:pharmacologicalandtherapeuticaspects.Americanjournaloftherapeutics.1997;4(1):34-38.

6. RolkeR,BaronR,MaierC,etal.QuantitativesensorytestingintheGermanResearchNetworkonNeuropathicPain(DFNS):Standardizedprotocolandreferencevalues.Pain.2006;123(3):231-243.doi:10.1016/j.pain.2006.01.041.

7. GormanJM,PappLA,CoplanJD,etal.AnxiogeniceffectsofCO2andhyperventilationinpatientswithpanicdisorder.AmericanJournalofPsychiatry.April1994.doi:10.1176/ajp.151.4.547.

8. PomaSZ,MilleriS,SquassanteL,etal.Characterizationofa7%carbondioxide(CO2)inhalationparadigmtoevokeanxietysymptomsinhealthysubjects.JournalofPsychopharmacology.2005;19(5):494-503.doi:10.1177/0269881105056533.

9. BussKA,SchumacherJRM,DolskiI,KalinNH,GoldsmithHH,DavidsonRJ.Rightfrontalbrainactivity,cortisol,andwithdrawalbehaviorin6-month-oldinfants.BehavioralNeuroscience.2003;117(1):11.doi:10.1037/0735-7044.117.1.11.

10. PfeiferM,GoldsmithHH,DavidsonRJ,RickmanM.ContinuityandChangeinInhibitedandUninhibitedChildren.ChildDevelopment.2002;73(5):1474-1485.doi:10.1111/1467-8624.00484.

11. NorrholmSD,VervlietB,JovanovicT,etal.Timingofextinctionrelativetoacquisition:Aparametricanalysisoffearextinctioninhumans.BehavioralNeuroscience.2008;122(5):1016.doi:10.1037/a0012604.

12. ZeidanMA,LebronMiladK,ThompsonHollandsJ,etal.Test–RetestReliabilityduringFearAcquisitionandFearExtinctioninHumans.CNSNeuroscience&Therapeutics.2012;18(4):313-317.doi:10.1111/j.1755-5949.2011.00238.x.

13. SchmitzA,GrillonC.Assessingfearandanxietyinhumansusingthethreatofpredictableandunpredictableaversiveevents(theNPU-threattest).NatureProtocols.2012;7(3):527-532.doi:10.1038/nprot.2012.001.

14. SamsonAC,KreibigSD,SoderstromB,WadeAA,GrossJJ.Elicitingpositive,negativeandmixedemotionalstates:Afilmlibraryforaffectivescientists.Cognition&Emotion.May2015.doi:10.1080/02699931.2015.1031089.

15. JoormannJ,TalbotL,GotlibIH.Biasedprocessingofemotionalinformationingirlsatriskfordepression.JournalofAbnormalPsychology.2007;116(1):135.doi:10.1037/0021-843X.116.1.135.

16. CherekDR.Effectsofsmokingdifferentdosesofnicotineonhumanaggressivebehavior.Psychopharmacology.1981;75(4):339-345.doi:10.1007/BF00435849.

BehavioralAssessmentMethodsforRDoCConstructs

28

17. GenioleSN,MacDonellET,McCormickCM.ThePointSubtractionAggressionParadigmasalaboratorytoolforinvestigatingtheneuroendocrinologyofaggressionandcompetition.HormonesandBehavior.April2016.doi:10.1016/j.yhbeh.2016.04.006.

18. GagneJR,VanHulleCA,AksanN,EssexMJ,GoldsmithHH.Derivingchildhoodtemperamentmeasuresfromemotion-elicitingbehavioralepisodes:Scaleconstructionandinitialvalidation.PsychologicalAssessment.2011;23(2):337.doi:10.1037/a0021746.

19. WolpeJ.ThePracticeofBehaviorTherapy.Allyn&Bacon;1990.20. KaplanDM,SmithT,CoonsJ.Avaliditystudyofthesubjectiveunitofdiscomfort(SUD)

score.MeasurementandEvaluationinCounselingandDevelopment.January1995.21. WolpeJ,LangP.Wolpe:ManualfortheFearSurveySchedule.SanDiego,CA:Educational

andIndustrialTestingService;1977.22. CarletonRN,NortonMAPJ,AsmundsonGJG.Fearingtheunknown:Ashortversionofthe

IntoleranceofUncertaintyScale.JournalofAnxietyDisorders.2007;21(1):105-117.doi:10.1016/j.janxdis.2006.03.014.

23. CarverCS,WhiteTL.Behavioralinhibition,behavioralactivation,andaffectiveresponsestoimpendingrewardandpunishment:TheBIS/BASScales.JournalofPersonalityandSocialPsychology.1994;67(2):319.doi:10.1037/0022-3514.67.2.319.

24. WatsonD,FriendR.Measurementofsocial-evaluativeanxiety.1969.doi:10.1111/j.2044-8341.1967.tb00577.x/abstract.

25. TaylorS,ZvolenskyMJ,CoxBJ,etal.Robustdimensionsofanxietysensitivity:DevelopmentandinitialvalidationoftheAnxietySensitivityIndex-3.PsychologicalAssessment.2007;19(2):176.doi:10.1037/1040-3590.19.2.176.

26. BrownGW,HarrisT.Socialoriginsofdepression:areply.PsychologicalMedicine.1978;8(04):577-588.doi:10.1017/S0033291700018791.

27. RUDOLPHKD,FLYNNM.Childhoodadversityandyouthdepression:Influenceofgenderandpubertalstatus.DevelopmentandPsychopathology.2007;19(02):497-521.doi:10.1017/S0954579407070241.

28. BernsteinDP,FinkL.Bernstein:ChildhoodTraumaQuestionnaire:aRetrospectiv...-GoogleScholar.1998.

29. IppenCG,FordJ,RacusinR,etal.TraumaticEventsScreeningInventory-ParentReportRevised.2002.

30. TaylorSE,LernerJS,SageRM,LehmanBJ,SeemanTE.EarlyEnvironment,Emotions,ResponsestoStress,andHealth.JournalofPersonality.2004;72(6):1365-1394.doi:10.1111/j.1467-6494.2004.00300.x.

31. SlavichGM,EpelES.TheStressandAdversityInventory(STRAIN):Anautomatedsystemforassessingcumulativestressexposure.LosAngeles:UniversityofCalifornia.2010.

32. WrightKA,LamDH,BrownRG.Reducedapproachmotivationfollowingnonreward:ExtensionoftheBIS/BASscales.PersonalityandIndividualDifferences.2009;47(7):753-757.doi:10.1016/j.paid.2009.06.015.

33. BaarsMY,252M,llerMJ,etal.DepressiveandAggressiveResponsestoFrustration:DevelopmentofaQuestionnaireandItsValidationinaSampleofMaleAlcoholics.DepressionResearchandTreatment.2011;2011.doi:10.1155/2011/352048.

BehavioralAssessmentMethodsforRDoCConstructs

29

AppendixNVS-I:NVSdomaingrouptableontaskcriteriaforrecommendedparadigms NVS

Construct

Task

ValidM

easureof

Construct(#1

)

Test-Retest

Reliability(#2)

Floo

r/Ce

iling(#

2)

PracticeEffects(#2

)

Longitu

dina

lStability

(#2)

Stan

dardize

dParameters(#4

)

Copyrig

ht(#

15)

Canitbe

usedacross

man

ysites?(#9)

Canitbe

usedwith

childrenorsp

ecial

popu

latio

ns?(#6)

Sensitivityto

w/in

pe

rson

cha

nge(#10

)

Tolerability(#18

)

Acutethreat TrierSocialStressTest

4 *3* *3* ? ? 2 5 5 Ages:5

Culture:4?

¾* 3

Acutethreat BehavioralapproachTest

4 ? ? N/A ? 2 5 5 Ages:5

Culture:4

5 4

Acutethreat Coldpressorandotherpaintolerancetasks

4 3 ? ? 3 4(butnotalwaysattendedtoinliterature)

5 3 Ages:5

Culture:5

3 3

Acutethreat CO2challenge 4 3 ? 4 5 5 Ages:5

Culture:4

4 3

Acutethreat Strangertasks 4 ? 5 1 3 2 5 5 Ages:5

Culture:5

1 3

Acutethreat(learning)

Fearconditioning

5 2 ? ? ? 4 5 5 Ages:5

Cultures:

5 4

Potentialthreat

NPUThreat-Task

4/5 4 5 ? ? 2 5 3 Ages:5

Culture:3

? 3

BehavioralAssessmentMethodsforRDoCConstructs

30

Loss Sadnesselicitingfilmclips(seecaveatsabove)

4 ? ? ? ? 3 3(somemaybecopyrighted)

5 Ages:5

Culture:4

3 4

Frustrativenonreward

LabTAB:BoxEmpty,TransparentBox

5 4 5 ? 4(onlyifmult.tasksareused)

2 5 3 5,Adults(potentiallyadaptable)

Culture:?

1 4

Frustrativenonreward

PointsSubtractionAggressionParadigm(PSAP)

4 1* 1* ? 1? 1 5 3 1

Couldbeadapted

? 4

NVS

Con

struct(resto

fcrite

ria)

Task

(resto

fcriteria)

Alternateform

s(#2

)

Internalre

liability(#2)

Canbe

usedinclinical

trialsorsc

reen

ing(#5)

Stan

dalon

ebe

havioralta

sk?(#7)

Canusewith

imaging

orERP

?(#11

)

Relatb

twta

skperf&

ne

uralsigknow

n?

(#13

)

Clinicalphe

notype

(#14

)

Measureso

ne

constructo

rspe

cific

toone

?(#16)

Anytaskth

atcou

ldbe

mod

ified

?(#17

)

Norms(#8

)

Anim

alana

logue

(#12

)

Acutethreat TrierSocialStressTest

1 ?? 1 5 4* 2 5 4 -- 1 1

Threat Behavioralapproach

1 ? 4 5 5 5 5 5 Lotsofmodifications

1 5

Acutethreat ColdPressorandotherpaintolerancetasks

1 ? 2 5 5 5 4 1 Potentially 3 2

Acutethreat CO2challenge 1 N/A 4 5 5 4 5 5 Notreally 1 4

Acutethreat Strangertasks 1 4 2 5 2 2 2 3 ? 1 5

BehavioralAssessmentMethodsforRDoCConstructs

31

Acutethreat(learning)

Fearconditioning

5 4 5 5 4 5 4 Many N/A 5

Potentialthreat

NPU 4 3(withSUDSratings)

3

5 5 5 5 -- 1 5

Loss Sadnesselicitingfilmclips,espw/immersion;facialexpormoodratings

4 ? 4 5 5 3 4 2/3 Yes,many 3 1

Frustrativenonreward

PointsSubtractionAggressionParadigm(PSAP)

1 ? 4 5 5 3 4 3(constructitselfisbroad.Measuretapslossaswellasthreat)

Couldbemodifiedforchildren

1 3

Frustrativenonreward

LabTAB:BoxEmpty,TransparentBox

1 4 3 5 2 -- 3 3(constructitselfisbroad.Measuretapscognitivecontrolandpositiveemotionality)

Couldbemodifiedforadults

1 2

BehavioralAssessmentMethodsforRDoCConstructs

32

AppendixNVS-II:NVSdomaingrouptableontaskcriteriaforparadigmsthatneedmorework,ratedfrom1(noevidence)-5(strongevidence)

Construct

Task

ValidM

easureof

Construct(#1)

Test-Retest

Reliability(#2)

Floo

r/Ce

iling(#

2)

PracticeEffects

(#2)

Longitu

dinal

Stability(#

2)

Standardize

dParameters(#4)

Copyrig

ht(#

15)

Canitbe

used

acrossm

anysites?

(#9)

Canitbe

used

with

kidso

rspecial

popu

latio

ns?(#6)

w/in

person(#10)

Tolerability(#18)

VigilanceorAttentionalcapture

DotProbe(supraliminal1000mspresentationofangry/fearfulfaces)

3 2? 5 ? 2? 5 5 5 5 5 5

Inabilitytodisengagefromnegativestimulus

ExogenousCuingTask

3(psychometricsfornon-emotionalstimuliisavailable,butunclearifsimilarforemotionalstimuli)

5 ? 2 5 5 4 ? 5

BehavioralAssessmentMethodsforRDoCConstructs

33

Construct(rest

ofcriteria)

Task

(resto

fcrite

ria)

Alternate

form

s(#2)

Internal

reliability(#2)

Canbe

usedin

clinicaltrials

orsc

reen

ing

(#5)

Standalon

ebe

havioral

task?(#7)

Canusewith

im

agingor

ERP?(#

11)

Relatb

twta

sk

perf&neu

ral

sigkno

wn?

(#13)

Clinical

phen

otype

(#14)

Measureso

ne

constructo

rspecificto

one?(#

16)

Anytaskth

at

couldbe

mod

ified

?(#17)

Norms(#8)

Anim

al

analogue

(#12)

VigilanceorAttentionalcapture

DotProbe(supraliminal1000mspresentationofangry/fearfulfaces)

2 1 4 5 5 4 5 3 -- 1 3

Inabilitytodisengagefromnegativestimulus

ExogenousCuingTask

2 ? 4 5 3 ? 3 3 Lotsofmodif.arepossible

1 1

BehavioralAssessmentMethodsforRDoCConstructs

34

PositiveValenceSystemsFinalReport

MauricioR.Delgado,Ph.D.,PaulW.Glimcher,Ph.D.GregHajcak,Ph.D.,DiegoA.Pizzagalli,M.D.,Ph.D.(chair),MichaelT.Treadway,Ph.D.,BenjaminE.Yerys,Ph.D.

ExecutiveSummary

ThePositiveValenceSystems(PVS)DomainsubgroupcarefullyconsideredtheoriginalPVSconstructsanddiscussedover25tasksthatwererankedaccordingtopre-definedcriteria.DuringdeliberationsconcerningthePVSstructureandpossiblereconfigurations,particularemphasiswasplacedon(1)avoidingpotentialredundanciesacrossconstructs/sub-constructs,and(2)attemptingtoisolate“purer”constructs.Similarly,whenconsideringtasks,emphasiswasplacedonparadigmsthatisolategivensub-constructs.TheseconsiderationsledtoaproposedrestructuringofthePVSdomainintothreeconstructs(RewardResponsiveness,RewardLearning,RewardValuation),eachinvolvingthreesub-constructs.Amongalltasksdiscussed,16wereselectedforpotentialprioritization.Othertaskswerediscussedbutnotrecommended,whereasothersweredeemedpromisingbutrequiringmoreevaluation.

I.GeneralCommentsBeforediscussionsofthecurrentPVSstructureandpotentialtasks,theworkgroupdeliberatedonseveralgeneralpoints:

1. Manytasksthathavebeenadoptedwidelyintheliterature,particularlythosedevelopedforneuroimaging/neuropsychologicalstudiesinthelate1990s/early2000s,oftencannotdisentanglecurrentPVSconstructs/sub-constructs.ProminentexamplesaretheIowaGamblingTask1andtheMonetaryIncentiveDelay(MID)task2,whichareamongthemostwidelyusedtasksinthefield,andhaveprovidedawealthofvaluableinformation.Forexample,intheMIDtask,rewardvalueandrewardpredictionerror(RPE)areperfectlycorrelated,andthuscannotbede-conflated.

2. TheMIDtaskcurrentlyappearsinthematrixfortheconstructInitialResponsivenesstoReward,howeveroutcomesfromthistaskthatmeasureresponsetorewardcannotbedissociatedfromeachother.ThePVSgroupisnotrecommendingthistaskasameasureofInitialResponsivenesstoReward.Alternatively,theyarerecommendingitasameasureofRewardAnticipationbecausetheoutcomesassociatedwithanticipationareindependentandcanbeisolated.

3. Althoughworkgroupmembersdeemedregulatoryprocessesasbeingveryimportant,therewasconsensusthatregulationofPVSconstructswouldentailprocessesbettercapturedbytheCognitiveSystemsandArousalSystems.Accordingly,tasksprobingregulatoryprocesseswerenotdiscussed.

BehavioralAssessmentMethodsforRDoCConstructs

35

4. Forsomesub-constructs(inparticular,“initialresponsivenesstoreward”),tasksyieldnodirectbehavioraloutput.However,theseconstructscanbemeaningfullyprobedwithimaging,electrophysiological,andperipheralpsychophysiologicaltechniques,andcouldbeaugmentedbyaffectiveratings.Giventhecentralityoftheseconstructsandtheirtranslationalvalueforpreclinicalmodels,theabsenceofdirectbehavioraloutputdidnotpreventtherecommendationofvarioustasks.Ingeneral,theabilityofatasktobeusedinconjunctionwithimaging,electrophysiologyorpsychophysiologywasdeemedaplus.

5. Someconstructs(e.g.,RewardPredictionError)requirecomputationalmodelingformeaningfulinterpretation.Accordingly,disseminationofsomeoftheproposedtaskswithinthissub-constructmightbecontingentupon(andthuslimitedby)expertiseincomputationalmodeling.

6. Althoughworkgroupmembersacknowledgedtheimportanceofself-reportmeasuresofPVSconstructs,performance-basedorbehavioraltaskswereprioritizedtomaximizepotentialtranslationtoandback-translationfrompreclinical(animal)models.

7. Whenevaluatingtasks,tolerability(i.e.,participants’experience)wasalsoconsidered.

II.OrganizationoftheDomain

DuringdeliberationsconcerningtheoriginalPVSconstructsandstructure,particularemphasiswasplacedon(1)avoidingpotentialredundanciesacrossconstructsandsub-constructs,and(2)attemptingtoisolate“purer”constructs.TheseconsiderationsledtoaproposedrestructuringofthePVSdomainintothreeconstructs(RewardResponsiveness,RewardLearning,RewardValuation),eachinvolvingthreesub-constructs(Table1).Rationalesforrestructuring/renamingaswellasde-prioritizationofsometasknominationsfromtheoriginalRDoCworkshopareprovidedinlatersectionsofthisreport.

TABLE1:ProposedRestructuringofthePVSdomain

Construct Sub-construct

1.RewardResponsiveness

1.1.InitialResponsetoReward

1.2.RewardAnticipation

1.3.RewardSatiation

2.RewardLearning

2.1.Habit

BehavioralAssessmentMethodsforRDoCConstructs

36

2.2.ProbabilisticandReinforcementLearning

2.3.RewardPredictionError

3.RewardValuation

3.1.Reward(probability)

3.2.Delay

3.3.Effort

III.RecommendedTasks

Paradigmsthatwereevaluatedas“bestinclass”forgivenPVSsub-constructsaredescribedinmoredetailinAppendicesPVS-IIa-PVS-IIf.RatingsoneachsuggestedcriterionforthesetasksareprovidedinAppendixPVS-I.

1. RewardResponsivenessWeproposeRewardResponsivenessasaconstruct,whichincludesthreesub-constructs:initialresponsivenesstoreward,rewardanticipation,andrewardsatiation.

1.1. Initialresponsivenesstoreward:Thisisdefinedbyneuralandphysiologicalresponsetopositivereinforcers(money,positivepictures).Assuch,bydefinitiontherearenooptimalbehavioralmeasures,atleastnotincurrentinstantiations.

GuessingTask(e.g.,CardGuessingorDoors)3,4.Thesetaskshavenomeaningfulbehavioraloutput;rather,theyhavebeenwidelyusedinconjunctionwithe.g.fMRI,EEG/ERP,HR,GSRrecordings.Theycouldbemodifiedtoincluderatings.Thesetaskshaveexcellentconstructvalidityandpsychometricproperties,althoughmoreworkisneededtoevaluatetest-retestreliability.Therearegooddataonindividualdifferencesandsensitivitytochange.SeeAppendixPVS-IIafordetailedevaluations.

1.2. Rewardanticipation

MonetaryIncentiveDelayTask2.Probesrewardanticipation;modificationsareneededinordertoimproveitsabilitytoisolateanticipation;inparticularuseoflongerandjitteredinterstimulusintervals(e.g.,followinganexponentialfunctionwithover-representationofshorterinter-stimulusintervals)isexpectedtoimprovetheabilitytoisolateanticipation-relatedactivation.SeeAppendixPVS-IIbfordetailedevaluationsforeachcriterionforthistask.

BehavioralAssessmentMethodsforRDoCConstructs

37

1.3. Sustainedresponsivenesstoreward:Wesuggestedrenaming“RewardSatiation”.

Fixed-RatioSatiationSchedule5.Excellentconstructvalidity,andpotentiallywouldhaveexcellentothercriteria,butneedssignificantdevelopment.Thisremainsarecommendationduetothelackofabetteroptionforthissubconstruct.

2. RewardLearningWeproposeRewardLearningasaconstruct,withsub-constructsofhabit,rewardpredictionerror,andprobabilisticandreinforcementlearning.

2.1. Habit

DevaluationTask6,7.Thistaskhasexcellentconstructvalidity.Therearesomeconcernsaboutabilitytorepeatedlyadminister(i.e.,practiceeffects)andtheuseofthetaskwithchildren/specialpopulations.Thereissomeevidenceforlinkstoclinicalfeatures.Thepsychometricpropertiesarenotyetknown,buttherearenobetteroptionsforrecommendation.SeeAppendixPVS-IIcfordetailedevaluationsforeachcriterionforthistask.

HabitTask(longertermreversallearning;8.Thistaskpotentiallyhasexcellentconstructvaliditybutinformationaboutotherparametersisunknown.

HabitLearningTask9.Thistaskhasexcellentconstructvaliditybutinformationaboutotherparametersisunkown.Thetaskmaynotbepracticalorefficientbecauseoflength.Someproposedmodificationsincludeadministeringthetaskinonlyonesessionsothatitcouldbecomemoresensitivetoindividualdifferences.

2.2. ProbabilisticandReinforcementLearning(formerRewardLearning)

ProbabilisticRewardTask10.Thistaskhasexcellentconstructvalidityandacceptabletest-retest,butthereisaneedtoevaluateinternalreliability(e.g.,computereliabilityforodd/eventrials).Itcanberepeated,andusedacrossmanyageandpopulations.Itissensitivetowithin-personchangeandhasknownrelationstoclinicalfeatures.Performanceonthistaskcanbemanipulatedbypharmacological(e.g.,dopaminergiccompounds)orbehavioral(e.g.,acutestressors)meansinpredictablemanners.Therearesomeemergingnormativedataforthistask.SeeAppendixPVS-IIdfordetailedevaluationsforeachcriterionforthistask.

PavlovianConditioning11.Inthesetasks,onestimuluspredictsapositiveoutcome.Inspiteofstrongconstructvalidity,thesetasksyieldpoorbehavioralprofiles.Thus,theyrequireimagingorpsychophysiological(e.g.,skinconductance,pupildilation)readouts.Suchtaskscouldbemodifiedinordertoincludeaffectiveratings.Thesetaskshaveunknownpsychometricproperties.Theycanberepeated,andusedacrossmanyageandpopulations.Thereisevidenceforsomelinkstoclinicalfeatures.Therearenonormativedataforthesetasks.

BehavioralAssessmentMethodsforRDoCConstructs

38

ProbabilisticStimulusSelectionTask12.Thistaskhasexcellentconstructvalidity.Someconcernsaboutthistaskincludethefactthatmanyparticipantsdonotlearnit,itneedsworkfromotherlabsusingthetaskbesidestheinitiallab,anditwouldbedifficulttousewithchildrenorspecialpopulations.Thistaskcanberepeated.Thereissomeevidenceforlinkswithclinicalfeatures.Therearenonormativedataforthistask.

DriftingDoubleBandit13.Thistaskhasexcellentconstructvalidity,butunknownpsychometricsproperties.Thereislittleevidenceaboutlinkstoclinicalfeatures.Thesensitivityofthetasktowithin-personchangeorclinicalfeaturesisunknown.Thistaskcanberepeatedifdifferentstimulussetsaredeveloped,anditcanbeusedacrossmanyageandpopulations.Therearenonormativedataforthistask.

2.3. Expectancy/RewardPredictionError

RutledgePassiveLotteryTask14.Therearenobehavioraloutputsforthistask,butitisapuremeasureofRPE.Thepotentialdownsidetothistaskisthatmodelingthedatarequiresexpertiseincomputationalmodeling.

DriftingDoubleBandit13.Thistaskhasexcellentconstructvalidity,butunknownpsychometricsproperties.Thereislittleevidenceaboutlinkstoclinicalfeatures.Thesensitivityofthesetasktowithinpersonchangeorclinicalfeaturesisunknown.Thistaskcanberepeatedifdifferentstimulussetsaredeveloped,anditcanbeusedacrossmanyageandpopulations.Therearenonormativedataforthistask.

3. ValuationWeargueforaconstructcalledValuation,withsub-constructsofReward(whichwillencompassprobability),delay,andeffort.

3.1. Reward

ProbabilityChoiceTask15oranalogous—dropambiguity).SeeAppendixPVS-IIefordetailedevaluations.

Measuringthevaluesubjectsplaceonarewardinawaythatallowsinter-individualcomparisonbasedonlyonbehaviorisatheoreticallydifficultprospect.Usingonlybehavioronecanonlymeasuredifferenceinthe“rateatwhich”thesubjectivevalueofarewardgrowsasafunctionoftherateatwhichtheobjectivemagnitudeofagivenrewardgrows.Thisis,formally,thecurvatureoftheutilityfunctionfromeconomics.Typically,theutilityfunctionismeasuredbyaskingquestionsthatcompeteafixedsizedrewardagainstrewardsorgreatermagnitudebutlowerprobability.MeasurementsofthistypeareverywelldevelopedinpsychologyandbehavioraleconomicsandtypicallyarederivativeoftheclassicHoltandLaurie16approach.

WillingnesstoPay(BDM)17;seealso18

BehavioralAssessmentMethodsforRDoCConstructs

39

Onewaytobegintocompareindividualresponsestorewardsistoasksubjectstopriceindollars(orinanothercurrency)themaximumamountthattheywouldbewillingtopaytoobtainaspecificgoodunderaspecificcondition.Twoissues,however,makethatmeasurementproblematic.First,asubjectwhoisactuallybiddingonarealgoodisoftenincentivizedtoreportalownumberinthehopesthattheywill‘game’theexperimenterintogivingthemthatgoodforless.Thisfirstconcernislargelyeliminatedinthe‘BDM’method.IntheBDMmethod,subjectsstatethemaximalpricethattheywouldbewillingtopayfromamenuofpossibleprices–say$1-$5in50centincrements.Oncetheyhavereportedthatpricetheydrawachipfromanurnwitheachchipbearingasinglepricefrom$1-$5in50centincrements.Ifthedrawnchipisbelowtheirpre-statedmaximumtheybuythegoodforthepriceonthechip,ifitisabovethepre-statedmaximumtheyarenotallowedtobuythegood.Underthisregimethesubjectsdobestiftheyreportthetruepricebecausethepricingmechanismisunaffectedbytheir‘bid’.BDMisforthisreasonthegoldstandardforassessingtrulyheld‘values’(indollars)fornon-monetarygoods.Thesecondproblemisthatsubjectsshouldneverbewillingtopaymorethanthemarketpriceforagoodiftheycanleavethelabimmediatelytopurchaseitforless.Typically,thisisdealtwithbyaskingthesubjectstoremaininthelabafterbiddingforsomefixedlengthoftime.Forraregoodsorgoodswithhighmarketpricesthisismuchlessofaproblem.

3.2. Delay

WorkgroupdeliberationsaswellasconsiderationofsuggestionsprovidedinresponsetotheRFIhighlightseveralcandidatetasks,whichhavecommonfeatures:Kable’stask19(mostoftenusedinclinicalsamples),TraditionalBickelHypothetical20(mostoftenusedinsubstanceabuseliterature),JohnsonandBickel21,GreenandMeyerson'shypothetical22(mostoftenusedinpsychologystudies).ThetaskbyKablewasdeemedoptimalforusewithneuroimagingduetoitsdisplaytechnique.

3.3. Effortvaluation/willingnesstowork.

EffortExpenditureforRewardTask23.Thistaskhasgoodconstructvalidity.Itcanbeusedinarangeofpopulations,issensitivetowithin-subjectmanipulationsandcanbeusedwithchildren(>9yearsold,althoughwithoutprobabilitymanipulation).Thetaskhasmoderatetoexcellenttest-retestreliability.Someminorconcernsaboutthistaskwereaboutaboutwhethereffortisconfoundedwithtimeontask,butitwasfeltthata“pure”versioncouldbedevelopedbyfixingtrialtimingstructure(sotimeontaskisheldconstant).SeeAppendixPVS-IIefordetailedevaluationsforeachcriterionforthistask.

BehavioralAssessmentMethodsforRDoCConstructs

40

TABLE2:RecommendedTasksforeachPVSsub-constructConstruct/Sub-construct Task Keyreferences

1.RewardResponsiveness

1.1.InitialResponsetoReward

SimpleGuessingTask

(Delgadoetal.2000)2

(Carlsonetal.2011)3

1.2.RewardAnticipation MonetaryIncentiveDelayTask (Knutsonetal.2000)1

1.3.RewardSatiation Fixed-ratioSatiationSchedule (Sherman&Thomas1968)4

2.RewardLearning

2.1.Habit DevaluationTask (Gillanetal.2011)22

HabitTask (McKimetal.2016)7

HabitLearningTask (Tricomietal.2009)8

2.2.ProbabilisticandReinforcementLearning ProbabilisticRewardTask (Pizzagallietal.2005)9

PavlovianConditioning (O’Dohertyetal.2004)23

Driftingdoublebandit (Dawetal.2011)11

ProbabilisticStimulusSelectionTask (Franketal.2004)10

BehavioralAssessmentMethodsforRDoCConstructs

41

2.3.RewardPredictionError RutledgePassiveLotteryTask (Rutledgeetal.2010)12

Driftingdoublebandit (Dawetal.2011)11

3.RewardValuation

3.1.Reward(probability) ProbabilityChoiceTask e(Levyetal.2010)13

WillingnessToPayTask (Beckeretal.1963)15

3.2.Delay

DelayedDiscountingTask

f(Kable&Glimcher2007)17

(Johnson&Bickel2002)19

(Green&Myerson2004)20

3.3.Effort EffortExpenditureforRewardTask (Treadwayetal.2009)21

eDropambiguitymanipulationfDeemedpreferableinconjunctionwithfunctionalneuroimaging

BehavioralAssessmentMethodsforRDoCConstructs

42

IV.TasksthatrequiremoreevaluationRewardValuation

3.3.Effort

a)DeckChoiceEffortTask24 :Thiscognitiveeffort-baseddecisionmakingtaskwasdevelopedforuseinclinicalpopulations24.TheDecktaskinvolvesmakingchoicesbetweenhardvs.easycognitivetasks(i.e.,cognitivesetswitching)fordifferentlevelsofmonetaryreward.Itisbasedonacognitiveefforttaskoriginallydevelopedforhealthyindividuals25.Theconstructofcognitiveefforthasbeenstudiedinanimalmodels26;thistaskwasnominatedinresponsetoNIMHRFIpostedonMonday3/28/2016(https://grants.nih.gov/grants/guide/notice-files/NOT-MH-16-007.html).

• Evidenceforconstructvalidityintermsofthemechanismthetestisthoughttoassess:Evidenceforconstructvaliditystemsfrom:itsabilitytodistinguishschizophreniapatientsfromhealthysubjects,relationstoothereffort-baseddecisionmakingtasksinschizophrenia,non-clinicalresearchshowingsomeconvergentvalidityfordifferenttypesofcognitiveefforttasks,andneuroimagingstudies.

• Evidenceforreliability,ofanyform,includinginternalconsistency,test-retestreliability,etc.:Modest-to-Good(ICC=.67)one-monthtest-retestreliabilityinpatientswithschizophreniar24.

• Evidenceforotherrelevantpsychometriccharacteristicsaboutthetest,includingpracticeeffects,floororceilingeffects,etc.:Thetaskperformedreasonablywellregardingfloor,ceiling,orpracticeeffectsinschizophrenia24.

• Descriptionsofanyknownanimalhomologuesforthistest:Cognitiveeffort-baseddecisionmakingtaskshavebeenusedinanimalmodels26.

• Evidenceoftaskimprovementwithpsychologicalorpharmacologicaltreatment:None

b)CognitiveEffortDiscounting(COGED)task27:TheCOGEDisusedtoassessevaluationofcognitiveeffortcosts,balancedagainstrewards.Theextenttowhichanindividualdiscountsareward,contingentonperformanceofademandingtask,isthoughttoindicatehowstronglytheyexperienceeffortcostsinthecognitivedomain,andconversely,theirmotivationforgoalpursuitviacognitiveengagement.

• Evidenceforconstructvalidityintermsofthemechanismthetestisthoughttoassess:COGEDissensitivetobothstateandtraitfactorsthatsupportitsconstructvalidity.Statefactorsincludeworkingmemoryload(‘N’ontheN-backtask),whichincreasesdiscountingandofferamount,whichdecreasesdiscounting27.TraitfactorsincludeNeedforCognitionandcognitiveaging27andnegativesymptomsinschizophrenia28.Moreover,unpublishedobservationsindicatethatCOGEDisstronglycorrelatedwithswitchcostsinatasks-switchingparadigm(steepdiscountersontheN-backhavelargerswitchcostsinadifferenttask-switchingparadigm),andaweakercorrelationwithdelaydiscounting(steepeffortdiscountersarealmostinvariablysteep/impatientdelaydiscounters).Thislatterobservationdovetailswithrecentstudiesofcognitiveeffectsindelaydiscounting

BehavioralAssessmentMethodsforRDoCConstructs

43

supportingthatpatientchoicebehaviorrequires(potentiallyeffortful)workingmemoryallocationduringdecision-making.Finally,ataneurallevel,recentobservations(inpreparationforpublication)includethatdimensionsofrewardamountandtaskloadarebothrobustlyencodedincanonicalsubjectivevalueencodingregionslikethevmPFCandposteriorcingulatecortex,asparticipantsevaluatecognitiveeffort-contingentrewards.Also,whileparticipantsareengagedwiththeN-backtask,steepereffortdiscountersshowgreaterrecruitmentinanumberoftask-positiveregionsincludingthefronto-parietal,salience,anddorsalattentionnetworks.

• Evidenceforreliability,ofanyform,includinginternalconsistency,test-retestreliability,etc.:Limitedevidence,butincludestheaforementionedinter-individualcorrelationsbetweenCOGEDandNeedforCognitionandnegativesymptoms.Correlationswiththesetraitdimensionssupportreliability.Inasmallsample(N=25participants),theICCoftheAreaUndertheDiscountingCurvemeasureofCOGED,acrossthreesessionsamonghealthyyoungadults,was0.47with95%CIof[0.23,0.69].TotheextentthatCOGEDcapturesbothtraitandstateeffects(e.g.fatigueorsleepdeprivation29,somevariabilityisexpected.

• Evidenceforotherrelevantpsychometriccharacteristicsaboutthetest,includingpracticeeffects,floororceilingeffects,etc.:Dependingonparadigmdesign,briefexposuretotheN-backtaskpriortodiscountingyieldsshallowerdiscountingthanprolongedexposurewhich,atthelimit,producesnodiscounting(individualsalwaysselectthemoredemandingoptionformoremoney),restrictinginter-individualvariability.

• Descriptionsofanyknownanimalhomologuesforthistest:ThenearestistheRatCognitiveEffortTask(RCET)ofCockerandcolleagues30.Therearemanyotherphysicaleffortparadigms(e.g.T-mazesforrats,orlevelpullsformonkeys),butthisistheonlyanimalcognitiveefforttask.

• Evidenceoftaskimprovementwithpsychologicalorpharmacologicaltreatment:Noneisavailabletodate.

c)AdditionalEffort-basedTasks

Thefollowingtasksweredeemedaspromisinginlightoftheirpotentialabilitytoprobeparticularsub-constructsbutrequiremoreworkandevaluation(oftenbecausetheyhavebeeninvestigatedinalimitednumberofstudies):

• PhysicalEffort:GripForceTask31,32• PhysicalEffort:BeautifulFacesTask33andrelatedtasks(e.g.,toproberestrictedinterestin

autism34):Tasksthatrequireefforttoexperienceareinforcer(e.g.,beautifulfaces)needtoberefinedtobetterindexeffort.

V.Tasksthatarenotrecommended1.RewardResponsiveness

BehavioralAssessmentMethodsforRDoCConstructs

44

1.1.InitialResponsetoReward

MonetaryIncentiveDelayTask2:TheMIDwasrecommendedforthesub-construct“RewardAnticipation”(seeSectionIII,Point1.2.)butnotforthesub-construct“InitialResponsivenesstoReward”duetopoorvalidityindissociatingpredictionerrorandoutcomevaluesignals.Specifically,formalmodelingexpectationofrewardoutcomeinthistaskischallenging,asitwillbeinfluencedbybothoutcomesofpriortrialsaswellasperformanceonthecurrenttrial(e.g.,dependingonRTtothetarget,participantshaveagoodexpectationoftheupcomingoutcome).Moreover,commonattemptstoworkaroundthislimitationbymodelingexpectationasjusttheaveragerewardrateresultinpredictionerrorvaluesthatareco-linearwithoutcomevalues.

CueReactivityTasks:Notconsideredbecausethesetaskslikelyengagerewardanticipationinsomeconditions,butinitialresponsivenesstorewardinothers.

1.2.RewardAnticipation

None.

1.3.RewardSatiation

DevaluationTasks:Poorconstructvalidityforthissub-construct—likelyamuchbettermeasureofhabit.

2.RewardLearning

2.1.Habit

KnotTyingandSerialResponseTasks:notdiscussedbecausetheymostlyprobeprocedurallearning;similarly,AttentionalBlindnessTaskswerenotconsideredbecausetheyassessattentionalbiasrelatedtoexpertise.

2.2.ProbabilisticandReinforcementLearning

DriftingBandit14:Excellentproperties;ithasbeenusedinstudiesinParkinsonanddopaminergicchallenges;itcanmeasureexploration/exploitationandallowstofitlearningrateandbias.Itwasnotdiscussedfurther,however,becauseDoubleBanditTasks(e.g.,Dawetal.2011)yieldthesameoutcomevariablesandallowonetoparsebothmodel-basedandmodel-freeparametersinthesametask,andarethusmoreefficient.

PavlovianInstrumentalTransferTasks35:interestingtaskbutitrequiresworkbeforewidedisseminationbecause~30%ofparticipantsareunabletolearnit).

2.3.RewardPredictionError

BehavioralAssessmentMethodsforRDoCConstructs

45

None.

3.RewardValuation

3.1.Reward(probability)

None.

3.2.Delay

None.

3.3.Effort

ProgressiveRatioTask36:Inspiteoftheirwidespreaduseintheliterature,ProgressiveRatioTaskswerenotconsideredbecausetheyconfoundeffort,timediscounting,rewardmagnitude(andsatiety).

VI.References1. BecharaA,DamasioH,TranelD,DamasioAR.DecidingAdvantageouslyBeforeKnowing

theAdvantageousStrategy.Science.1997;275(5304):1293-1295.doi:10.1126/science.275.5304.1293.

2. KnutsonB,WestdorpA,KaiserE,HommerD.FMRIVisualizationofBrainActivityduringaMonetaryIncentiveDelayTask.NeuroImage.2000;12(1):20-27.doi:10.1006/nimg.2000.0593.

3. DelgadoMR,NystromLE,FissellC,NollDC,FiezJA.TrackingtheHemodynamicResponsestoRewardandPunishmentintheStriatum.JournalofNeurophysiology.2000;84(6):3072-3077.doi:10.1016/0166-2236(90)90107-L.

4. CarlsonJM,FotiD,Mujica-ParodiLR,Harmon-JonesE,HajcakG.VentralstriatalandmedialprefrontalBOLDactivationiscorrelatedwithreward-relatedelectrocorticalactivity:AcombinedERPandfMRIstudy.NeuroImage.2011;57(4):1608-1616.doi:10.1016/j.neuroimage.2011.05.037.

5. ShermanJA,ThomasJR.SomeFactorsControllingPreferenceBetweenFixed-RatioandVariable-RatioSchedulesofReinforcement.JournaloftheExperimentalAnalysisofBehavior.1968;11(6):689–&.

6. GottfriedJA,O'DohertyJ,DolanRJ.EncodingPredictiveRewardValueinHumanAmygdalaandOrbitofrontalCortex.Science.2003;301(5636):1104-1107.doi:10.1126/science.1087919.

7. BalleineB,DickinsonA.Signallingandincentiveprocessesininstrumentalreinforcerdevaluation.TheQuarterlyJournalofExperimentalPsychology.May2007.doi:10.1080/14640749208401007.

8. McKimTH,BauerDJ,BoettigerCA.Addictionhistoryassociateswiththepropensitytoformhabits.JournalofCognitiveNeuroscience.2016;28(7):1024-1038.

BehavioralAssessmentMethodsforRDoCConstructs

46

doi:10.1162/jocn_a_00953.9. TricomiE,BalleineBW,O'DohertyJP.Aspecificroleforposteriordorsolateralstriatumin

humanhabitlearning.EuropeanJournalofNeuroscience.2009;29(11):2225-2232.doi:10.1111/j.1460-9568.2009.06796.x.

10. PizzagalliDA,JahnAL,O’SheaJP.Towardanobjectivecharacterizationofananhedonicphenotype:Asignal-detectionapproach.BiologicalPsychiatry.2005;57(4):319-327.doi:10.1016/j.biopsych.2004.11.026.

11. O'DohertyJ,DayanP,SchultzJ,DeichmannR,FristonK,DolanRJ.DissociableRolesofVentralandDorsalStriatuminInstrumentalConditioning.Science.2004;304(5669):452-454.doi:10.1126/science.1094285.

12. FrankMJ,SeebergerLC,O'ReillyRC.ByCarrotorbyStick:CognitiveReinforcementLearninginParkinsonism.Science.2004;306(5703):1940-1943.doi:10.1126/science.1102941.

13. DawND,GershmanSJ,SeymourB,DayanP,DolanRJ.Model-BasedInfluencesonHumans'ChoicesandStriatalPredictionErrors.Neuron.2011;69(6):1204-1215.doi:10.1016/j.neuron.2011.02.027.

14. RutledgeRB,DeanM,CaplinA,GlimcherPW.Testingtherewardpredictionerrorhypothesiswithanaxiomaticmodel.JournalofNeuroscience.2010;30(40):13525-13536.doi:10.1523/JNEUROSCI.1747-10.2010.

15. LevyI,SnellJ,NelsonAJ,RustichiniA,GlimcherPW.NeuralRepresentationofSubjectiveValueUnderRiskandAmbiguity.JournalofNeurophysiology.2010;103(2):1036-1047.doi:10.1152/jn.00853.2009.

16. HoltCA,LaurySK.Riskaversionandincentiveeffects.Americaneconomicreview.2002.17. BeckerGM,DegrootMH,MarschakJ.Stochasticmodelsofchoicebehavior.Behavioral

Science.1963;8(1):41-55.doi:10.1002/bs.3830080106.18. LouieK,KhawMW,GlimcherPW.Normalizationisageneralneuralmechanismfor

context-dependentdecisionmaking.PNAS.2013;110(15):6139-6144.doi:10.1073/pnas.1217854110.

19. KableJW,GlimcherPW.Theneuralcorrelatesofsubjectivevalueduringintertemporalchoice.Natureneuroscience.2007;10(12):1625-1633.doi:10.1038/nn2007.

20. BickelWK,MarschLA.Towardabehavioraleconomicunderstandingofdrugdependence:delaydiscountingprocesses.Addiction.2001;96(1):73-86.doi:10.1046/j.1360-0443.2001.961736.x.

21. JohnsonMW,BickelWK.WITHIN-SUBJECTCOMPARISONOFREALANDHYPOTHETICALMONEYREWARDSINDELAYDISCOUNTING.JournaloftheExperimentalAnalysisofBehavior.2002;77(2):129-146.doi:10.1901/jeab.2002.77-129.

22. GreenL,MyersonJ.ADiscountingFrameworkforChoiceWithDelayedandProbabilisticRewards.PsychologicalBulletin.2004;130(5):769.doi:10.1037/0033-2909.130.5.769.

23. TreadwayMT,BuckholtzJW,SchwartzmanAN,LambertWE,ZaldDH.Worththe“EEfRT?”Theeffortexpenditureforrewardstaskasanobjectivemeasureofmotivationandanhedonia.PLOSONE.2009;4(8):e6598.doi:10.1371/journal.pone.0006598.

24. ReddyLF,HoranWP,BarchDM,etal.Effort-BasedDecision-MakingParadigmsforClinicalTrialsinSchizophrenia:Part1—PsychometricCharacteristicsof5Paradigms.SchizophrBull.2015;41(5):sbv089-sbv1054.doi:10.1093/schbul/sbv089.

BehavioralAssessmentMethodsforRDoCConstructs

47

25. KoolW,McGuireJT,RosenZB,BotvinickMM.Decisionmakingandtheavoidanceofcognitivedemand.JournalofExperimentalPsychology:General.2010;139(4):665.doi:10.1037/a0020198.

26. YoungJW,MarkouA.TranslationalRodentParadigmstoInvestigateNeuromechanismsUnderlyingBehaviorsRelevanttoAmotivationandAlteredRewardProcessinginSchizophrenia.SchizophrBull.2015;41(5):1024-1034.doi:10.1093/schbul/sbv093.

27. WestbrookA,KesterD,BraverTS.WhatIstheSubjectiveCostofCognitiveEffort?Load,Trait,andAgingEffectsRevealedbyEconomicPreference.PLOSONE.2013;8(7):e68210.doi:10.1371/journal.pone.0068210.

28. CulbrethA,WestbrookA,BarchD.Negativesymptomsareassociatedwithanincreasedsubjectivecostofcognitiveeffort.JournalofAbnormalPsychology.2016;125(4):528.doi:10.1037/abn0000153.

29. LibedinskyC,MassarS,LingA,CheeW,HuettelSA.Sleepdeprivationalterseffortdiscountingbutnotdelaydiscountingofmonetaryrewards.Sleep.2013.

30. CockerPJ,HoskingJG,BenoitJ,WinstanleyCA.SensitivitytoCognitiveEffortMediatesPsychostimulantEffectsonaNovelRodentCost|[sol]|BenefitDecision-MakingTask.Neuropsychopharmacology.2012;37(8):1825-1837.doi:10.1038/npp.2012.30.

31. Cléry-MelinM-L,SchmidtL,LafargueG,BaupN,FossatiP,PessiglioneM.WhyDon'tYouTryHarder?AnInvestigationofEffortProductioninMajorDepression.PLOSONE.2011;6(8):e23178.doi:10.1371/journal.pone.0023178.

32. SchmidtL,LebretonM,Cléry-MelinM-L,DaunizeauJ,PessiglioneM.Neuralmechanismsunderlyingmotivationofmentalversusphysicaleffort.PLoSBiology.2012;10(2):e1001266.doi:10.1371/journal.pbio.1001266.

33. AharonI,EtcoffN,ArielyD,ChabrisCF,O'ConnorE,BreiterHC.BeautifulFacesHaveVariableRewardValue.Neuron.2001;32(3):537-551.doi:10.1016/S0896-6273(01)00491-3.

34. CascioCJ,FossFeigJH,HeacockJ,etal.Affectiveneuralresponsetorestrictedinterestsinautismspectrumdisorders.JournalofChildPsychologyandPsychiatry.2014;55(2):162-171.doi:10.1111/jcpp.12147.

35. CorbitLH,BalleineBW.DoubleDissociationofBasolateralandCentralAmygdalaLesionsontheGeneralandOutcome-SpecificFormsofPavlovian-InstrumentalTransfer.JNeurosci.2005;25(4):962-970.doi:10.1523/JNEUROSCI.4507-04.2005.

36. HodosW,KalmanG.EFFECTSOFINCREMENTSIZEANDREINFORCERVOLUMEONPROGRESSIVERATIOPERFORMANCE.JournaloftheExperimentalAnalysisofBehavior.1963;6(3):387-392.doi:10.1901/jeab.1963.6-387.

BehavioralAssessmentMethodsforRDoCConstructs

48

Appendix1:Ratingsoftasksrecommendedforconsideration.

DOMAIN:POSITIVEVALENCESYSTEMS

Criteria(Rateeachonascaleof1-5,with1=doesnotdoagoodjobofmeetingthecriterion;5=doesanexcellentjobmeetingthecriterion

Construct Task

ValidM

easureof

Construct

Test-Retest

Reliability

Floo

r/Ce

iling

PracticeEffects

Longitud

inal

Stab

ility

Sensitivetow/in

person

cha

nge

Stan

dardized

Parameters

Canitbeused

acrosssites?

Canitbeused

with

kidsorspecial

popu

lation

s?

Arenormativeda

ta

available?

Arerelationsto

clinicalfe

atures

know

n?

Notcop

yrighted

?

1.RewardResponsiveness

1.1.InitialResponsetoReward

SimpleGuessingTask(e.g.50%CardTask)

57 3 5 5 4 5 3 5 48 1 4 5

7Butnobehavioraloutcomeavailable.Itwouldrequiretheadditionofself-reportorpsychophysiologicalassessments.8Withchildrenthan7yearsold

BehavioralAssessmentMethodsforRDoCConstructs

49

1.2.RewardAnticipation

MonetaryIncentiveDelayTask 19,210

211 5 4 1(u)12

5 3 5 5 5 4 5

1.3RewardSatiation

Fixed-ratioSatiationSchedule 5 1 4 5 1 1 1 4 4 1 1 5

2.RewardLearning

2.1.Habit DevaluationTask

HabitTask

HabitLearningTask

5 1(u)f 4 3 1(u)f 1(u)f 1 4 313 1 1 5

2.2.ProbabilisticandReinforcementLearning

a)ProbabilisticRewardTask

b)PavlovianConditioning

c)Driftingdoublebandit

d)ProbabilisticStimulusSelectionTask

5

5a

5

5

3

1(u)f

1(u)f

1(u)f

5

4

5

3

5

3

5

5

4

1(u)f

1(u)f

1(u)f

5

3

2

4

4

3

4

4

5

5

5

3

4b

5

4

3

4

1

1

1

4

3

1

4

414

5

5

5

2.3.RewardPredictionError

a)RutledgePassiveLotteryTask

b)DriftingDoubleBandit(seeabove)

5

5

1(u)f1(u)f

3

5

4

5

1(u)f1(u)f

1(u)f

2

3

4

2

5

3

4

1

1

1

1

5

5

9Forbehavioraloutcome10Forneuraloutcome11GoodbutlowN12Unknown13Children,OCD,autism14Freelyavailableforresearchers/non-profits;usebyindustryrequireslicensing

BehavioralAssessmentMethodsforRDoCConstructs

50

3.RewardValuation

3.1.Reward(probability)

ProbabilityChoiceTask

WillingnessToPayTask

5

5

1(u)f1(u)f

3

3

4

3

1(u)f1(u)f

1(u)f

1(u)f

3

3

2

3

3

3

1

1

1

1

5

5

3.2.Delay DelayedDiscountingTask

3.3.Effort EffortExpenditureforRewardTask 415 3 5 4 4 5 3 5 4 2 4 4h

15Itmanipulateseffortsandtimelineatthesametime,thusnotapuremeasureofeffort.Modificationscouldbeapplied.

BehavioralAssessmentMethodsforRDoCConstructs

51

AppendixPVS-IIa:DetailedEvaluationCriteriaforSimpleGuessingTask

PVSConstruct:RewardResponsiveness

PVSSub-construct:InitialResponsetoReward

A)Card-GuessingTask(e.g.,Delgadoetal.)

1. Howvalidatestoftheconstructisthetask?

Thecardguessingtaskwasdevelopedtoidentifyneuralcircuitsinvolvedinrewardprocessing.Morespecifically,thetaskallowsforthecomparisonofbrainresponsestopositiveoutcomes(e.g.,receivingamonetaryreward)comparedtoneutralornegativeoutcomes(e.g.,monetaryloss).Theoriginalversionofthetask[1]doesnotrequirelearningormuchpracticeandmerelyinvolves“guessing”decisionswhetherthenumberofacardishigherorlowerthan5(ata50%probability),withguessesresultinginpositive(acorrectresponse),neutralornegative(anincorrectresponse)outcomes,thuscontrollingforchangesinresponsestorewardasafunctionoflearningorexpectations.Priorstudieshaveshownthat:(1) Acrossseveralparadigms,acomparisonofpositiveandnegativeoutcomesyields

activationinreward-relatedregions,primarilydorsalandventralstriatum(forreviewsee[2]).Thiscanbeobservedinbothevent-relatedandblockeddesigns.

(2) Thisreward-relatedresponseiscontext-dependentandcanbemodulatedbyfactorssuchasmagnitude[3],probability[4]andthetypeofrewardutilized,fromnon-monetarypositivefeedback[5,6]tosymbolicstimulirepresentingfood[7].

(3) Thisreward-relatedresponseisbluntedbyexposuretoacutestress[8]ordeprivationofnicotine[9].

(4) Thisreward-relatedresponsecharacterizedbythecard-guessingtaskhasbeenfoundtobealteredinapopulationofpatientsrecoveredfromanorexianervosa[10]andbulimianervosa[11]aswellasadolescentswithAnorexiaNervosa[12].

(5) Thisreward-relatedresponsecharacterizedbythecard-guessingtaskhasalsobeenfoundtobealteredinapopulationofadolescentswithmajordepressivedisorder[13,14],withsuchalterationsbeingpredictiveofdepressivesymptomsinpubertaladolescents[15]orrelatedtochallengingsocialexperiencesinearlyadolescence(suchaspeervictimization;[16]).

(6) Reward-relatedresponsescharacterizedbythecard-guessingtaskaresusceptibletothesocialcontextinwhichtheyarereceived,beingalteredbasedontheperception

BehavioralAssessmentMethodsforRDoCConstructs

52

ofacooperativeorcompetitivescenario[17,18]orasafunctionofwhethertheinteractioniswithapersonorcomputer[19,20].

(7) Childhoodmeasuresofstress[21]andemotionalneglect[22]correlatewithblunted-rewardsensitivityasmeasuredbyneuralresponsestorewardingoutcomesinthecard-guessingtask.

(8) Themagnitudeofthisreward-relatedresponsecorrelateswithpreferencesforimmediateoverdelayedrewards[23]andriskychoicesinsomecontexts[19],aswellasanunwillingnesstoresistcigarettesmoking[24].

(9) Sustainedactivityinreward-relatedregionsduringthisparadigminthelaboratorycorrelateswithrealworldpositiveemotionalresponsesincontrolparticipants[25]andpositiveaffectinadolescentmajordepressivedisorder[14].

(10) Thecard-guessingtaskcanyieldresultsinlong[1]orshort(localizer;[26])versionsandcanbemodifiedtoalsolookatanticipationofrewardorchangesasafunctionoflearningorotherfactors(e.g.,socialcontext[18]).

2. Doesthetaskhavegoodpsychometriccharacteristics(incl.highinternalreliability,test-

retestreliability,sensitivity/specificity,limitedpracticeeffects,availabilityofalternate

forms,longitudinalstability)?

i. highinternalreliability:Notevaluatedii. test-retestreliability:Notevaluatediii. Sensitivity/specificity:Notevaluatediv. Limitedpracticeeffects:Inoriginalversion,therearenoknownpracticeeffects.v. Availabilityofalternateforms:Yes,thereisahighdegreeofflexibilitywiththis

paradigmandithasbeenadaptedfordifferentquestions,ortimingconstraintsorforspecificpopulations.

vi. Longitudinalstability:Notevaluated

3. Areparametersforadministeringthetask(e.g.,numberoftrials,stimuluscharacteristics,

etc.)standardizedonanempiricalbasis?

i. Therearenoformalempiricalparametersasbehavioralmeasuresbeyondreactiontimeandsubjectivemeasuresthatserveasmanipulationchecksarenotincludedoroptimalforanalysis.Therearepublishedminimumamountoftrialsinvariousadaptationsthathavebeeneffective.

4. Isthetaskfreefromfloor/ceilingeffectswhichwouldprecludeuseinsubjectswitha

rangeofimpairment?

i. Yes

BehavioralAssessmentMethodsforRDoCConstructs

53

5. Doesthetaskhavethesameperformancecharacteristicsacrosscultures?Isitfreefrom

culture-andlanguage-specificfeatures/stimuli?

i. Thetaskshouldbefreefromcultureandlanguage-specificfeaturesbeyondchangingthecurrency.

ii. Oneexample:thetaskhasbeenruninGermanywithadultADHDparticipantstosimilarresults(Wilbertzetal.,2012).

6. Isthetasksensitivetochangeandlackandlossoffunction?

i. Yes,asevidencedfromitsuseindiversepatientpopulationspreviouslydescribed.

7. Canthetask(oritsanalog)beusedinanimals?

i. Yes,althoughtherearenoclearparalleltasksatthistime.

8. Canthetaskbeusedacrossagegroups?

i. Yes,thetaskhasbeenusedwithchildren,adolescentsandolderadults.

9. Canthetaskbeusedwithmethodstointerrogatebraincircuitry(e.g.,fMRI,EEG,etc.)?

i. Theprimarygoalofthistaskistoobservereward-relatedactivation.Assuch,itisusedprimarilywithneuroimagingmethodssuchasfMRI.

10. Isthereconsensusonwhichmetric/scoreshouldbeconsideredtobeprimary?

i. Thetaskservesprimarilyasameasureofneuralactivityofrewardresponses.Thus,theprimarymeasureisameasureofBOLDsignalsinreward-relatedregions.

11. Areadequatenormativedataavailableacrossage,gender,education,ethnicity,SES?

i. Thedataareavailableacrossmultipleparadigmsbuthavenotbeenaggregated.

12. Aretherelationshipsbetweentaskperformanceandneuralsignal(s)known?

i. Yes(sepoint#1)

13. Aretherelationshipsbetweentaskperformanceandclinicalfeature(s)known?

i. Yesforsomeclinicalfeatures(seepoint#1)

14. Isthetaskfeasibleforadministrationacrosssites?

i. Yes

15. Canthetaskbeusedasastand-alonebehavioraltask?i. No

BehavioralAssessmentMethodsforRDoCConstructs

54

16. Whatworkisneededtogetthistaskreadyforuseinclinicaltrials?

i. Selectionofoneversionoftheparadigmthatcanbestandardized(e.g.,basedonamountoftrialsandoptimaltiming).

17. Isthetaskcopyrighted?i. No

References

1. Delgado,M.R.,etal.,Trackingthehemodynamicresponsestorewardandpunishmentin

thestriatum.JNeurophysiol,2000.84(6):p.3072-7.2. Delgado,M.R.,Reward-relatedresponsesinthehumanstriatum.AnnNYAcadSci,

2007.1104:p.70-88.3. Delgado,M.R.,etal.,Dorsalstriatumresponsestorewardandpunishment:effectsof

valenceandmagnitudemanipulations.CognAffectBehavNeurosci,2003.3(1):p.27-38.4. Delgado,M.R.,etal.,AnfMRIstudyofreward-relatedprobabilitylearning.Neuroimage,

2005.24(3):p.862-73.5. Delgado,M.R.,V.A.Stenger,andJ.A.Fiez,Motivation-dependentresponsesinthe

humancaudatenucleus.CerebCortex,2004.14(9):p.1022-30.6. Tricomi,E.,etal.,Performancefeedbackdrivescaudateactivationinaphonological

learningtask.JCognNeurosci,2006.18(6):p.1029-43.7. Luking,K.R.andD.M.Barch,Candyandthebrain:neuralresponsetocandygainsand

losses.CognAffectBehavNeurosci,2013.13(3):p.437-51.8. Porcelli,A.J.,A.H.Lewis,andM.R.Delgado,Acutestressinfluencesneuralcircuitsof

rewardprocessing.FrontNeurosci,2012.6:p.157.9. Wilson,S.J.,etal.,Effectofsmokingopportunityonresponsestomonetarygainandloss

inthecaudatenucleus.JAbnormPsychol,2008.117(2):p.428-34.10. Wagner,A.,etal.,Alteredrewardprocessinginwomenrecoveredfromanorexia

nervosa.AmJPsychiatry,2007.164(12):p.1842-9.11. Wagner,A.,etal.,Alteredstriatalresponsetorewardinbulimianervosaafterrecovery.

IntJEatDisord,2010.43(4):p.289-94.12. Bischoff-Grethe,A.,etal.,Alteredbrainresponsetorewardandpunishmentin

adolescentswithAnorexianervosa.PsychiatryRes,2013.214(3):p.331-40.13. Forbes,E.E.,fMRIstudiesofrewardprocessinginadolescentdepression.

Neuropsychopharmacology,2011.36(1):p.372-3.14. Forbes,E.E.,etal.,Alteredstriatalactivationpredictingreal-worldpositiveaffectin

adolescentmajordepressivedisorder.AmJPsychiatry,2009.166(1):p.64-73.15. Morgan,J.K.,etal.,Neuralresponsetorewardasapredictorofincreasesindepressive

symptomsinadolescence.NeurobiolDis,2013.52:p.66-74.

BehavioralAssessmentMethodsforRDoCConstructs

55

16. Casement,M.D.,etal.,Girls'challengingsocialexperiencesinearlyadolescencepredictneuralresponsetorewardsanddepressivesymptoms.DevCognNeurosci,2014.8:p.18-27.

17. Fareri,D.S.andM.R.Delgado,Differentialrewardresponsesduringcompetitionagainst

in-andout-of-networkothers.SocCognAffectNeurosci,2014.9(4):p.412-20.18. Fareri,D.S.,etal.,Socialnetworkmodulationofreward-relatedsignals.JNeurosci,2012.

32(26):p.9045-52.19. Delgado,M.R.,etal.,Understandingoverbidding:usingtheneuralcircuitryofrewardto

designeconomicauctions.Science,2008.321(5897):p.1849-52.20. Fareri,D.S.,L.J.Chang,andM.R.Delgado,Computationalsubstratesofsocialvaluein

interpersonalcollaboration.JNeurosci,2015.35(21):p.8170-80.21. Hanson,J.L.,etal.,Cumulativestressinchildhoodisassociatedwithbluntedreward-

relatedbrainactivityinadulthood.SocCognAffectNeurosci,2016.11(3):p.405-12.22. Hanson,J.L.,A.R.Hariri,andD.E.Williamson,BluntedVentralStriatumDevelopmentin

AdolescenceReflectsEmotionalNeglectandPredictsDepressiveSymptoms.BiolPsychiatry,2015.78(9):p.598-605.

23. Hariri,A.R.,etal.,Preferenceforimmediateoverdelayedrewardsisassociatedwith

magnitudeofventralstriatalactivity.JNeurosci,2006.26(51):p.13213-7.24. Wilson,S.J.,etal.,Weakventralstriatalresponsestomonetaryoutcomespredictan

unwillingnesstoresistcigarettesmoking.CognAffectBehavNeurosci,2014.14(4):p.1196-207.

25. Heller,A.S.,etal.,TheNeurodynamicsofAffectintheLaboratoryPredictsPersistenceof

Real-WorldEmotionalResponses.JNeurosci,2015.35(29):p.10503-9.26. Speer,M.E.,J.P.Bhanji,andM.R.Delgado,Savoringthepast:positivememoriesevoke

valuerepresentationsinthestriatum.Neuron,2014.84(4):p.847-56.

BehavioralAssessmentMethodsforRDoCConstructs

56

B.DoorsTask(e.g.,Hajcaketal.)

1. Howvalidatestoftheconstructisthetask?

TheDoorsTaskissimplegamblingtaskthatisintendedtoelicitphysiologicalresponsestoreceivingrewardandloss.Oneachtrial,participantsviewtwodoorsandaretoldthatonedoorleadstomonetaryrewardandoneleadtomonetaryloss;participantsselectadoorbyclickingtheleftorrightmousebutton,andsubsequentlyreceivefeedbackindicatingeitherawin($.50)oraloss($.25).Thetaskincludes60trials,andfeedbackisexactlyequiprobable(i.e.,30gainsand30losses,presentedinarandomorder).

Thistask,andfunctionallyidenticalvariantsliketheballoontaskorcardsguessingtask,wasdesignedtoexaminephysiologicalresponses(i.e.,EEG,fMRI)tofavorable(i.e.,winningmoney)versusunfavorable(i.e.,losingmoney)feedback.ThestudiesbelowfocusonERPresponsetorewardandstriatalresponsetoreward—thoughotherregionsofinteresthavebeenexaminedinrelationtoindividualdifferences.Priorstudieshaveshownthatneuralresponsetorewardis:

(1) RelatedacrossbothERPandfMRImethods1,5,11.(2) Relatedtobehavioralmeasuresofrewardsensitivityandself-reportedsensitivityto

reward2.andreal-worldpositiveaffectiveexperience8.(3)Bluntedinrelationtoincreaseddepressivesymptomsinbothchildrenandadults2,4,9.

(4)BluntedamongindividualswithMDD,especiallyinrelationtoanhedonicsymptoms7,9,14.OnerecentstudyfoundreducedrewardresponseamongremittedmelancholicMDDindividuals20.

(5)Reducedamongindividualsathighriskfordepression12,21,andreducedreward-relatedbrainactivitypredictsincreasesindepressivesymptoms2,4,16andnew-onsetdepressionprospectively2,16.

(6)Abnormalamongindividualswithaddiction17,especiallyinrelationtoanhedonicsymptomsandpredictedrewards.

(7)IslinkedtogenesthatregulateDA10.(7)Correlatedamongfirst-degreerelatives(r=0.31)21.(8)Thatisbluntedindepressionmayimprovewiththerapy6.

2. Doesthetaskhavegoodpsychometriccharacteristics(incl.highinternalreliability,test-

retestreliability,sensitivity/specificity,limitedpracticeeffects,availabilityofalternate

forms,longitudinalstability)?

BehavioralAssessmentMethodsforRDoCConstructs

57

i. highinternalreliability:highinternalreliabilityforbothstriatumresponsetoreward(r=0.66)15andERPresponsetoreward(r=0.8515;r=0.903;r=0.8913).

ii. test-retestreliability:usingfMRI–moderate(ICCs=0.55–0.62)18;usingERP,moderate-to-high(r=0.673;r=0.7113)

iii. Sensitivity/specificity:ROCanalysesnotperformedyet(butdataareavailable)iv. Limitedpracticeeffects:taskcanbedonemanytimes.v. Availabilityofalternateforms:Yes,doorstaskisfunctionallyidenticaltocardguessing

andsimilartaskswhereprobabilityofrewardis50%oneachtrial7,8.

3. Areparametersforadministeringthetask(e.g.,numberoftrials,stimuluscharacteristics,

etc.)standardizedonanempiricalbasis?

i. Taskstimuliwereoptimizedtobesimpleandcanbeusedwithalargeagerange(aslowas4yearsinongoingwork);althoughthetaskproducesinternallyreliablereward-relatedneuralmeasureswith40-60trials,itappearsthathalfasmanytrialsmayberequired15—thoughwhethertasklengthimpactsrelationshipswithindividualdifferencesisunknown.

4. Isthetaskfreefromfloor/ceilingeffectswhichwouldprecludeuseinsubjectswitha

rangeofimpairment?

i. Yes;taskhasbeenusedwithchildrenandotherspecialpopulations.

5. Doesthetaskhavethesameperformancecharacteristicsacrosscultures?Isitfreefrom

culture-andlanguage-specificfeatures/stimuli?

i. InadditiontotheU.S.,thetaskhasbeenusedinAsiansamples,wherereward-relatedneuralactivityhasalsobeenrelatedtodepressionandanhedonia14.

ii. Thereisnoapriorireasontobelievethatitwouldperforminaculturally-specificway.

6. Isthetasksensitivetochangeandlackandlossoffunction?

i. Yes,asevidencedbyfindingsinpatientsamples(seeabove).

7. Canthetask(oritsanalog)beusedinanimals?

i. Intheory,yes;thoughananimalversionhasnotbeencreated.

8. Canthetaskbeusedacrossagegroups?

i. Yes,publisheddatain9year-olds12;ongoingworkin3-6yearolds.

9. Canthetaskbeusedwithmethodstointerrogatebraincircuitry(e.g.,fMRI,EEG,etc.)?

BehavioralAssessmentMethodsforRDoCConstructs

58

i. Yes;thetaskhasbeenusedtoexaminereward-relatedbrainactivityusingbothEEGandfMRI.

10. Isthereconsensusonwhichmetric/scoreshouldbeconsideredtobeprimary?

i. RewardPositivity(inERP),orthedifferencebetweenrewardandnon-reward(i.e.,averageactivityfrom250-350msfollowingfeedbackatFCz;thisappearslateramongyoungersubjects)

ii. Reward-circuitactivationusingfMRI(i.e.,striatalresponse,medialprefrontalcortexresponse)

11. Areadequatenormativedataavailableacrossage,gender,education,ethnicity,SES?

i. Thetaskhasbeenadministeredtomorethan1,000individuals.Age-andgender-relatednormsarenotavailable,butcouldbecreated.

12. Aretherelationshipsbetweentaskperformanceandneuralsignal(s)known?

i. Thetaskassessesinitialresponsivenesstoreward,operationalizedintermsofneuralresponse.Behaviorally,itispossibletoexaminewin-stay/lose-shiftstrategies,thoughthesedatahaverelatedinconsistentlytoneuralresponsetorewards.

13. Aretherelationshipsbetweentaskperformanceandclinicalfeature(s)known?

i. Neuralresponsetorewardonthedoorstaskhasbeenrelatedtodepressionandrelatedconstructs—bothcross-sectionallyandprospectively.

14. Isthetaskfeasibleforadministrationacrosssites?

i. Yes;itiscurrentlybeingusedatmanyresearchsites.

15. Canthetaskbeusedasastand-alonebehavioraltask?i. No

16. Whatworkisneededtogetthistaskreadyforuseinclinicaltrials?

i. Examineimpactofpharmacologicalchallengeii. Animalmodeloftaskiii. Examinewhethermeasuresaresensitivetotreatmentresponse

17. Isthetaskcopyrighted?

i. No.

References

BehavioralAssessmentMethodsforRDoCConstructs

59

1. Becker,M.P.,Nitsch,A.M.,Miltner,W.H.,&Straube,T.(2014).Asingle-trialestimationofthefeedback-relatednegativityanditsrelationtoBOLDresponsesinatime-estimationtask.TheJournalofNeuroscience,34(8),3005-3012.

2. Bress,J.N.,&Hajcak,G.(2013).Self-reportandbehavioralmeasuresofrewardsensitivitypredictthefeedbacknegativity.Psychophysiology,50(7),610–616.

3. Bress,J.N.,Meyer,A.,&Proudfit,G.H.(2015).Thestabilityofthefeedbacknegativityanditsrelationshipwithdepressionduringchildhoodandadolescence.Development

andPsychopathology,27(4pt1),1285–12944. Bress,J.N.,Smith,E.,Foti,D.,Klein,D.N.,&Hajcak,G.(2012).Neuralresponseto

rewardanddepressivesymptomsinlatechildhoodtoearlyadolescence.BiologicalPsychology,89(1),156–162.

5. Carlson,J.M.,Foti,D.,Mujica-Parodi,L.R.,Harmon-Jones,E.,&Hajcak,G.(2011).VentralstriatalandmedialprefrontalBOLDactivationiscorrelatedwithreward-relatedelectrocorticalactivity:acombinedERPandfMRIstudy.Neuroimage,57(4),1608-1616.

6. Dichter,G.S.,Felder,J.N.,Petty,C.,Bizzell,J.,Ernst,M.,&Smoski,M.J.(2009).TheEffectsofPsychotherapyonNeuralResponsestoRewardsinMajorDepression.BiologicalPsychiatry,66(9),886–897.

7. Forbes,E.E.,Hariri,A.R.,Martin,S.L.,Silk,J.S.,Moyles,D.L.,Fisher,P.M.,…Dahl,R.E.(2009).AlteredStriatalActivationPredictingReal-WorldPositiveAffectinAdolescentMajorDepressiveDisorder.AmericanJournalofPsychiatry,166(1),64–73.

8. Forbes,E.E.,Ryan,N.D.,Phillips,M.L.,Manuck,S.B.,Worthman,C.M.,Moyles,D.L.,Dahl,R.E.(2010).HealthyAdolescents’NeuralResponsetoReward:AssociationsWithPuberty,PositiveAffect,andDepressiveSymptoms.JournaloftheAmericanAcademyof

Child&AdolescentPsychiatry,49(2),162–172.9. Foti,D.,&Hajcak,G.(2009).Depressionandreducedsensitivitytonon-rewardsversus

rewards:Evidencefromevent-relatedpotentials.BiologicalPsychology,81(1),1–8.10. Foti,D.,&Hajcak,G.(2012).Geneticvariationindopaminemoderatesneuralresponse

duringrewardanticipationanddelivery:Evidencefromevent-relatedpotentials.Psychophysiology,49(5),617–626.

11. Foti,D.,Weinberg,A.,Bernat,E.M.,&Proudfit,G.H.(2015).Anteriorcingulateactivitytomonetarylossandbasalgangliaactivitytomonetarygainuniquelycontributetothefeedbacknegativity.ClinicalNeurophysiology,126(7),1338-1347.

12. Kujawa,A.,Proudfit,G.H.,&Klein,D.N.(2014).Neuralreactivitytorewardsandlossesinoffspringofmothersandfatherswithhistoriesofdepressiveandanxietydisorders.JournalofAbnormalPsychology,123(2),287–297.

13. Levinson,A.R.,Speed,B.C.,&Hajcak,G.(2016).ReliabilityoftheelectrocorticalresponsetogainsandlossesintheDoorstask.UnderReview.

14. Liu,W.,Wang,L.,Shang,H.,Shen,Y.,Li,Z.,Cheung,E.F.C.,&Chan,R.C.K.(2014).Theinfluenceofanhedoniaonfeedbacknegativityinmajordepressivedisorder.Neuropsychologia,53,213–220.

15. Luking,K.R.,Nelson,B.D.,Infantolino,Z.P.,Sauder,C.L.,&Hajcak,G.(underreview).InternalreliabilityoffMRIandEEGMeasuresofRewardinLateChildhoodandEarlyAdolescence.

BehavioralAssessmentMethodsforRDoCConstructs

60

16. Nelson,B.D.,Perlman,G.,Klein,D.N.,Kotov,R.,&Hajcak,G.(inpress).BluntedNeuralResponsetoRewardsProspectivelyPredictstheDevelopmentofDepressioninAdolescentGirls.AmericanJournalofPsychiatry.

17. Parvaz,M.A.,Gabbay,V.,Malaker,P.,&Goldstein,R.Z.(2016).Objectiveandspecifictrackingofanhedoniaviaevent-relatedpotentialsinindividualswithcocaineusedisorders.DrugandAlcoholDependence.doi:10.1016/j.drugalcdep.2016.05.004

18. Plichta,M.M.,Schwarz,A.J.,Grimm,O.,Morgen,K.,Mier,D.,Haddad,L.,Meyer-Lindenberg,A.(2012).Test–retestreliabilityofevokedBOLDsignalsfromacognitive–emotivefMRItestbattery.NeuroImage,60(3),1746–1758.

19. Speed,B.C.,Nelson,B.D.,Auerbach,R.P.,Klein,D.N.,&Hajcak,G.(2016).DepressionRiskandElectrocorticalReactivityDuringSelf-ReferentialEmotionalProcessingin8to14Year-OldGirls.JournalofAbnormalPsychology.doi:10.1037/abn0000173

20. Weinberg,A.,&Shankman,S.A.(2016).BluntedRewardProcessinginRemittedMelancholicDepression.ClinicalPsychologicalScience.doi:10.1177/2167702616633158

21. Weinberg,A.,Liu,H.,Hajcak,G.,&Shankman,S.A.(2015).Bluntedneuralresponsetorewardsasavulnerabilityfactorfordepression:Resultsfromafamilystudy.JournalofAbnormalPsychology,124(4),878–889

BehavioralAssessmentMethodsforRDoCConstructs

61

AppendixPVS-IIb:DetailedEvaluationCriteriaforMonetaryIncentiveDelayTask

PVSConstruct:RewardResponsiveness

PVSSub-construct:RewardAnticipation

1. Howvalidatestoftheconstructisthetask?Ok.

i.TheMIDtaskelicitsrobustandreliablebrainactivity(seebelow)duringanticipationofmonetarygainsinthenucleusaccumbens(NAcc)(3);duringanticipationofmonetarylossesintheanteriorinsula,andlessrobustbutstillreliableactivityinresponsetogainoutcomesinthemedialprefrontalcortex(MPFC)andputamen-possiblyduetosplittrials)(5).

ii.NAccactivityduringanticipationoflargegainsoftencorrelateswithcueelicitedpositivearousal(7).

iii.NAccactivityduringanticipationoflargegainsalsocorrelatesselectivelywithindividualdifferencesinpositivearousedtraits(r’s~.3)(4).

iv.NAccactivityduringanticipationoflargegainscorrelateswithnegativesymptomsacrossseveralstudiesofpatientswithschizophrenia(r’s~.5),butnotasrobustlywithsymptomsrelatedtoaffectivedisorders(10).

2. Doesthetaskhavegoodpsychometriccharacteristics(incl.highinternalreliability,test-

retestreliability,sensitivity/specificity,limitedpracticeeffects,availabilityofalternate

forms,longitudinalstability)?Yes.i.Internalreliability:Split–halfreliabilityofneuralactivityduringthefirsttestingsessionindicatedthatrightNAccactivityduringanticipationoflargegains(ICC=0.56/0.71,p<.05)wasmoderate(4)(unpublishedsupplement).

ii.Test-retestreliability:Test-retestreliabilityofneuralactivityovera>2yearperiodindicatedthatpeakrightNAccactivityduringanticipationoflargegains(ICC=0.64/0.78)andrightAInsactivityduringanticipationoflargelosses(ICC=.47/.64)wasmoderatetostrong(4)(otherconditionsshowedlesssignificanceandpeaksshowedbetterreliabilitythanfittedcontrasts).Similarly,otherneuroimagingstudiesusingcomparablerewardtasksdemonstratedgoodreliabilityiftheyusedlarge(6)butnotsmall(8)incentives.

iii.Measureswiththegreatesttest-retestreliabilitywerealsothemostcorrelatedwithaffectivetraits(r~.3),whilesignaltonoiseratiowasnot(4).

iv.Poweranalysisindicatedthatforlargeeffectsizes(f=3.07)typicallyobservedinNAccactivitycontrastsofanticipationoflargeversusnogains,6subjectsweresufficienttodetectagroupeffectatapowerof.80(p<.05).

BehavioralAssessmentMethodsforRDoCConstructs

62

v.Alternateforms(i.e.,pseudorandomorders)areavailableandproduceindistinguishableresults.

vi.Developmentalstabilityoveradolescenceiscurrentlybeingassessedinlargesamples(e.g.,IMAGEN).

3. Areparametersforadministeringthetask(e.g.,numberoftrials,stimuluscharacteristics,

etc.)standardizedonanempiricalbasis?Somewhat.i.Design:ArecentandpopularversionoftheMIDtaskusesa2(valence:gain,loss)x3(magnitude:$0,$1,$5)factorialdesignwith15-18trialspercell.Orderispseudorandomandbalancedwitha2-6secondintertrialinterval.Cuefeaturescanandhaverepresenteddiversealternativeincentivefeaturesincludingprobability(9),requiredeffort(11)etc.

ii.Analysis:Anticipationcanandshouldbeseparatelyanalyzedfromoutcomes(whichareconditionalonandorthogonaltoanticipation).Rawaveragesofpeakactivationcanbeextractedandanalyzedandshowsuperiortest-retestreliabilitytocontrastsandresultingfits(4).

iii.Development:Taskparametersandrequirementscouldbenefitfromcontinuedoptimization,particularlywithrespecttobalancingtasklengthagainstpsychometriccriteria(i.e.,moreresearch/fundingisneeded).

4. Isthetaskfreefromfloor/ceilingeffectsthatcouldprecludeuseinsubjectswitharange

ofimpairment?Yes.i.TheMIDtaskavoidsfloorandceilingeffectsbyimplementinganadaptivetargetresponsewindowthatallowsittobeadministeredinmostsubjectpopulations,includingclinicalsamplesandacrossthelifespan(10)(14),whichcontrolstheexpectedvalueofcuesandoutcomesacrossdiversesamples.

5. Doesthetaskhavethesameperformancecharacteristicsacrosscultures?Isitfreefrom

culture-andlanguage-specificfeatures/stimuli?Yes.i.TheMIDtaskhasbeenappliedacrossdiversecultureswherefMRIisavailableandproducedqualitativelycomparableresults(e.g.,Britain,Germany,France,Netherlands,Israel,Japan,China,US,etc.)(12).Trainingsubjectswithabstractcueshelpscontrolpre-existingconfoundsduetolearningorpre-existingsymbolicassociations.Cuemappingscanalsobefullycounterbalancedwithindatasets.

ii.Abstractcuesfacilitatemappingincentivesaccordingtoculturallyequivalentincentiveschemes(e.g.,adaptingthesymbol$to€)tobedeterminedbyculturally-informedresearchers.

BehavioralAssessmentMethodsforRDoCConstructs

63

6. Isthetasksensitivetochangeandlackandlossoffunction?Yes.i.Greaterage-relateddeclinesinAInsactivityduringanticipationoflargelossesversusNAccactivityduringanticipationoflargegainshasbeenreplicatedinmultiplestudies(14;15).

ii.SomeclinicalresearchsuggeststhatbluntedNAccactivityduringgainanticipationinschizophrenicpatientsontypicalantipsychoticscanpartiallybereversedafterswitchingtoatypicalantipsychotics,intandemwithdiminutionofnegativesymptoms(13).

7. Canthetask(oritsanalog)beusedinanimals?Yes(aftersubstitutingprimaryfor

secondaryrewards).i.Tasksthatvarycuedrewardmagnitude(i.e.,dropsofsugarwater)elicitmagnitude-dependentincreasesinNAccdopaminereleaseinrats,asassessedbyinvivocyclicvoltammetry(16)(thesameisnottrueforcuedeffort,parallelinghumanstudies).

8. Canthetaskbeusedacrossagegroups?Yes.

i.TheMIDtaskhasbeenusedinadolescentsandelders,andtokenizedversionshavebeenextendedtochildren(butrequirenorming).

ii.Adolescents(<18)showqualitativelysimilaractivitypatterns,withsomewhatdiminishedNAccactivityduringanticipationoflargegains(17;18).

iii.Olderadults(>60)typicallyshowsimilaractivityasyoungeradults,withtheexceptionoflessAInsactivityduringanticipationoflargelosses(4;14)

9. Canthetaskbeusedwithmethodstointerrogatebraincircuitry(e.g.,fMRI,EEG,etc.)?

Yes(particularlyFMRI).i.TheMIDtaskisspecificallydesignedandoptimizedforusewithFMRI.ii.TheMIDtaskhasbeenusedwithEEG,butdeepsourcesaredifficulttolocalize(6).iii.WearecurrentlyexploringconnectionswithraclopridedisplacementPETbutdisparatetimescalesaredifficulttocompare(butsee(19)).

10.Isthereconsensusonwhichmetric/scoreshouldbeconsideredtobeprimary?Somewhat.

i.Whilethereisnoformalconsensusforneuralactivity,themajorityofresearcherscontrast:(1)gainversusnongainanticipation;(2)lossversusnonlossanticipation;(3)gainversusnongainoutcome;(4)nonlossversuslossoutcome.Alternatively,researchersextractpeakactivationforallconditions(e.g.,valencebymagnitude)fromvolumesofinterestintheNAcc,MFPC,andrightAIns(recommended).(12)

ii.Valenceandarousalratingsforeachoftheincentivecuescanbecollectedafter(orevenduring)thetask,mean-deviated,androtatedtoderivecueelicitedpositivearousalandnegativearousalscores(20).

BehavioralAssessmentMethodsforRDoCConstructs

64

iii.Functionalconnectivitybetweennodescouldbeextractedforspecifictrialphasesandconditions,buttheseindiceshavenotreceivedextensivepsychometriccharacterization(e.g.,(21)).

11.Areadequatenormativedataavailableacrossage,gender,education,ethnicity,SES?

Partially.i.Somenormativedataareavailableinmedium-sizedsamples(n=52)forageandgender(4),andlargerdatasetsarecomingonline(e.g.,IMAGEN).Samplestodatehavetendedtoincludehigheducationandsocioeconomicstatusindividuals(exceptincasesofclinicalgroups).

12.Aretherelationshipsbetweentaskperformanceandneuralsignal(s)known?Yes.i.Behavioralperformanceistypicallycontrolledsothatassociationsbetweenovertbehaviorandbrainactivityaredissociable.

ii.Regressorsthatparametricallymodelreactiontimeinresponsetoeachtarget,however,typicallyrobustlyactivatetheputamenandsupplementarymotorcortex(22).

13.Aretherelationshipsbetweentaskperformanceandclinicalfeature(s)known?

Somewhat.i.Behavioralperformanceistypicallycontrolledsothatassociationsbetweenovertbehaviorandbrainactivityaredissociable(asabove).

ii.ThestrongestclinicalcorrelatesofNAccactivityduringgainanticipationtodatehaveincludednegativesymptomsinthecontextofschizophrenia(23)andhyperactivesymptomsinthecontextofADHD(6;24).

iii.Manyotherdisordersremaintobeexplored(e.g.,affectivedisorders,addiction).

14.Isthetaskfeasibleforadministrationacrosssites?Yes.i.AnadaptedversionoftheMIDtaskhasbeenusedinapproximately2000youthacross8EuropeansitesintheIMAGENconsortium,andisalsobeingusedinanothermultisitestudy(FAST-MAS).Initialverificationofadequatesignalhomogeneityandspatiotemporalresolutionacrossscannersisessential.

15.Canthetaskbeusedasastand-alonebehavioraltask?Possiblynot.i.BecausetheMIDtaskadaptivelycontrolsperformancetoequateexpectedvalue,fasterreactiontimemeasurestoprovidelimitedinformation.

BehavioralAssessmentMethodsforRDoCConstructs

65

ii.Researcherscan,however,solicitaffectiveresponses(typicallyvalenceandarousal)toincentivecuesasasummarymeasureofaffectiveresponsiveness(9).Combinationofneuralself-reportmeasures,however,isrecommended.

16.Whatworkisneededtogetthistaskreadyforuseinclinicaltrials?Inuse,butmorecouldbedone.i.Thecurrent“standard”3(magnitude)x2(valence)versionisalreadyinuseinmanyclinicalandpharmacologicalprotocols(however,seebelow):

ii.Thetaskinvolvesaspeededreactiontimeresponse.Thisiscontrolledacrossincentiveconditions,butmayaddtotheobservedsignal.Ifreducedmotorengagementisdesired,aMIDtaskversioninvolvingchoicesratherthanspeededreactiontimecouldbecomparedwithcanonicalversions(thiswouldrequirepiloting,however,sinceitcouldchangetheaffectiveresponsesandgeneralizabilityofthetask).

iii.Moreextensivesetsofgainandlossmagnitudescouldbeinvestigatedinalongerexperimenttodetermineoptimalmagnitudes(however,seteffectsmayalsoplayarole).

iv.Adirectlyparallelversioncouldbedevisedandcharacterizedinratsusingbotholder(voltammetry)andnewer(optogeneticfiberphotometry)measures,possiblyalongsidepharmacologicalmodulationforvalidation.

v.Fasterperipheralphysiologicalmeasures(facialelectromyography+pupillarydilation)mightbetestedasapotentiallydilutedbutimplicitbehavioralprobeofaffectiveresponsesduringtheMIDtask.

vi.Taskparameters(i.e.,numberandcompositionofconditions,numberoftrialspercondition,minimumvariableintertrialinterval)couldbecomparedandoptimizedinaseriesoftrials.

17.Isthetaskcopyrighted?No.

i.InitialdevelopmentoftheMIDTaskwasfundedthroughanNIHB/STARTgrantMH066923sothetaskbelongstoAmericantaxpayers.Versioncontrol,however,ismaintainedbyBK(knutson@stanford.edu),whocanproviderecentcopiesofthetaskuponrequest.

References

1. KnutsonB,Westdorpa,KaiserE,HommerD(2000):FMRIvisualizationofbrainactivityduringamonetaryincentivedelaytask.Neuroimage12:20–7.

2. HaberSN,KnutsonB(2010):Therewardcircuit:linkingprimateanatomyandhumanimaging.Neuropsychopharmacology35:4–26.

BehavioralAssessmentMethodsforRDoCConstructs

66

3. KnutsonB,AdamsCM,FongGW,HommerD(2001):Anticipationofincreasingmonetaryrewardselectivelyrecruitsnucleusaccumbens...JNeurosci(Vol.21).doi:20015472[pii].

4. WuCC,Samanez-LarkinGR,KatovichK,KnutsonB(2014):Affectivetraitslinktoreliableneuralmarkersofincentiveanticipation.Neuroimage84:ElsevierInc.279–289.

5. KnutsonB,FongGW,BennettSM,AdamsCM,HommerD(2003):Aregionofmesialprefrontalcortextracksmonetarilyrewardingoutcomes:characterizationwithrapidevent-relatedfMRI.Neuroimage18:263–272.

6. PlichtaMM,ScheresA(2014):Ventral-striatalresponsivenessduringrewardanticipationinADHDanditsrelationtotraitimpulsivityinthehealthypopulation:Ameta-analyticreviewofthefMRIliterature.NeurosciBiobehavRev38:125–134.

7. KnutsonB,GreerSM(2008):Anticipatoryaffect:Neuralcorrelatesandconsequencesforchoice.PhilosTransRSocLondBBiolSci363:3771–86.

8. FliessbachK,RoheT,LinderNS,TrautnerP,ElgerCE,WeberB(2010):Retestreliabilityofreward-relatedBOLDsignals.Neuroimage50:ElsevierInc.1168–1176.

9. KnutsonB,TaylorJ,KaufmanM,PetersonR,GloverG(2005):Distributedneuralrepresentationofexpectedvalue.JNeurosci25:4806–4812.

10. KnutsonB,HeinzA(2015):Probingpsychiatricsymptomswiththemonetaryincentivedelaytask.BiolPsychiatry77:418–20.

11. CroxsonPL,WaltonME,O’ReillyJX,BehrensTEJ,RushworthMFS(2009):Effort-basedcost-benefitvaluationandthehumanbrain.JNeurosci29:4531–41.

12. BalodisIM,PotenzaMN(2015):Anticipatoryrewardprocessinginaddictedpopulations:Afocusonthemonetaryincentivedelaytask.BiolPsychiatry77:Elsevier434–444.

13. SchlagenhaufF,JuckelG,KoslowskiM,KahntT,KnutsonB,DemblerT,etal.(2008):Rewardsystemactivationinschizophrenicpatientsswitchedfromtypicalneurolepticstoolanzapine.Psychopharmacology(Berl)196:673–684.

14. Samanez-LarkinGR,GibbsSEB,KhannaK,NielsenL,CarstensenLL,KnutsonB(2007):Anticipationofmonetarygainbutnotlossinhealthyolderadults.NatNeurosci10:787–791.

15. Samanez-LarkinGR,LevensSM,PerryLM,DoughertyRF,KnutsonB(2012):Frontostriatalwhitematterintegritymediatesadultagedifferencesinprobabilisticrewardlearning.JNeurosci32:5333–7.

16. GanJO,WaltonME,PhillipsPEM(2010):Dissociablecostandbenefitencodingoffuturerewardsbymesolimbicdopamine.NatNeurosci13:25–7.

17. BjorkJM,KnutsonB,FongGW,CaggianoDM,BennettSM,HommerDW(2004):Incentive-elicitedbrainactivationinadolescents:similaritiesanddifferencesfromyoungadults.JNeurosci24:1793–1802.

18. BjorkJM,KnutsonB,HommerDW(2008):Incentive-elicitedstriatalactivationinadolescentchildrenofalcoholics.Addiction103:1308–1319.

19. SchottBH,MinuzziL,KrebsRM,ElmenhorstD,LangM,WinzOH,etal.(2008):Mesolimbicfunctionalmagneticresonanceimagingactivationsduringrewardanticipationcorrelatewithreward-relatedventralstriataldopaminerelease.JNeurosci28:14311–9.

BehavioralAssessmentMethodsforRDoCConstructs

67

20. KnutsonB,KatovichK,SuriG(2014):InferringaffectfromfMRIdata.TrendsCognSci18:422–8.

21. ChoYT,ErnstM,FudgeJL(2013):Cortico-amygdala-striatalcircuitsareorganizedashierarchicalsubsystemsthroughtheprimateamygdala.JNeurosci33:14017–30.

22. KnutsonB,TaylorJ,KaufmanM,PetersonR,GloverG(2005):Distributedneuralrepresentationofexpectedvalue.JNeurosci25:4806–12.

23. JuckelG,SchlagenhaufF,KoslowskiM,WüstenbergT,VillringerA,KnutsonB,etal.(2006):Dysfunctionofventralstriatalrewardpredictioninschizophrenia.Neuroimage29:409–16.

24. ScheresA,MilhamMP,KnutsonB,CastellanosFX(2007):Ventralstriatalhyporesponsivenessduringrewardanticipationinattention-deficit/hyperactivitydisorder.BiolPsychiatry61:720–724.

BehavioralAssessmentMethodsforRDoCConstructs

68

AppendixPVS-IIc:DetailedEvaluationCriteriaforDevaluationLearningTasks

PVSConstruct:RewardLearning

PVSSub-construct:Habit

1. Howvalidatestoftheconstructisthetask?

Devaluationlearningtasks(DLT)weredevelopedtoprovideanobjectivemeasureofparticipants’abilitytoestablishahabitualresponsetostimuliassociatedwithoutcomesthatearnpoints,andthena‘slips-of-action’phasemeasurestheirabilitytonotrespondtoformerlyrewardedstimulithataredevaluedinthefinaltestphase.Priorstudieshaveshownthatdevaluationlearning:

1) isnegativelycorrelatedwithticseverityinpatientswithGillesdelaTouretteSyndrome(Delormeetal.2016),OCDtraits(Snorrasonetal.2016)inyoungadults,andbluntedinpatientswithOCD(Gillanetal.2011)andpatientswithalcoholdependence(Sjoerdsetal.2013).MedicatedpatientswithGillesdelaTouretteSyndromeshowedimproveddevaluationlearningovernon-medicatedpatients(Delormeetal.2016).Patientswithlongerdurationofalcoholdependenceshowedlessengagementoftheventromedialprefrontalcortex(acriticalstructureforgoal-directedbehaviorthatcanoverridehabitualbehavior)(Sjoerdsetal.2013).

2) isbluntedwithacutedopamine(deWitetal.2012)andtryptophandepletion(Worbeetal.2015),andsteeperdeclinesinplasmatryptophanlevelspredictedpoorerperformanceindevaluingstimuli(Worbeetal.2015)

3) islinkedtoreward-relatedactivation(deWitetal.2009)inhumansandrats(Smith&Graybiel2016)(dorsalstriatum)andatypicalstructuralconnectivityfromrewardnodestomotorregions(Delormeetal.2016)inpatientswithGillesdelaTouretteSyndrome.

2. Doesthetaskhavegoodpsychometriccharacteristics(incl.highinternalreliability,test-

retestreliability,sensitivity/specificity,limitedpracticeeffects,availabilityofalternate

forms,longitudinalstability)?

i. highinternalreliability:notevaluatedii. test-retestreliability:notevaluatediii. Sensitivity/specificity:notevaluatediv. Limitedpracticeeffects:notevaluatedv. Availabilityofalternateforms:notevaluatedbutpossiblevi. Longitudinalstability:notevaluated

BehavioralAssessmentMethodsforRDoCConstructs

69

3. Areparametersforadministeringthetask(e.g.,numberoftrials,stimuluscharacteristics,

etc.)standardizedonanempiricalbasis?

i. No.Parametersneedtobeoptimizedforadministrationacrossadult,pediatric,andclinicalpopulations.

4. Isthetaskfreefromfloor/ceilingeffectswhichwouldprecludeuseinsubjectswitha

rangeofimpairment?

i. Incomplete;taskcharacteristicsshowadequatevariabilityacrosshealthyadultandadultclinicalpopulations,butadditionalworkisneededforpediatricpopulations.

5. Doesthetaskhavethesameperformancecharacteristicsacrosscultures?Isitfreefrom

culture-andlanguage-specificfeatures/stimuli?

i. Notyetknown

6. Isthetasksensitivetochangeandlackandlossoffunction?

i. Yes,asevidencedbypsychopharmacologicchallenge(Worbeetal.2015;deWitetal.2012)andfindingsinpatientpopulations(Sjoerdsetal.2013;Gillanetal.2011;Delormeetal.2016).

7. Canthetask(oritsanalog)beusedinanimals?

i. Incomplete–onestudytodateshowseffectiveanimalanalog(Smith&Graybiel2016).

8. Canthetaskbeusedacrossagegroups?

i. Versionsimplementedinadults(Snorrasonetal.2016;Sjoerdsetal.2013;Delormeetal.2016;Gillanetal.2011;deWitetal.2012;Worbeetal.2015),olderadults(deWitetal.2011),andchildren(Geurts&deWit2013),butthechildhoodtaskdidnotelicittheintendeddevaluationeffectinchildrenwithautism.Unclearifthisisbecausehabitformationisintactinchildrenwithautismorthetaskwasnotproperlyoptimizedtobesensitivetodifferencesinperformanceforchildren—existingdataonrewardsystems(Kohlsetal.2012;Dichteretal.2012)andreversallearninginautism(Yerysetal.2009;D’Cruzetal.2013;Reedetal.2011)wouldsuggestdevaluationlearningtobeareasonabletargettoexpectdifferencesbetweengroups.

9. Canthetaskbeusedwithmethodstointerrogatebraincircuitry(e.g.,fMRI,EEG,etc.)?

i. Yes(seeabove).ThetaskhasbeenimplementedwithfMRIandDTI(deWitetal.2009;Delormeetal.2016)

10. Isthereconsensusonwhichmetric/scoreshouldbeconsideredtobeprimary?

BehavioralAssessmentMethodsforRDoCConstructs

70

i. Differencescoreofvaluableminusdevaluedresponse%inSlips-of-ActionandBaselinephases

ii. Correct/IncorrectresponsesanddecreasesinRToverthecourseofthelearningphaseiii. AccuracyduringtheOutcome-devaluationstage

11. Areadequatenormativedataavailableacrossage,gender,education,ethnicity,SES?

i. No

12. Aretherelationshipsbetweentaskperformanceandneuralsignal(s)known?

i. Yes(seeabove).Linkagetostriatuminhumans(Delormeetal.2016;deWitetal.2009)andanimals(Smith&Graybiel2016).

13. Aretherelationshipsbetweentaskperformanceandclinicalfeature(s)known?

i. Yes,correlateswithticseverityinGillesdelaTouretteSyndrome(Delormeetal.2016)andpoorerdevaluationobservedinpatientswithOCD(Gillanetal.2011)andalcoholdependence(Sjoerdsetal.2013)butnotParkinson’s(deWitetal.2011)orautism(Geurts&deWit2013).

14. Isthetaskfeasibleforadministrationacrosssites?

i. Yes

15. Canthetaskbeusedasastand-alonebehavioraltask?i. Yes

16. Whatworkisneededtogetthistaskreadyforuseinclinicaltrials?

i. Optimizationacrosspediatricandclinicalpediatricpopulations,validityandnormalizationanalyses.

17. Isthetaskcopyrighted?i. No

References:

1.Delorme,C.etal.EnhancedhabitformationinGillesdelaTourettesyndrome.Brain139,605–615(2016).

2.Snorrason,I.,Lee,H.J.,deWit,S.&Woods,D.W.Arenonclinicalobsessive-compulsivesymptomsassociatedwithbiastowardhabits?PsychiatryRes.241,221–223(2016).

3.Gillan,C.M.etal.Disruptioninthebalancebetweengoal-directedbehaviorandhabitlearninginobsessive-compulsivedisorder.Am.J.Psychiatry168,718–726(2011).

BehavioralAssessmentMethodsforRDoCConstructs

71

4.Sjoerds,Z.etal.Behavioralandneuroimagingevidenceforoverrelianceonhabitlearninginalcohol-dependentpatients.Transl.Psychiatry3,e337(2013).

5.deWit,S.etal.Relianceonhabitsattheexpenseofgoal-directedcontrolfollowingdopamineprecursordepletion.Psychopharmacology(Berl.)219,621–631(2012).

6.Worbe,Y.,Savulich,G.,Wit,S.de,Fernandez-Egea,E.&Robbins,T.W.TryptophanDepletionPromotesHabitualoverGoal-DirectedControlofAppetitiveRespondinginHumans.Int.J.Neuropsychopharmacol.18,pyv013(2015).

7.deWit,S.,Corlett,P.R.,Aitken,M.R.,Dickinson,A.&Fletcher,P.C.DifferentialEngagementoftheVentromedialPrefrontalCortexbyGoal-DirectedandHabitualBehaviortowardFoodPicturesinHumans.J.Neurosci.29,11330–11338(2009).

8.Smith,K.S.&Graybiel,A.M.Habitformationcoincideswithshiftsinreinforcementrepresentationsinthesensorimotorstriatum.J.Neurophysiol.115,1487–1498(2016).

9.deWit,S.,Barker,R.A.,Dickinson,A.D.&Cools,R.HabitualversusGoal-directedActionControlinParkinsonDisease.J.Cogn.Neurosci.23,1218–1229(2011).

10.Geurts,H.M.&deWit,S.Goal-directedactioncontrolinchildrenwithautismspectrumdisorders.Autism18,409–18(2013).

11.Kohls,G.,Chevallier,C.,Troiani,V.&Schultz,R.T.Social‘wanting’dysfunctioninautism:neurobiologicalunderpinningsandtreatmentimplications.J.Neurodev.Disord.4,10(2012).

12.Dichter,G.S.,Damiano,C.A.&Allen,J.A.Rewardcircuitrydysfunctioninpsychiatricandneurodevelopmentaldisordersandgeneticsyndromes:animalmodelsandclinicalfindings.J.Neurodev.Disord.4,19(2012).

13.Yerys,B.E.etal.Set-shiftinginchildrenwithautismspectrumdisorders:reversalshiftingdeficitsontheIntradimensional/ExtradimensionalShiftTestcorrelatewithrepetitivebehaviors.Autism13,523–538(2009).

14.D’Cruz,A.-M.etal.Reducedbehavioralflexibilityinautismspectrumdisorders.Neuropsychology27,152–160(2013).

15.Reed,P.,Watts,H.&Truzoli,R.Flexibilityinyoungpeoplewithautismspectrumdisordersonacardsorttask.Autism(2011).doi:10.1177/1362361311409599

BehavioralAssessmentMethodsforRDoCConstructs

72

AppendixPVS-IId:DetailedEvaluationCriteriaforProbabilisticRewardTask

PVSConstruct:RewardLearning

PVSSub-construct:ProbabilisticandReinforcementLearning

1. Howvalidatestoftheconstructisthetask?

TheProbabilisticRewardtask(PRT)wasdevelopedtoprovideanobjectivemeasureofparticipants’abilitytomodifybehaviorasafunctionofreward(Pizzagallietal.2005)(modifiedafter(Tripp&Alsop1999)),andyieldsmeasuresofrewardresponsivenessandrewardlearning.Priorstudieshaveshownthatresponsebiastowardsamorefrequentlyrewardedstimulus:

(1)isinverselyrelatedtocurrentanhedonicsymptomsinunselectedadults,individualswithelevateddepressivesymptoms,andunmedicatedindividualswithcurrentMDD(Pizzagalli,Iosifescu,etal.2008;Pizzagallietal.2005;Bogdan&Pizzagalli2006)andrelativesofpatientswithmajordepression(W.-H.Liuetal.2016);correlateswithreducedhedoniccapacity/approachmotivationprepubertalchildren(Lukingetal.2015);andcorrelateswithcigarettecravingamongsmokers(Peechatkaetal.2015);

(2)predictsself-reportedanhedonicsymptoms38dayslater(Pizzagallietal.2005);(3)isbluntedinindividualswithincreaseddepressivesymptoms,currentMDD,andpast

MDD(Pizzagalli,Iosifescu,etal.2008;Pizzagallietal.2005;Pechteletal.2013;Whittonetal.2016;Liuetal.2011),particularlythosewithelevatedanhedonicsymptoms(Vrieze,Pizzagalli,etal.2013)ormelancholicdepression(Fletcheretal.2015);inrelativesofpatientswithmajordepressionwithsub-clinicaldepressivesymptoms(W.-H.Liuetal.2016);andinyouthreportinganhedoniaacrossvariousDSMdiagnosis(Morrisetal.2015).

(4)isimprovedbypharmacologicaltreatmentsamongdepressedinpatients(Vrieze,Pizzagalli,etal.2013)andbyresidentialtreatmentinfemaleadolescentswithco-occurringdepressionandsubstanceabuse(Bogeretal.2014);

(5)islinkedtobothresting(Webbetal.2016)(Kaiseretal.,underreview)andreward-relatedactivationandfunctionalconnectivitywithinnodesofthebrainrewardsystem(ventral/dorsalstriatum,orbitofrontalcortex,dorsalanteriorcingulatecortex)(Santessoetal.2008a;Santessoetal.2009;Bogdanetal.2011)aswellasERPmarkersofreinforcementlearning(Santessoetal.2008a;Whittonetal.2016;Bress&Hajcak2013);

(6)islinkedtoDAreleaseinextrastriatalregions(asassessedbyPET)(Vrieze,Ceccarini,etal.2013);

(7)isassociatedwithgeneticvariantsknowntomodulateprefrontaldopaminergicvariation(COMT;(Lancasteretal.2012;Lancasteretal.2015;Goetzetal.2013);and(Corral-Fríasetal.2016),riskformooddisordersandschizophrenia(CACNA1C;(Lancasteretal.2014),andmu-opioidreceptorfunction(Leeetal.2011).

BehavioralAssessmentMethodsforRDoCConstructs

73

(8)ispotentiatedorbluntedbypharmacologicalchallengeshypothesizedtoincrease(e.g.,nicotine,amphetamine)ordecrease(e.g.,singlelowdosesofpramipexolethoughttoreducephasicDAresponseviapresynapticautoreceptoractivation),respectively,DAsignalinginbothhumansandrats(Barretal.2008;Pizzagalli,Evins,etal.2008;Pergadiaetal.2014;Der-Avakianetal.2013);

(9)ispotentiatedinhealthycontrolsbyhigh-frequencyrapidTMSovertheleftdorsolateralprefrontalcortex(Ahnetal.2013);

(10)isbluntedbyacutelaboratoryandprolongednaturalisticstressors(Bogdan&Pizzagalli2006;Pizzagallietal.2007),particularlyinindividualscarryinggeneticvariantspreviouslyassociatedwithincreasedHPAreactivityordepression(Bogdanetal.2011;Bogdanetal.2010;Nikolovaetal.2012);conversely,agreaterresponsebiasunderstressamongindividualswithGeneralAnxietyDisorders(GAD)predictslowerdepressionsymptoms1monthlater(Morris&Rottenberg2015).

(11)isheritable(46%)(Bogdan&Pizzagalli2009).

2. Doesthetaskhavegoodpsychometriccharacteristics(incl.highinternalreliability,test-

retestreliability,sensitivity/specificity,limitedpracticeeffects,availabilityofalternate

forms,longitudinalstability)?

i. highinternalreliability:notevaluatedii. test-retestreliability:0.57over38daysinunselectedindividuals(Pizzagallietal.2005);

replicatedinanindependentunselectedsample:r=0.50-0.56over39days(Santessoetal.2008b)

iii. Sensitivity/specificity:ROCanalysesnotperformedyet(butdataareavailable)iv. Limitedpracticeeffects:minimizedbyusingdifferentalternateforms(seebelow).v. Availabilityofalternateforms:Yes(5forms)vi. Longitudinalstability:limited(onlyevaluatedover~40days)

3. Areparametersforadministeringthetask(e.g.,numberoftrials,stimuluscharacteristics,

etc.)standardizedonanempiricalbasis?

i. Taskcharacteristics(e.g.,stimulussizeandexposure)wereoptimizedinordertoachieveanoverallaccuracy~0.85(toallowconditionorgroupmodulations).

4. Isthetaskfreefromfloor/ceilingeffectswhichwouldprecludeuseinsubjectswitha

rangeofimpairment?

i. Yes;taskcharacteristics(e.g.,stimulussizeandexposure)wereoptimizedinordertoachieveanoverallaccuracy~0.85.

5. Doesthetaskhavethesameperformancecharacteristicsacrosscultures?Isitfreefrom

culture-andlanguage-specificfeatures/stimuli?

BehavioralAssessmentMethodsforRDoCConstructs

74

i. FindingsofreducedresponsebiasinMDDvs.healthycontrolshavebeenreplicatedacrossUS(Pizzagalli,Iosifescu,etal.2008),European(Vrieze,Pizzagalli,etal.2013),andAsian(Liuetal.2011)samples.Thetaskanditsinstructionshavebeentranslatedinseverallanguages(e.g.,Dutch,English,German,Korean,Chinese)

ii. Thetaskhasbeenfreelydisseminatedby>110researchgroupsacrossmanycountries;itsminimalrelianceonverbalstimulimakescross-culturalcomparisonsfeasible.

6. Isthetasksensitivetochangeandlackandlossoffunction?

i. Yes,asevidencedbypharmacologicalchallenges(Barretal.2008;Pizzagalli,Evins,etal.2008;Pergadiaetal.2014),neurostimulation(Ahnetal.2013),andfindingsinpatientsamples(Pizzagalli,Iosifescu,etal.2008;Fletcheretal.2015;Vrieze,Pizzagalli,etal.2013;Liuetal.2011).

7. Canthetask(oritsanalog)beusedinanimals?

i. Yes;aconceptuallyanalogousversionhasbeendevelopedforrats(Der-Avakianetal.2013).Cross-speciesstudieshaveshownthatthesamefindingshaveemergedinhumansandratswhenusingpharmacologicalchallenges(Pizzagalli,Evins,etal.2008;Der-Avakianetal.2013),nicotinewithdrawal(Pergadiaetal.2014),orstressors(Bogdan&Pizzagalli2006)(andDer-Avakianetal.,inpreparation).

8. Canthetaskbeusedacrossagegroups?

i. Some(unpublished)datainchildren

9. Canthetaskbeusedwithmethodstointerrogatebraincircuitry(e.g.,fMRI,EEG,etc.)?

i. Yes(seeabove).ThetaskhasbeenusedinconjunctionwithERP,fMRIandPET.

10. Isthereconsensusonwhichmetric/scoreshouldbeconsideredtobeprimary?

i. Responsebiasii. Rewardlearning(e.g.,RB(block3)–RB(Block1)iii. Secondary:Discriminability,accuracy,RT

11. Areadequatenormativedataavailableacrossage,gender,education,ethnicity,SES?

i. Thetaskhasbeenadministeredtoover1,000individuals.Age-andgender-relatednormsareavailable.

12. Aretherelationshipsbetweentaskperformanceandneuralsignal(s)known?

i. Yes(seepoint#1)

BehavioralAssessmentMethodsforRDoCConstructs

75

13. Aretherelationshipsbetweentaskperformanceandclinicalfeature(s)known?

i. Yes(seepoint#1)

14. Isthetaskfeasibleforadministrationacrosssites?

i. Yes(standardizationandamanualhavebeendevelopedfortheEMBARCstudy).ii. Inaddition,Dr.Pizzagalli’slabhasfeelyprovidedthetasktoover110groupssince

2005,andextensivedocumentation/manualsareavailableforstandardizationacrosssites.

15. Canthetaskbeusedasastand-alonebehavioraltask?

i. Yes

16. Whatworkisneededtogetthistaskreadyforuseinclinicaltrials?

i. EMBARCandCNTRACSwillprovideinforegardingitsuseinclinicaltrials

17. Isthetaskcopyrighted?i. Thecodeiscopyrighted(HarvardUniversity)andisprovidedforfreetoacademic

groups.Alicenseagreementisrequiredforindustry.

References:

Seeoverallbibliography

BehavioralAssessmentMethodsforRDoCConstructs

76

AppendixPVS-IIe:DetailedEvaluationCriteriaforRiskandAmbiguityTask

PVSConstruct:RewardValuation

PVSSub-construct:Reward(probability)

1. Howvalidatestoftheconstructisthetask?

TheRiskandAmbiguityTaskwasdevelopedtoassessindividualbehaviorunderuncertainty.Itassessesindividualattitudestowardsrisk(knownoutcomeprobabilities)andambiguity(unknownoutcomeprobabilities)1,2.Thetaskyieldsmeasuresofriskandambiguityattitudesinthegainandlossdomains,aswellasmeasuresofdecisionquality3.Priorstudieshaveshown:

1) Decreasedambiguityaversioninadolescentscomparedtoadults4,whichincreaseswithage5.Noambiguityaversioninpre-adolescentchildren6.

2) Increasedriskaversioninthegaindomainandriskseekinginthelossdomain,aswellasdecreaseddecisionquality,inolderadults3.

3) IncreasedaversiontoambiguouslossesinindividualswithPTSD,whichiscorrelatedwithsymptomstrengthandmediatestheassociationbetweenthedegreeofcombatexposureandthedegreeofsymptoms,specificallyanxiousarousal7.

4) DecreaseddecisionqualityandincreasedambiguityaversioninindividualswithOCD8.5) Correlationbetweenthegray-mattervolumeofaregioninrightPosteriorParietal

Cortexandindividualrisktolerance9.6) Effectofindividualriskandambiguityattitudesonactivationmagnitudeinvalue-

relatedbrainareas1.

2. Doesthetaskhavegoodpsychometriccharacteristics(incl.highinternalreliability,test-

retestreliability,sensitivity/specificity,limitedpracticeeffects,availabilityofalternate

forms,longitudinalstability)?

i. highinternalreliability:notevaluatedii. test-retestreliability:riskandambiguityattitudesstablein18subjectsacrosstwo

sessionsseparatedbyseveraldays1,butreliabilitynotquantified.iii. Sensitivity/specificity:notevaluatediv. Limitedpracticeeffects:notevaluatedv. Availabilityofalternateforms:severalversionsofthetaskhavebeenusedvi. Longitudinalstability:notevaluated

3. Areparametersforadministeringthetask(e.g.,numberoftrials,stimuluscharacteristics,

etc.)standardizedonanempiricalbasis?

BehavioralAssessmentMethodsforRDoCConstructs

77

i. No

4. Isthetaskfreefromfloor/ceilingeffectswhichwouldprecludeuseinsubjectswitha

rangeofimpairment?

i. Thetaskhasbeenusedinawiderangeofages,includingseveralpsychiatricconditions(seeabove),withnofloor/ceilingeffects.

5. Doesthetaskhavethesameperformancecharacteristicsacrosscultures?Isitfreefrom

culture-andlanguage-specificfeatures/stimuli?

i. Thetaskisfreefromculture-andlanguage-specificstimuli.Performanceacrossculturesnotevaluated.

6. Isthetasksensitivetochangeandlackandlossoffunction?

i. Notevaluated

7. Canthetask(oritsanalog)beusedinanimals?

i. Inprinciplethetaskisspecifictohumans,asitrequiresunderstandingofsymbolicprobabilities.Onestudy,however,usedananaloginmonkeys10.

8. Canthetaskbeusedacrossagegroups?

i. Yes,thetaskhasbeensuccessfullyusedacrossawiderangeofages,from8to90yearsold3-6.

9. Canthetaskbeusedwithmethodstointerrogatebraincircuitry(e.g.,fMRI,EEG,etc.)?

i. Yes,thetaskhasbeenusedwithfMRI1.

10. Isthereconsensusonwhichmetric/scoreshouldbeconsideredtobeprimary?

i. Riskandambiguityattitudesinthegainandlossdomains,estimatedbasedonproportionofchoicesofeachtype,orbasedonfittingabehavioralmodel

i. Estimatesofdecisionqualitybasedonviolationsoffirst-orderstochasticdominanceandtransitivity

11. Areadequatenormativedataavailableacrossage,gender,education,ethnicity,SES?

i. No

12. Aretherelationshipsbetweentaskperformanceandneuralsignal(s)known?

i. Onlypartially(seeabove)

BehavioralAssessmentMethodsforRDoCConstructs

78

13. Aretherelationshipsbetweentaskperformanceandclinicalfeature(s)known?

i. Relationshipswithsomefeatures,includingobsessivecompulsivedisorderandanxiousarousalareknown(seeabove)

14. Isthetaskfeasibleforadministrationacrosssites?

i. Yes.Itincludesstandardizedinstructionsandhasbeenusedinamulti-sitestudyatYaleandNYU3,4.Thetaskwasalsoprovideduponrequesttoseveralothergroups.

15. Canthetaskbeusedasastand-alonebehavioraltask?

i. Yes.

16. Whatworkisneededtogetthistaskreadyforuseinclinicaltrials?

i. Standardizationofparameters,estimationoftheminimaltasklengthrequiredforadequateparameterestimates.

17. Isthetaskcopyrighted?i. No

References

1. LevyI,SnellJ,NelsonAJ,RustichiniA,GlimcherPW.Neuralrepresentationofsubjectivevalueunderriskandambiguity.JNeurophysiol.2010;103(2):1036-1047.

2. LevyI,RosenbergBelmakerL,MansonK,TymulaA,GlimcherPW.MeasuringthesubjectivevalueofriskyandambiguousoptionsusingexperimentaleconomicsandfunctionalMRImethods.JVisExp.2012(67):e3724.

3. TymulaA,RosenbergBelmakerLA,RudermanL,GlimcherPW,LevyI.Likecognitivefunction,decisionmakingacrossthelifespanshowsprofoundage-relatedchanges.ProcNatlAcadSciUSA.2013;110(42):17143-17148.

4. TymulaA,RosenbergBelmakerLA,RoyAK,etal.Adolescents'risk-takingbehaviorisdrivenbytolerancetoambiguity.ProcNatlAcadSciUSA.2012;109(42):17135-17140.

5. BlankensteinNE,CroneEA,vandenBosW,vanDuijvenvoordeAC.DealingWithUncertainty:TestingRisk-andAmbiguity-AttitudeAcrossAdolescence.DevNeuropsychol.2016:1-16.

6. LiR,BrannonEM,HuettelSA.Childrendonotexhibitambiguityaversiondespiteintactfamiliaritybias.FrontPsychol.2014;5:1519.

7. RudermanL,EhrlichDB,RoyA,PietrzakRH,Harpaz-RotemI,LevyI.PosttraumaticStressSymptomsandAversiontoAmbiguousLossesinCombatVeterans.DepressAnxiety.2016.

8. PushkarskayaH,TolinD,RudermanL,etal.Decision-makingunderuncertaintyinobsessive-compulsivedisorder.JPsychiatrRes.2015;69:166-173.

BehavioralAssessmentMethodsforRDoCConstructs

79

9. Gilaie-DotanS,TymulaA,CooperN,KableJW,GlimcherPW,LevyI.Neuroanatomypredictsindividualriskattitudes.JNeurosci.2014;34(37):12394-12401.

10. HaydenBY,HeilbronnerSR,PlattML.Ambiguityaversioninrhesusmacaques.FrontNeurosci.2010;4.

BehavioralAssessmentMethodsforRDoCConstructs

80

AppendixPVS-IIf:DetailedEvaluationCriteriafortheEffort-ExpenditureforRewardsTask

PVSConstruct:RewardValuation

PVSSub-construct:Effort

1. Howvalidatestoftheconstructisthetask?

TheEffortExpenditureforRewardsTask(EEfRT;pronounced“Effort”)wasdevelopedasahomologuetowell-studiedeffort-baseddecision-makingtasksusedintherodentliterature(e.g.,1).Thetaskassessesanindividualpreferencebetweenexpendinggreaterphysicaleffortintheformofspeededbuttonpressesinordertogainlargermonetaryrewardsvs.lesseffortforsmallerrewards.Thetasktakesapproximately20minutes,duringwhichtimeindividualstypicallycompleteapproximately50trialsforwhichtheymustchoosebetween“hardtasks”and“easytasks”.Trialsvaryintermsofboththemagnitudeofrewardavailableforchoosingthemoreeffortfuloptionaswellastheprobabilityofrewardreceipt.Thesemanipulationswereincludedtoincreasetheecologicalvalidityofthetaskforuseinhumans,buttheirinclusionmeansthatthetaskisnota“pure”measureofeffortalone.

(1)Consistentwithpredictionsfromtheanimalliteratureregardingtheroleofdopamine(DA)ineffort-baseddecision-making2,administrationoftheDA-releasingagentd-amphetamineincreasestheproportionofhard-tasksselectedontheEEfRT3.Additionallytheproportionofhard-taskspredictsamphetamine-inducedDAreleaseinthestriatum4.

(2)Proportionofhard-tasksisinverselyrelatedtotraitanhedoniainanundergraduatesampleenrichedforanhedonia5;andpositivelyrelatedtotraitrewardanticipationandbehavioralactivation6(andunpublishedobservations);

(3)Repeatedstudiesofpatientsindepression7,8andschizophrenia9-13;havefoundevidenceforalteredperformanceontheEEfRTascomparedtohealthycontrols.Importantlyhowever,itremainsunclearwhetherbothgroupsshowaprimaryreductionineffortexpenditure(preferenceforlesseffortfuloptions)oradeficitineffortallocation(exertinggreatereffortfortrialsthatofferrelativelysmallerrewards,andfailingtoexpendeffortfortrialsthatoffergreaterrewards).Furtherwithinthesegroups,relationshipsbetweenEEfRTperformanceanddimensionalmeasuresofanhedoniaornegativesymptomshavebeenmoderateatbest,andofteninconsistent,suggestingthattheymaybeassessingdifferentaspectsofreward-relatedsymptoms.

2. Doesthetaskhavegoodpsychometriccharacteristics(incl.highinternalreliability,test-

retestreliability,sensitivity/specificity,limitedpracticeeffects,availabilityofalternate

forms,longitudinalstability)?

i. highinternalreliability:evaluationinprocess;willbeavailableinwinter2016

BehavioralAssessmentMethodsforRDoCConstructs

81

ii. test-retestreliability:assessedinasampleofschizophreniapatientsonly.ICCsat4weeksrangeinthissamplevariedfordifferentparameters(rewardmagnitude;probability).Rangefrom.079to0.53.

iii. Sensitivity/specificity:unknowniv. Limitedpracticeeffects:repeatedassessmentshavenotfoundsignificantevidenceof

practiceeffects3,14.v. Availabilityofalternateforms:Yes–awidenumberofvariantsarecurrentlyinusevi. Longitudinalstability:limited(onlyevaluatedfor~30days)

3. Areparametersforadministeringthetask(e.g.,numberoftrials,stimuluscharacteristics,

etc.)standardizedonanempiricalbasis?

i. Partially.Taskparametersaresettofacilitatehighcompletionrates(>90%)ofhighandloweffortoptioninhealthyormild/moderatepsychiatricpatients.

4. Isthetaskfreefromfloor/ceilingeffectswhichwouldprecludeuseinsubjectswitha

rangeofimpairment?

i. Partially.Somesubjectswillmakeallofonechoicetype(i.e.,alleasyorallhardchoices).Thisisestimatedtooccur<5%basedinhealthyparticipants,butmaybemoreprevalentinpatientpopulationswithvaryingimpairments.

5. Doesthetaskhavethesameperformancecharacteristicsacrosscultures?Isitfreefrom

culture-andlanguage-specificfeatures/stimuli?

i. FindingsintheUS8havebeenreplicatedinanindependently-collectedChinesesample7.

ii. Thetaskhasbeenshared>85researchgroupsacross7countries.Modificationofrewardmagnitudesmaybenecessarytoadjustfordifferencesincurrencyvaluations.

6. Isthetasksensitivetochangeandlackandlossoffunction?

i. Repeated-administrationshaveshownsensitivityofthetasktomanipulationsofdopamine(amphetamine)3andadenosine3.

7. Canthetask(oritsanalog)beusedinanimals?

i. Yes–thetaskwasmodeledafterwell-knowneffort-baseddecision-makingparadigmsinrodents1,15,16

8. Canthetaskbeusedacrossagegroups?

i. Some(unpublished)datahavebeenadministeredinchildren.

BehavioralAssessmentMethodsforRDoCConstructs

82

9. Canthetaskbeusedwithmethodstointerrogatebraincircuitry(e.g.,fMRI,EEG,etc.)?

i. Yes–publisheddatahavelinkedthetaskoffMRI17,EEG4,18,anddopamine-receptorPETimaging4

10. Isthereconsensusonwhichmetric/scoreshouldbeconsideredtobeprimary?

i. Totalproportionofhardtaskchoicesii. Differenceinproportionofhardtaskchoicesforhighvs.lowprobabilitylevelsand/or

reward

11. Areadequatenormativedataavailableacrossage,gender,education,ethnicity,SES?

i. Thetaskhasbeenadministeredinover1,000individuals.Age,Sex,IQandSESnormsareintheprocessofbeingcompiled,andareexpectedtobepublishedinthewinterof2016.

12. Aretherelationshipsbetweentaskperformanceandneuralsignal(s)known?

i. Partially–functionalneuroimagingstudiesareinprogress

13. Aretherelationshipsbetweentaskperformanceandclinicalfeature(s)known?

i. Partially(seepoint#1)

14. Isthetaskfeasibleforadministrationacrosssites?

i. Yes

15. Canthetaskbeusedasastand-alonebehavioraltask?i. Yes–mostpublishedpapersusingthetaskhaveuseditasastand-alonetask

16. Whatworkisneededtogetthistaskreadyforuseinclinicaltrials?

i. Thetaskiscurrentlybeingusedinclinicaltrialsforschizophrenia.Preparationforotherpatientgroupsmayberequired.

17. Isthetaskcopyrighted?i. Thetaskiscopyrighted(EmoryUniversityandVanderbiltUniversity)andalicenseis

requiredfornon-academicuse(i.e.,industry).Thetaskismadefreelyavailableforacademicresearch.

References

BehavioralAssessmentMethodsforRDoCConstructs

83

1. SalamoneJD,CousinsMS,McCulloughLD,CarrieroDL,BerkowitzRJ.Nucleusaccumbensdopaminereleaseincreasesduringinstrumentalleverpressingforfoodbutnotfreefoodconsumption.PharmacolBiochemBehav1994;49(1):25-31.

2. SalamoneJD,CorreaM.Themysteriousmotivationalfunctionsofmesolimbicdopamine.Neuron2012;76(3):470-485.

3. WardleMC,TreadwayMT,MayoLM,ZaldDH,deWitH.AmpingUpEffort:Effectsofd-AmphetamineonHumanEffort-BasedDecision-Making.JNeurosci2011;31(46):16597-16602.

4. TreadwayMT,BuckholtzJW,CowanRL,WoodwardND,LiR,AnsariMSetal.Dopaminergicmechanismsofindividualdifferencesinhumaneffort-baseddecision-making.JNeurosci2012;32(18):6170-6176.

5. TreadwayMT,BuckholtzJW,SchwartzmanAN,LambertWE,ZaldDH.Worththe'EEfRT'?Theeffortexpenditureforrewardstaskasanobjectivemeasureofmotivationandanhedonia.PLoSONE2009;4(8):e6598.

6. GeaneyJT,TreadwayMT,SmillieLD.TraitAnticipatoryPleasurePredictsEffortExpenditureforReward.PLoSONE2015;10(6):e0131357.

7. YangX-h,HuangJ,ZhuC-y,WangY-f,CheungEFC,ChanRCKetal.Motivationaldeficitsineffort-baseddecisionmakinginindividualswithsubsyndromaldepression,first-episodeandremitteddepressionpatients.PsychiatryRes2014;220(3):874-882.

8. TreadwayMT,BossallerNA,SheltonRC,ZaldDH.Effort-baseddecision-makinginmajordepressivedisorder:atranslationalmodelofmotivationalanhedonia.JAbnormPsychol2012;121(3):553.

9. BarchDM,TreadwayMT,SchoenN.Effort,anhedonia,andfunctioninschizophrenia:Reducedeffortallocationpredictsamotivationandfunctionalimpairment.JAbnormPsychol2014;123(2):387.

10. FervahaG,Graff-GuerreroA,ZakzanisKK,FoussiasG,AgidO,RemingtonG.Incentivemotivationdeficitsinschizophreniareflecteffortcomputationimpairmentsduringcost-benefitdecision-making.JPsychiatrRes2013;47(11):1590-1596.

11. McCarthyJM,TreadwayMT,BennettME,BlanchardJJ.Inefficienteffortallocationandnegativesymptomsinindividualswithschizophrenia.SchizophrRes2016.

12. ReddyLF,HoranWP,BarchDM,BuchananRW,DunayevichE,GoldJMetal.Effort-baseddecision-makingparadigmsforclinicaltrialsinschizophrenia:part1—psychometriccharacteristicsof5paradigms.SchizophrBull2015:sbv089.

13. TreadwayMT,PetermanJS,ZaldDH,ParkS.Impairedeffortallocationinpatientswithschizophrenia.SchizophrRes2015;161(2):382-385.

14. WardleMC,TreadwayMT,deWitH.Caffeineincreasespsychomotorperformanceontheeffortexpenditureforrewardstask.PharmacolBiochemBehav2012;102(4):526-531.

15. FlorescoSB,StOngeJR,Ghods-SharifiS,WinstanleyCA.Cortico-limbic-striatalcircuitssubservingdifferentformsofcost-benefitdecisionmaking.CognAffectBehavNeurosci2008;8(4):375-389.

16. WaltonME,BannermanDM,RushworthMF.Theroleofratmedialfrontalcortexineffort-baseddecisionmaking.JNeurosci2002;22(24):10996-11003.

BehavioralAssessmentMethodsforRDoCConstructs

84

17. YangX-h,HuangJ,LanY,ZhuC-y,LiuX-q,WangY-fetal.Diminishedcaudateandsuperiortemporalgyrusresponsestoeffort-baseddecisionmakinginpatientswithfirst-episodemajordepressivedisorder.ProgNeuropsychopharmacolBiolPsychiatry2016;64:52-59.

18. HughesDM,YatesMJ,MortonEE,SmillieLD.Asymmetricfrontalcorticalactivitypredictseffortexpenditureforreward.SocCognAffectNeurosci2015;10(7):1015-1019.

BehavioralAssessmentMethodsforRDoCConstructs

85

CognitiveSystemsFinalReport

CameronCarter,M.D.(chair),NealCohen,Ph.D.,JordanDeVylder,Ph.D.,DwightDickinson,Ph.D.,DamienFair,Ph.D.,MartaKutas,Ph.D.,SoheePark,Ph.D.,andLucinaUddin,Ph.D.

I.GeneralComments• InkeepingwiththecognitiveneuroscienceemphasisthatisatthefoundationofRDoC,

inourselectionoftasksandparadigmswehaveemphasizedconstructvalidityasthemostessentialoftheselectioncriteria.Intheinterestsoftimeandbecausetheylacksub-constructspecificity,wedidnotfocusonself-reportinstrumentsforthemeasurementofcognitivesystems.Inaddition,wheretheywererelevantwewereguidedbyexperiencesandfindingsfromtheCNTRICS/CNTRACSmeasurementdevelopmentinitiative.

• Wehavenotattemptedtoorthogonalizeconstructorsub-constructs.Thus,certaintasksandparadigmsmaybeappropriateformeasuringmultiplecognitivesub-constructs.

• AsisthecaseforotherRDoCsystemsanumberofthecognitivetasks/paradigmsthatseemmostappropriateforcertaincognitivesub-constructsarewell-establishedintheliteratureandconstruct-valid,buthavenotgonethroughrigorouspsychometrictestingandarenotstandardizedinaCNTRICS/CNTRACSsense.Assuchthesemeasureswereuniformlyratedashighonconstructvaliditybutlowonthepresenceofpsychometricdataorstandardizedmethodsofadministrationsuchasstimuluspresentationtimes,inter-trialintervals,numbersoftrialsperconditionetc.Assucheachparadigmthatwasconsideredisbetterdescribedas‘classes’oftasks/paradigmsthanasspecificmeasures.Insomecasesthereisonewidelyusedexemplaroftheclass–e.g.,thePosnerversionofspatialandnon-spatialcuingparadigms,andwenotethisintherelevantsection.Forothernewerapproaches(suchasrelationalinference,describedunderDeclarativeMemory)therearerelativelyfewexemplars.Ineithercase,theversionofthetaskdescribedinthereferencesforrecommendedparadigmscanbeconsideredagoodstartingpointforfurtherdevelopmentalworkdevotedtotaskoptimizationandpsychometriccharacterization.

• Itislikelytobenecessarytoparameterizetasksdifferentlyfordifferentpopulations.Thiscanbechallenging.Formanyparadigms,itwillbenecessarytoparameterizethetasksinawaythatpreservesconstructvalidityacrosspopulations,e.g.,childrenandadults.

• Oneadvantageofcognitiveneuroscienceparadigmsisthatmanyhavebeenusedinresearcharoundtheworld,andmanyusenon-verbalstimuli,reducingoreliminatinglinguisticandcross-culturaladaptationissues.

BehavioralAssessmentMethodsforRDoCConstructs

86

• Theworkgroupdiscussedcertainpsychoticphenomena,particularlyhallucinationsanddelusions.Thesephenomenahavepresentedspecialchallengesandthefieldhasnotconvergedonanywell-specifiedmodeltodatethoughthereareinterestingtheoriesunderdevelopment(e.g.aberrantreinforcementlearning,defectiveBayesianprediction,impairedperformancemonitoring,alteredefferencecopyetc.).ThegroupfeltthatwhileimportantthesehavebeenchallengingtomodelwithinanRDoCcognitivesystemsframework,andgiventhecurrentstateofresearchandweoptedtonotspendtimeonthis.Reinforcementlearningmodels,whicharerelevant,arebeingaddressedunderPositiveValenceSystems.

• Amongthecognitivesystemsconstructsintheexistingmatrix,languagewaslesswellelaboratedthantheotherconstructs.Giventhespecializednatureofthefieldoflinguisticsaswellasevolvingconceptsthatinvokeinteractionsbetweencognitiveandlinguisticsystemswefeltthatitidentifyingconstructsandparadigmsfromthisdomainwouldbebestservedbyagroupwithmoreexpertiseinthearea.Anewreviewisnotedthatmayprovidesomeusefulcontextforthisdiscussion:Elvevag,Cohenetal.,AnexaminationofthelanguageconstructinNIMH'sresearchdomaincriteria:Timefor

reconceptualization!AmJMedGenetBNeuropsychiatrGenet.2016Mar10

• Traditionalcognitivetasks,suchasthoseoftenusedinneuropsychologicalbatteries,werediscussedgenerally,andspecificallyforsomeconstructs.Forthemostpart,thesewerejudgedtolackcognitiveconstructspecificityandwerenotrecommendedforRDoCpurposes.

II.OrganizationoftheDomain• Thereisconsiderablevariationintheelaborationanddisaggregationofcognitive

domainsandconstructsintheexistingRDoCMatrix.Someareinneedofupdatinginlightofcurrentcognitiveneuroscience.Inthiscontextwedidsuggestafurtherelaborationoftheconstructofattention.Specifically,weidentifiedthreeimportantsubdomains;controlledversusautomaticattention,capacitylimitationandinterferencecontrol,andsustainedattentionorvigilance.

• AsisthecaseincognitiveneurosciencetheorythereisconsiderableoverlapamongcertaindomainswithintheRDoCcognitivesystemsdomain,e.g.,betweenworkingmemory,attentionandcognitivecontrol.Similarly,thereisoverlapbetweenRDoCcognitivesystemsandotherRDoCdomains.Forexample,vigilanceisasub-constructofattentionandalsoanindexofarousal.Reinforcementlearningisanimportantformoflearningandmemorybutisbeingaddressedbypositivevalencesystems.Languagewasinitiallygroupedascognitivesystemsconstruct,butisalsocentraltosocialbehavior.

• PossibleadditionalRDoCdomains/constructswerediscussed.Theseincludedreasoning/inferenceandfuturesimulationwhichareemergingareasincognitiveneurosciencewithstrongclinicalrelevance.

BehavioralAssessmentMethodsforRDoCConstructs

87

III.RecommendedTasksAllofthetasksbelowarerecommendedforinclusion.Asnotedaboveandforothernon-cognitivedomainswhileconstructvalidityisstrongforallofthesemeasuressomewillneedsubstantialdevelopmentintermsofoptimizationandpsychometricevaluation.

Attention

• Theparadigmslistedfortheattentiondomainare‘classes’ofparadigms,asdescribedabove.Theysharethecharacteristicsofwide-use,well-developedliterature,andhighconstructvalidity.Whileattentionhasbeenverywidelystudiedinbasiccognitiveneuroscienceforseveraldecades,withoneexception(theAttentionNetworksTask,seebelow),therearenostandardized,psychometricallyrefinedversionsofthesetasks.

Overt/CovertorBottom-upv.Topdown:

• Spatialandnon-spatialcuingtasks,includingPosnerversionsofthetasks1andtheAttentionNetworks(ANT)Task2.Limitedpsychometricdataareavailableforthelatter.

• Visualsearchparadigm3

CapacityandInterferenceControl:

• Attentionalblinkduringrapidserialvisualpresentation4• Dualtaskparadigms,includingversionsdevelopedbyPashler5

Vigilance:

• Varioustaskshave‘catch’trialsbuiltinthatpermitinvestigatorstoseparateattentionlapsesfromothereffectsofinterest(e.g.,changedetectionworkingmemorytasks,perceptualthresholdeffects)–attentionlapsesindexvigilance.6

• Thereisalsoaclassoftasksthathavebeendevelopedtoevaluateattentionlapsingor“mindwandering”duringavarietyoflaboratoryandeverydayactivities.Thesetasksincludeprobestoindexsubjectsawarenessoflapsingwhichhavebeenshowntocorrelatewithobjectivemeasuresoftaskperformanceaswellasneuralmeasuresoftaskrelatedbrainactivity7

Perception(Visual)

• Wefocusedourdiscussiononvisualperception–becauseneuralsubstratesdifferamongperceptualsystemsandbecausethescienceofvisualperceptionismorewell-developedthanthesciencerelatingtootherperceptualsystems

• Keyissuesforperceptiontasksandparadigmsincludecontrolforvisualacuity,lapsesofattention,andworkingmemoryimpairment.

• Forexample,CNTRACSworkhasshownthatremovingschizophreniasubjectswhofailattentionlapse‘catch’trialseliminatesgroupdifferencesonthecontrastcontrasttask(seebelow).Thisposesbothconstructvalidityandmeasurementconcerns.

BehavioralAssessmentMethodsforRDoCConstructs

88

• SomeofthetasksrecommendedbelowhavebeenoptimizedandpsychometricallycharacterizedbyCNTRACS(Contrast-contrasttask,JOVI)orinthecaseofcontrastsensitivitybytheMARScompany.Theremainingshouldbeconsidered“classes”ofparadigmswiththereferencedversionsservingasgoodstartingpointsforfurtherdevelopmentintomorestandardizedandreliablemeasures.

Perceptualsensitivitythreshold:

• Contrastsensitivityparadigms,suchastheversionsdevelopedbyMars(http://www.marsperceptrix.com),isproprietary

• Aclassoftaskswithandasubstantialliteraturealsoexists,butwhichhaven’tbeenstandardizedorpsychometricallytested

Surroundsuppression:

• Thesearetasksindexingtheeffectivenessoflateralinhibitioninthevisualsystem.• Contrast-Contrasttask6

• Goodconstructvalidity• OptimizedandpsychometricallyrefinedforadultsubjectsthroughCNTRACS8• Thisoptimizedversionwhichincludescatchtrialstocontrolforattention

lapsingisavailablethroughtheCNTRACSwebsite(http://cntracs.ucdavis.edu/)

• Relationtoclinicalconditionsunclear–nogroupdifferencesinschizophreniaaftercontrollingforattentioninCNTRACSmulti-sitestudy6

Visualintegration:Tasksmeasuretheactiveintegrationofvisualfeaturesintopercepts.

• Jitteredorientationvisualintegrationtask(JOVI)9• Goodconstructvalidity• OptimizedandpsychometricallyrefinedforadultsubjectsthroughCNTRACS9• Thisoptimizedversionwhichincludescatchtrialsisavailablethroughthe

CNTRACSwebsite(http://cntracs.ucdavis.edu)• Sensitivetogroupdifferences9

DeclarativeMemory

• Althoughtherearemanymemorysystems,declarativememorywasidentifiedintheoriginalcognitivesystemsworkgroupmeetingasthebestmemorytargetforpsychopathologyresearchwithintheRDoCframework.Wemaintainedthatfocus.

Relationalmemory

• Theprocessesinvolvedinmemoryforstimuli/eventsandhowtheywereassociatedwithcoincidentcontext,stimuli,orevents.

• Relationalanditem-specificencodingtask(RISE)10• Goodconstructvalidityforbothrelationalanditemmemoryperformance• OptimizedandpsychometricallyrefinedforadultsubjectsthroughCNTRACS

BehavioralAssessmentMethodsforRDoCConstructs

89

• ThisoptimizedversionisavailablethroughtheCNTRACSwebsite(http://cntracs.ucdavis.edu/)

• Goodevidenceofimpairmentinclinicalgroups(schizophrenia)10.• Evidenceofrelationshiptoeverydayfunctioninginschizophrenia11

Associativeinference

• Anemergingclassofparadigmsthathasgoodconstructvalidityfortheoperationofrelationalmemoryandtheabilitytoinfernewrelationshipsbetweenlearneditemsbasedupontheirrelationshipswithotheritemsacquiredduringlearning.

• Thisisadevelopingliteratureandanwithestablishedcanonicalparadigmbutthemeasuresarenotyetstandardizedandhaveunknownpsychometriccharacteristics12.Hencethisparadigmisrecommendedasaconstructvalidmeasurethat,likemanyothersinthecognitivedomain,willneedfurtherdevelopmentofanoptimizedversionthathasbeenpsychometricallycharacterized

Paired-associateslearning

• Variousmeasuresavailable(e.g.,fromWechslerMemoryScale)• Standardizedwithreasonablepsychometrics• TheWechslerversionisanoptionhoweverithasfeweritemsandlessprecisionthan

othertasks/paradigms.Experimentaltasksarefairlywidelyusedintheliteratureanddevelopingastandardizedtaskwouldbestraightforwardandisrecommended.

Patternseparation:

• Theabilitytodistinguishpreviouslypresenteditemsfromverysimilarfoils(i.e.,morechallengingthanmemorytasksinvolvingasimple‘oldv.new’distinction).AnewerandmorecomputationallyspecifiedaspectofDeclarativememorythathastheadvantageof:

• Moresensitivetoagingeffectsanddementiathanoldv.newparadigms• Knownrelationshipstomemorycircuitryinbrain

• MnemonicSimilarityTest,YassaandStarke13• Recommendedasconstructvalidbutpsychometricsnotknownandwillhave

tobeestablished,inordertohaveanoptimalstandardizedtask.

CognitiveControl

• Thisconstructincludesprocessesneededtomaintaingoaldirectedperformanceandovercomeprepotentandhabitualresponding

• Thereissubstantialsub-constructandtask/paradigmoverlapwithworkingmemorydomain

Responseinhibition:

• Paradigmslistedforthissub-constructare‘classes’ofparadigms,asdescribedinourgeneralcomments.Theysharethecharacteristicsofwide-use,well-developed

BehavioralAssessmentMethodsforRDoCConstructs

90

literature,andhighconstructvalidity.Wearenotawareofstandardized,psychometricallyrefinedversionsofthesetasks.

• Go/No-gotasks14• Stopsignaltasks15

Goalmaintenance(orpreparatorycognitivecontrol):

• AXandDPXcontinuousperformancetests• Strongconstructvalidity16• Optimizedandpsychometricallyrefinedforadultsubjectsthrough

CNTRACSs8• OptimizedversionsareavailablethroughtheCNTRACSwebsite

(http://cntracs.ucdavis.edu/)• Evidenceofimpairmentinclinicalconditions17• Relatedtofunctionalmeasures

• Preparingtoovercomeprepotencytask(POP)• Goodconstructvalidityasagoalmaintenance/proactivecognitivecontrol

measure18o Psychometricshavenotbeencharacterizedo Agoodchoiceforusewithimpairedpopulations(psychoticdisorders,

autism)andchildrenduetosimpletaskstructure.19,20

Performancemonitoring(ordynamiccontrol):Posterrorandpost-conflictadjustments

• Eachofthesethreeclassesoftasks/paradigmscommonlyusedtomeasurethiscontructiswidely-usedwithwell-developedliterature,andreasonableconstructvalidity.Psychometricdevelopmentandoptimizationareneededexceptforflankercla21/postconflictadjustmentsmeasure.Versionsexistforuseinchildren22.OneexampleistheNIHToolboxFlankertask,whichhasbeenstandardizedforallagesandpsychometricallytested.Therearequestionsaboutwhetheritincludessufficientnumbersoftrialsbutitmightbepossibletocomputetrialtotrialandposterroradjustments(3minutesduration).

• Flankertaskversions• Simontaskversions• Strooptaskversions23

WorkingMemory

• Workingmemoryhasbeenextensivelystudiedinthecognitiveneuroscienceandindividualdifferencesliteratureandthemeasuresthathavebeenusedforthemostparthavenotbeenstandardizedorpsychometricallycharacterized.TheexceptionstothisaretheAX/DPXmeasureofactivemaintenanceandthechangedetectionmeasureforworkingmemorycapacitythathavebeendevelopedbyCNTRACS.

• Asnotedabove,thereissubstantialsub-constructandtask/paradigmoverlapwithcognitivecontroldomain

BehavioralAssessmentMethodsforRDoCConstructs

91

Capacity:

• Changedetection• Variousversionsandwell-studiedparadigmwithgoodconstructvalidity24• Astandardized,psychometricallytestedversionisindevelopmentandwill

beavailablethroughCNTRACSinroughlyoneyear

Flexibleupdating:

• NBack25• Manyversionsandwell-studiedparadigmwithreasonableconstructvalidity

• Self-orderedpointing26• Widely-usedwithwell-developedliterature,andreasonableconstruct

validity.

ActiveMaintenance:

• Matchtosampletasks• Variousversionsandwell-studiedparadigmwithgoodconstructvalidity27• Widelyusedinanimalmodelsfromprimatestobirds

• Sternbergtasks• Variousversionsandwell-studiedparadigmwithgoodconstructvalidity28

• Changedetection(seeabove)24• AXandDPXcontinuousperformancetests(seeabove)

Interferencecontrol:

• Relatedtoactivemaintenance,butemphasizingtheextrademandsandeffortassociatedwithresistingdistractionorlapsingattention

• NBack(seeabove)• Sternbergtasks(seeabove)28

o Someversionsofthesetaskshaveinterferencebuiltin.

IV.Tasksthatarenotrecommended

ConstructAttention

• MismatchNegativitywasmentionedasafairlywell-developedauditoryperceptionparadigm,butitdoesnotyieldabehavioralperformanceindexanditwasnotconsideredfurtherforcurrentpurposes.Alsoweoptedtofocusonvisualattentionforthereasonsspecifiedabove.

ConstructRelationalMemory

• PairedAssociatedLearningformtheCANTABwasdiscussedbutnotrecommendedduetolowconstructvalidityforitemversusrelationallearningandbecauseitisproprietary.

BehavioralAssessmentMethodsforRDoCConstructs

92

ConstructWorkingMemory,FlexibleUpdating

• Letternumbersequencingo Well-knownpaperandpenciltaskthathasbeenstandardizedandpsychometrically

refined(e.g.,fortheWAISIQbatteryo Lacksexperimentalrefinementbutmaybeusefultogetanapproximateindexof

thissub-constructthoughnotwithoutcontroversye.g.29

V.References1. CarterCS,RobertsonLC,ChaderjianMR,CelayaLJ,NordahlTE.Attentionalasymmetryin

schizophrenia:controlledandautomaticprocesses.BiologicalPsychiatry.1992;31(9):909-918.doi:10.1016/0006-3223(92)90117-I.

2. MacLeodJW,LawrenceMA,McConnellMM,EskesGA,KleinRM,ShoreDI.AppraisingtheANT:PsychometricandTheoreticalConsiderationsoftheAttentionNetworkTest.Neuropsychology.2010;24(5):637-651.doi:10.1037/a0019803.

3. GoldJM,FullerRL,RobinsonBM,BraunEL,LuckSJ.Impairedtop–downcontrolofvisualsearchinschizophrenia.SchizophreniaResearch.2007;94(1-3):148-155.doi:10.1016/j.schres.2007.04.023.

4. MathisKI,WynnJK,BreitmeyerB,NuechterleinKH,GreenMF.Theattentionalblinkinschizophrenia:Isolatingtheperception/attentioninterface.JournalofPsychiatricResearch.2011;45(10):1346-1351.doi:10.1016/j.jpsychires.2011.04.002.

5. NuechterleinKH,PASHLERHE,SUBOTNIKKL.Translatingbasicattentionalparadigmstoschizophreniaresearch:Reconsideringthenatureofthedeficits.Developmentand

Psychopathology.2006;18(03):831-851.doi:10.1017/S095457940606041X.6. BarchDM,CarterCC,DakinSC,etal.TheClinicalTranslationofaMeasureofGain

Control:TheContrast-ContrastEffectTask.SchizophrBull.November2011:sbr154.doi:10.1093/schbul/sbr154.

7. SmallwoodJ,SchoolerJW.TheScienceofMindWandering:EmpiricallyNavigatingtheStreamofConsciousness.http://dxdoiorg/101146/annurev-psych-010814-015331.January2015.doi:10.1146/annurev-psych-010814-015331.

8. StraussME,McLouthCJ,BarchDM,etal.TemporalStabilityandModeratingEffectsofAgeandSexonCNTRaCSTaskPerformance.SchizophrBull.2014;40(4):835-844.doi:10.1093/schbul/sbt089.

9. SilversteinSM,KeaneBP,BarchDM,etal.OptimizationandValidationofaVisualIntegrationTestforSchizophreniaResearch.SchizophrBull.2011;38(1):sbr141–134.doi:10.1093/schbul/sbr141.

10. RaglandJD,RanganathC,BarchDM,etal.RelationalandItem-SpecificEncoding(RISE):TaskDevelopmentandPsychometricCharacteristics.SchizophrBull.2012;38(1):114-124.doi:10.1093/schbul/sbr146.

11. SheffieldJM,GoldJM,StraussME,etal.Commonandspecificcognitivedeficitsinschizophrenia:relationshipstofunction.CognAffectBehavNeurosci.2014;14(1):161-174.doi:10.3758/s13415-013-0211-5.

12. SchlichtingML,ZeithamovaD,PrestonAR.CA1subfieldcontributionstomemory

BehavioralAssessmentMethodsforRDoCConstructs

93

integrationandinference.Hippocampus.2014;24(10):1248-1260.doi:10.1002/hipo.22310.

13. BakkerA,KirwanCB,MillerM,StarkCEL.PatternSeparationintheHumanHippocampalCA3andDentateGyrus.Science.2008;319(5870):1640-1642.doi:10.1126/science.1152882.

14. BoucherL,PalmeriTJ,LoganGD,SchallJD.Inhibitorycontrolinmindandbrain:Aninteractiveracemodelofcountermandingsaccades.PsychologicalReview.2007;114(2):376.doi:10.1037/0033-295X.114.2.376.

15. LuijtenM,MachielsenMWJ,VeltmanDJ,HesterR,HaanLde,FrankenIHA.SystematicreviewofERPandfMRIstudiesinvestigatinginhibitorycontrolanderrorprocessinginpeoplewithsubstancedependenceandbehaviouraladdictions.169.2014.doi:10.1503/jpn.130052.

16. Lopez-GarciaP,LeshTA,SaloT,etal.Theneuralcircuitrysupportinggoalmaintenanceduringcognitivecontrol:acomparisonofexpectancyAX-CPTanddotprobeexpectancyparadigms.CognAffectBehavNeurosci.2015;16(1):164-175.doi:10.3758/s13415-015-0384-1.

17. HendersonD,PoppeAB,BarchDM,etal.OptimizationofaGoalMaintenanceTaskforUseinClinicalApplications.SchizophrBull.2012;38(1):104-113.doi:10.1093/schbul/sbr172.

18. SnitzBE,MacDonaldAIII,CohenJD.Lateralandmedialhypofrontalityinfirst-episodeschizophrenia:functionalactivityinamedication-naivestateandeffectsofshort-termatypicalantipsychotictreatment.AmericanJournalof….2005.

19. SolomonM,OzonoffSJ,CummingsN,CarterCS.Cognitivecontrolinautismspectrumdisorders.InternationalJournalofDevelopmentalNeuroscience.2008;26(2):239-247.doi:10.1016/j.ijdevneu.2007.11.001.

20. SolomonM,OzonoffSJ,UrsuS,etal.Theneuralsubstratesofcognitivecontroldeficitsinautismspectrumdisorders.Neuropsychologia.2009;47(12):2515-2526.doi:10.1016/j.neuropsychologia.2009.04.019.

21. ClaysonPE,LarsonMJ.Psychometricpropertiesofconflictmonitoringandconflictadaptationindices:ResponsetimeandconflictN2event-relatedpotentials.Psychophysiology.2013;50(12):1209-1219.doi:10.1111/psyp.12138.

22. MullaneJC,CorkumPV,KleinRM,McLaughlinE.InterferenceControlinChildrenwithandwithoutADHD:ASystematicReviewofFlankerandSimonTaskPerformance.ChildNeuropsychology.June2009.doi:10.1080/09297040802348028.

23. KernsJG,CohenJD,MacDonaldAW,ChoRY,StengerVA,CarterCS.AnteriorCingulateConflictMonitoringandAdjustmentsinControl.Science.2004;303(5660):1023-1026.doi:10.1126/science.1089910.

24. BarchDM,MooreH,NeeDE,ManoachDS,LuckSJ.CNTRICSImagingBiomarkersSelection:WorkingMemory.SchizophrBull.November2011:sbr160.doi:10.1093/schbul/sbr160.

25. JonidesJ,SchumacherEH,SmithEE,etal.VerbalWorkingMemoryLoadAffectsRegionalBrainActivationasMeasuredbyPET.http://dxdoiorg/101162/jocn199794462.January2008.doi:10.1162/jocn.1997.9.4.462.

26. GillettR.AssessmentofWorkingMemoryPerformanceinSelf-OrderedSelectionTests.

BehavioralAssessmentMethodsforRDoCConstructs

94

Cortex.2007;43(8):1047-1056.doi:10.1016/S0010-9452(08)70702-0.27. HorwitzB,TagametsMA.Predictinghumanfunctionalmapswithneuralnetmodeling.

Humanbrainmapping.1999.28. NelsonJK,Reuter-LorenzPA,SylvesterC-YC,JonidesJ,SmithEE.Dissociableneural

mechanismsunderlyingresponse-basedandfamiliarity-basedconflictinworkingmemory.PNAS.2003;100(19):11171-11175.doi:10.1073/pnas.1334125100.

29. EgelandJ.MeasuringWorkingMemoryWithDigitSpanandtheLetter-NumberSequencingSubtestsFromtheWAIS-IV:TooLowManipulationLoadandRiskforUnderestimatingModalityEffects.AppliedNeuropsychology:Adult.2015;22(6):445-451.doi:10.1080/23279095.2014.992069.

BehavioralAssessmentMethodsforRDoCConstructs

95

SystemsforSocialProcessesFinalReport

JedElison,Ph.D.,WilliamHoran,Ph.D.,JamesMorris,Ph.D.LynnPaul,Ph.D.,KevinPelphrey,Ph.D.(chair)

I.GENERALCOMMENTSWeselectedasetofbehavioralperformance,self-reportandparadigmstoassayvarioussocialprocessesdescribedintheRDOCmatrix.Ourgoalwastoidentifythebest,currentlyavailable,tasks.Wealsosoughttoidentifyareaswhereadditionalresearchisneededinordertofurtherdeveloptasks.Themajorityoftasks,evenifconsideredthebestavailableoptions,areinneedofadditionalworktosupporttheiruseacrossRDoCprojects.Inparticular,allofthetasksweidentifiedneedadditionalrefinement(e.g.,psychometricproperties,norms)foruseacrosspediatric,adolescent,andadulthealthy/clinicalpopulations,aswellasthedevelopmentofnormativegrowthcurvesforthetypicaldevelopmentoftargetedneuralsystems.Onvirtuallyeveryparadigm,task,self-reportwerecommendmoreresearchtoestablishpsychometricproperties,norms,growthchartsoflongitudinaldevelopmentalchanges,developmentofage-appropriateparadigmsandapplicationtoclinicalgroups.

II.ORGANIZATIONOFTHEDOMAINWerecommendadditionalworkspecificallyonthefollowingissues/constructs/tasks:

• AffiliationConstruct–Thefieldneedsdevelopmentofmethodstoassessreciprocaldyadicinteractionofestablisheddyads(parent-child;spouses)anddyadicinteractionofanindividualandstranger.

• ConsiderRejectionSensitivityandSocialMotivationaskeysubconstructsunderAttachmentandAffiliationintheRDOCmatrix.

• TheconstructofSocialCommunicationInitiation(Faces)needsdevelopmentofbothmethodsofelicitingemotionsandmethodsformeasuringfacialexpression(thelatterisripefordevelopmentofnewtechnology).

• ForthebroaderconstructofSocialCommunication(i.e.notface-specific),thereisasignificantneedfordevelopmentoftechniques/instrumentsthatcapturethedimensionalityoffunctioningacrossthelifespanandpopulationsandinstrumentsthatoptimizeecologicalvalidity.

• TheconstructofUnderstandingMentalStatesneedsworkfocusedontaxonomyandtaskdevelopmentparticularlyathigherlevelsofcomplexity(inference,irony).

• Affective/SocialTouch–Studiesareneededtofurtherdevelopourunderstandingofthisimportantaspectofsocialcognition.

• Theover-representationofpsychodynamically-inspiredattachmentparadigms(e.g.strange-situation)wasconcerningbecauseofthegenerallackofsupportforthefoundationaltenetsofpsychodynamictheory.Thisistasksandparadigmsemergingfromthetheorychallenging,astheytendtolinkdirectlytoo,andreifythetheoreticalclaims.

BehavioralAssessmentMethodsforRDoCConstructs

96

III.RECOMMENDEDTASKSAssessmentofMeasures:Weevaluatedaseriesofparadigmsundereachoftheconstructs,andratedaselectionofthemostpromisingofthesetasks.OurratingscanbefoundbelowinAppendixSSP-I.Aquestionmarkindicatesalackofknowledge/dataforthecriteria,andthusanopportunityforadditionalresearch.Ratingthetaskimpliesthatwearerecommendingthistaskasthecurrentbestoption(eventhoughsomearestillquitepooroptions).

A. AFFILIATIONANDATTACHMENT:NONE

RejectionSensitivity(newproposedsubconstructunderAffiliationandAttachment):

Cyberballisthestate-of-the-artparadigmforthemeasurementofRejectionSensitivity.Butitneedsdevelopmentinordertomakeitusefulasabehavioralmeasure.

• Recentmeta-analysis1provideextensiveinformationaboutthistask.• Thistaskhasbeenusedinarepeatedconfiguration(essentialforlongitudinal

studies)andfindingsindicatedgoodrepeatability2butthismaydifferbysubjectcohort.o Thereneedstobemoreworkontest-retestreliabilityacrosssubjectgroups

andstudiesofdevelopmentinchildrenandadolescents.o ThemostconsistentoutcomesinCyberballaremeasuredviafMRI,with

limiteddimensionalityofbehavioraloutcomeo Elementsofthetaskcanbestandardizedbutthusfar,thetasksarequite

variable.o Weneedworkcomparingbehavioraloutcomeparadigmsandestablishinga

standardizedbehavioralimplementationofCyberball.

SocialMotivation–Approach/Avoidance–(newproposedsubconstructsunderAttachmentandAffiliation):

WerecommendtheOne-ArmBanditTask3asameasureofsocialmotivation–i.e.,toapproachsocialrewardoravoidsocialpunishment/threat.Thisparadigmmeasureslearninginresponsesocialfeedback(happyvs.angryfacestimuli).

• Thistaskhasn’tbeenusedwidelyyetsoneedsmoreresearchtoestablishpsychometricproperties,norms,developmentofage-appropriateparadigmsandapplicationtoclinicalgroups.

WerecommendtheMultidimensionalScaleofPerceivedSocialSupport(MSPS)4Questionnaire

• TheMSPShasbeenusedwithvariouspopulations(4ethnicgroups)andthereliabilityofmeasurehasbeenreporteddowntoage35.Ithasgooddimensionalityandmeasuresmeasuresstate,butneedsworkontest-retestreliability.

B. SOCIALCOMMUNICATION

ReceptionofFacialCommunication

BehavioralAssessmentMethodsforRDoCConstructs

97

• Facialemotion(staticfaces):TheER40-PennEmotionRecognitionTest6isrecommended.

• Jointattention:TheGazeCuingtask7isthecurrentgoldstandard.Thetaskiswellestablishedbutnotwellstandardized.Theeffectisclear,butthetaskneedsmoreworkonstandardizationandthedevelopmentofnorms.

ProductionofFacialCommunication:NONEarereadyfor“prime-time”.

Non-FacialCommunication(MergedPerceptionandInitiation)

• WerecommendchangingtheRDOCmatrixtomergeperceptionandinitiation.• Thisareaisripefordevelopmentusingtechnology.• WerecommendtheSocialResponsivenessScale8asaquestionnaire.Thisisa

psychometricallyrobustmeasureforvariousages.Ithasgooddimensionalityacrossthewholepopulation.Itmeasuresaconstructthatisnotstatic(e.g.weight).Itisnotabehavioralperformancemeasure,however.Insteaditisareportcompletedbyacloseother(e.g.,spouseorparent).

• WerecommendtheTASIT19formeasuringtheperceptionofemotionspresentedthroughmultiplemodalities:.

• Therewasextensivediscussionaboutthesubcategoriesanddifficultygroupingtopics:vocalparalinguistic(e.g.pace,prosody,pitch,volume);interpersonalfeatures(e.g.turn-taking,proxemics).Thisareaneedsextensivedevelopment;specificallyrelatedtoinstrumentsthatcapturedimensionalityoffunctioningacrossagerangeandpopulationsandinstrumentsthatoptimizeecologicalvalidity.

C. PERCEPTIONANDUNDERSTANDINGOFSELF

Self-Knowledge

• WerecommendtheSelf-ReferentialMemory10task.TasksofthiskindhavebeenusedmostlyinfMRI&ERPparadigms.However,theysufferasbehavioraltasksbecauseoftheabsenceofclearbehavioraldatafromtheseparadigms.

D. PERCEPTIONANDUNDERSTANDINGOFOTHERSAnimacyPerception

• Thecurrentgold-standardforthemeasurementofAnimacyPerceptionisPoint-LightDisplaysofBiologicalMotion11.Thisparadigmneedsworkonstandardizationoftasks,andcreationofnormativedata,includinggrowthcurvesofdevelopmentofbrainmechanismsfortheperceptionofbiologicalmotion.

• WealsonotedtheuseofAnimations(e.g.Castelligoal-directedversions12)aspromising,butinneedofstandardization.

ActionPerception

• WediscussedtheHowofWhy/HowTask13

(http://www.bobspunt.com/whyhowlocalizer),notingitneeddevelopmentacrossmanydomains,butrecommendingthistaskasthebestavailablecurrently.

BehavioralAssessmentMethodsforRDoCConstructs

98

• Simpleimitationtaskshavebeenemployed,butthesearenormallyusedasabrainmeasurewithceilingofbehavioralperformance.

• Similarly,forActionPerception,especiallyintermsofactionstowardsgoals,weknowofextensiveneuroimagingwork,butintheabsenceofaclearbehavioraltask.

UnderstandingMentalStates

• Logical/PhysicalPerspectiveTaking(e.g.FalseBelief,HintingTask,StoriesfromEverydayLife).WerecommendtheHintingTask14asacurrentbestoption.

• Mental/EmotionalPerspectiveTaking(e.g.EmpathicAccuracy,FalseBelief,TASIT2&3,ReadingMindintheEyes15).WerecommendthereadingReadingtheMindin

theEyesTaskasacurrentbestoption.

IV.TASKSTHATREQUIREFURTHEREVALUATIONSelf-Knowledge

• WediscussedSelf-Relevantprocessing(e.g.Self-ReferentialMemory10).WenotedthesetaskshavebeenusedmostlyinfMRI&ERPparadigms.Assuch,theysufferasbehavioraltasksbecauseoftheabsenceofclearbehavioraldatafromtheseparadigms.

• WediscussedIdentificationofownemotionalstates(e.g.TAS-20).• WeconsideredRealityTesting(e.g.sourcememoryparadigms).• WediscussedthecomparisonofSelfandOtherratingsofsocially-relevantfunctions

(BRIEF,ABAS).

ProductionofFacialCommunication:NONE

• Spontaneousfacialemotiongeneration:Thereisnotastandardizedparadigmforelicitingfacialemotion(forexamples,see16,17).TherearevariousmethodsformeasurementsuchasFACS(http://www.paulekman.com/facs/orFACES(socrates.berkeley.edu/~akring/FACES%20manual.pdf),plusEMG.Weneeddevelopmentofstandardizedmethodsforelicitingemotionandsimplifiedsystemsformeasuringfacialexpression.

• Mimicry/imitationofemotionalexpression:Weneeddevelopmentofstandardizedmethodsforelicitingimitation/mimicryandsimplifiedsystemsformeasuringfacialexpression.

• Jointattention:ThereareseveralexcellentresearcherswhohaveemphasizedthisareainchildrenincludingPeterMundyandMichaelTomasello.Thisisaveryimportantconstructthatishasbeendevelopedforages9-24months,butitneedsdevelopmentandmeasurementtheforentirerelevantagerange,includingmodificationoftheconstructtoinclude,perhaps,jointintentions,intentionsharinginolderchildrenandevenadults.

• Wenotedthattheareaofmeta-cognitionofperformanceneedsdevelopment.

BehavioralAssessmentMethodsforRDoCConstructs

99

V.TASKSTHATARENOTRECOMMENDEDWereviewedthetaskscurrentlysuggestedintheRDOCmatrix.Fromthisreview,werecommendeliminatingfromthematrixthe:1)separation-reunion(e.g.,StrangeSituation);2)StillFace;and3)FordCorollaryDischargeparadigms.Separation-reunionparadigmsarelimitedbyaninherentrelianceonaparticularsetoftheoreticalassumptions(i.e.,attachment-theory)thatarewidelydebated.TheStillFaceparadigmisveryspecifictoonedevelopmentalepochandhaslittlepredictiveutility.TheFordparadigmdoesnotutilizeabehavioraloutput,andisthusoflimiteduse.Thisrecommendationisnotmeanttoimplythatweendorsealltherestofthetaskslistedinthematrixinthesocialdomain—onlythatweidentifiedparticularlysignificantproblemswiththeoneswerecommendhereforremoval.

WediscussedbutexcludedfromfurtherconsiderationtheSocialNetworkIndex18.Ontheonehand,thisisn’tabehavioralperformancemeasure,makingitlesswellsuitedfortheRDOCapproach.However,thismeasureisassociatedwithamygdalavolume19.Wediscussedtheuseofthismeasuretoassessaffiliation,butdecidednottorecommendthistaskbecauseitisanindexofsocialoutcomesthatareinformedbymultipleprocesses.

References1. HartgerinkCHJ,vanBeestI,WichertsJM,WilliamsKD.TheOrdinalEffectsofOstracism:

AMeta-Analysisof120CyberballStudies.VanYperenNW,ed.PLOSONE.2015;10(5):e0127002.doi:10.1371/journal.pone.0127002.

2. BollingDZ,PitskelNB,DeenB,etal.Dissociablebrainmechanismsforprocessingsocialexclusionandruleviolation.NeuroImage.2011;54(3):2462-2471.doi:10.1016/j.neuroimage.2010.10.049.

3. LinA,AdolphsR,RangelA.Socialandmonetaryrewardlearningengageoverlappingneuralsubstrates.SocCognAffectNeurosci.2012;7(3):274-281.doi:10.1093/scan/nsr006.

4. ZimetGD,DahlemNW,ZimetSG,FarleyGK.Themultidimensionalscaleofperceivedsocialsupport.Journalofpersonalityassessment.1988;52(1):30-41.

5. BruwerB,EmsleyR,KiddM,LochnerC,SeedatS.PsychometricpropertiesoftheMultidimensionalScaleofPerceivedSocialSupportinyouth.ComprehensivePsychiatry.2008;49(2):195-201.doi:10.1016/j.comppsych.2007.09.002.

6. ErwinRJ,GurRC,GurRE,SkolnickB,Mawhinney-HeeM,SmailisJ.Facialemotiondiscrimination:I.Taskconstructionandbehavioralfindingsinnormalsubjects.PsychiatryResearch.1992;42(3):231-240.doi:10.1016/0165-1781(92)90115-J.

7. FriesenCK,KingstoneA.Theeyeshaveit!Reflexiveorientingistriggeredbynonpredictivegaze.PsychonomicBulletin&Review.1998;5(3):490-495.doi:10.3758/BF03208827.

8. ConstantinoJN,DavisSA,ToddRD,etal.ValidationofaBriefQuantitativeMeasureofAutisticTraits:ComparisonoftheSocialResponsivenessScalewiththeAutismDiagnosticInterview-Revised.JAutismDevDisord.2003;33(4):427-433.doi:10.1023/A:1025014929212.

9. McDonaldS,FlanaganS,RollinsJ,KinchJ.TASIT:ANewClinicalToolforAssessingSocialPerceptionAfterTraumaticBrainInjury.TheJournalofHeadTraumaRehabilitation.

BehavioralAssessmentMethodsforRDoCConstructs

100

2003;18(3):219.10. KelleyWM,MacraeCN,WylandCL,CaglarS,InatiS,HeathertonTF.FindingtheSelf?An

Event-RelatedfMRIStudy.http://dxdoiorg/101162/08989290260138672.March2006.doi:10.1162/08989290260138672.

11. BjörnsdotterM,WangN,PelphreyK,KaiserMD.EvaluationofQuantifiedSocialPerceptionCircuitActivityasaNeurobiologicalMarkerofAutismSpectrumDisorder.JAMAPsychiatry.2016;73(6):614-621.doi:10.1001/jamapsychiatry.2016.0219.

12. CastelliF,FrithC,HappéF,FrithU.Autism,Aspergersyndromeandbrainmechanismsfortheattributionofmentalstatestoanimatedshapes.Brain.2002;125(8):1839-1849.doi:10.1093/brain/awf189.

13. SpuntRP,AdolphsR.ValidatingtheWhy/HowcontrastforfunctionalMRIstudiesofTheoryofMind.NeuroImage.2014;99:301-311.doi:10.1016/j.neuroimage.2014.05.023.

14. CorcoranR,FrithCD.Autobiographicalmemoryandtheoryofmind:Evidenceofarelationshipinschizophrenia.PsychologicalMedicine.2003;33(5):897-905.doi:10.1017/S0033291703007529.

15. VellanteM,Baron-CohenS,MelisM,etal.The“ReadingtheMindintheEyes”test:SystematicreviewofpsychometricpropertiesandavalidationstudyinItaly.CognitiveNeuropsychiatry.July2013.doi:10.1080/13546805.2012.721728.

16. GrossJJ,LevensonRW.Emotionelicitationusingfilms.Cognition&Emotion.January2008.doi:10.1080/02699939508408966.

17. LangPJ,BradleyMM,CuthbertBN.Internationalaffectivepicturesystem(IAPS):Affectiveratingsofpicturesandinstructionmanual.TechnicalreportA-8.2008.

18. CohenS,DoyleWJ,SkonerDP,RabinBS,GwaltneyJM.SocialTiesandSusceptibilitytotheCommonCold-Reply.JAMA.1997;278(15):1232-1232.doi:10.1001/jama.1997.03550150036020.

19. BickartKC,WrightCI,DautoffRJ,DickersonBC,BarrettLF.AmygdalaVolumeandSocialNetworkSizeinHumans.Natureneuroscience.2011;14(2):163.doi:10.1038/nn.2724.

BehavioralAssessmentMethodsforRDoCConstructs

101

AppendixSSP-I:Ratingsforrecommendedtasksontaskcriteria

Criteria(Rateeachonascaleof1-5,with1=doesnotdoagoodjobofmeetingthecriterion;

5=doesanexcellentjobmeetingthecriterion

Construct

Task

ValidM

easure

ofCon

struct

Test-Retest

Reliability

Floo

r/Ce

iling/

dimen

sion

ality

PracticeEffects

Longitud

inal

Stab

ility

Sensitiveto

w/inpe

rson

chan

ge

Stan

dardized

Pa

rameters

Canitbeused

acrossm

any

sites?

Canitbeused

withkidsor

special

popu

lation

s?

Arenormative

dataavailable?

Arerelationsto

clinicalfe

atures

know

n?

Not

copyrighted?

AttachmentandAffiliation

1.Directbrainandbehaviormeasuresofrejectionsensitivity(Cyberball,ChatRoom)

2.SocialMotivation–Approach/Avoidance(e.g.,SocialIncentiveDelayTask;DotProbe/AttentionBias;One-Armed-BanditTaskandotherneuroeconomicstasks)

3.Selfreportofneedforaffiliation/rejectionsensitivity(MultidimensionalScaleofPerceived

5

4

5

?

?

?

2

4

5

3

4

NA

?

?

?

?

?

?

2

5

5

5

5

5

5

3

4

3

?

4

3

?

?

5

5

5

BehavioralAssessmentMethodsforRDoCConstructs

102

SocialSupport;AnhedoniaScale;RejectionSensitivityScale;AffiliationTendencyScale)

SocialCommunication

ReceptionofFacialCommunication

Jointattention,responding(gazecuing);

FacialEmotion(facescanpaths;ER40)

5

5

?

4

5

4

5

5

?

3

?

?

1

5

5

5

5

5

?

4

3

4

5

5

ProductionofFacialCommunication

Jointattention,initiating

Initiateemotionalexpression(EMG/FACS/FACESwithprovocativecontext–IAPS/AffectiveComputing)

Mimicry/Imitateemotionalexpression(FACScoding/EMG

?

?

?

?

?

?

?

?

?

?

?

?

?

?

?

?

?

?

?

?

?

?

?

?

4

?

?

?

?

?

?

?

?

5

?

5

ReceptionofNon-FacialCommunication

SocialResponsivenessScale(SRS)

3

5

5

NA

5

4

5

\

5

5

5

5

2

BehavioralAssessmentMethodsforRDoCConstructs

103

MultimodalSocialPragmatics(e.g.,vocal:pace,prosody,pitch,;turn-taking,distance,touch,gestures;BLERT;TASIT1;CASL-PL)

? ? ? ? ? ? ? ? ? ? ? ?

PerceptionandUnderstandingofSelf

Agency Illusionsofwill(rubberhand)

JoystickManipulation(decouplingmotorandsensoryfeedback)

Measureofsenseofcontrol

? ? ? ? ? ? ? ? ? ? ? ?

Self-Knowledge Self-ReferentialMemoryParadigm

Self-referentialeffect

BRIEF,ABAS–selfvs.otherratingofknowledgeofself

Identifyownemotionalstates

Realitymonitoring

4 3 4 4 3 ? 4 5 5 ? 3 5

BehavioralAssessmentMethodsforRDoCConstructs

104

PerceptionandUnderstandingofOthers

Animacyperception

Pointlightdisplaysofbiologicalmotion

HeiderandSimmeltypefilms(goal-directed)

5 3 4 3 3 4 3 5 5 3 5 5

ActionPerception

HowpartoftheHow/WhyTask(BobSpunt)

Imitation(fingertapping)

Contagion(yawning)

Actionobservation–goaldirectedactions

5 ? ? ? ? ? 5 5 5 ? ? 5

UnderstandingMentalStates

Logical/PhysicalPerspectivetaking(e.g.,HintingTask,FalseBelief,StoriesfromEverydayLife)

Mental/EmotionalPerspectiveTaking(e.g.,ReadingtheMindintheEyes,FalseBelief,EmpathicAccuracyParadigm,TASITparts2&3)

4

3

4

2

4

4

4

4

4

5

3

3

5

5

5

3

4

?

3

4

5

5

5

BehavioralAssessmentMethodsforRDoCConstructs

105

ArousalandRegulatorySystemsFinalReport

TheodoreP.Beauchaine,RuthM.Benca,DavidBrent,AndrewKrystal,DaraManoach(chair),UmaVaidyanathan

ThisreportsummarizesthemeetingoftheArousalandRegulatorySystems(ARS)subgroupoftheNationalAdvisoryMentalHealthCouncilWorkgroup,whichwasestablishedbytheNationalInstituteofMentalHealth(NIMH)todevelop“alistofrecommendedtasksforeachRDoCconstructincludedintheRDoCmatrix”.TheARSsubgroupwaschargedwithdevelopingalistoftasksforthethreeconstructsintheArousalandRegulatorySystemsdomain:(1)arousal,(2)sleep-wakefulnesssand(3)circadianrhythms.Arousal/regulatorysystemsaredefinedintheRDoCmatrixas,“…responsibleforgeneratingactivationofneuralsystemsasappropriateforvariouscontexts,andprovidingappropriatehomeostaticregulationofsuchsystemsasenergybalanceandsleep(http://www.nimh.nih.gov/research-priorities/rdoc/constructs/arousal-and-regulatory-systems.shtml,June20th,2016).Sinceeffortful/activeformsofbehaviorregulationandemotionregulationarenotsubsumedwithinthisdefinition,theywerenotconsidered.Thus,theARSsubgroupworkeddirectlyfromconstructsalreadylistedintheRDoCmatrix(http://www.nimh.nih.gov/research-priorities/rdoc/constructs/rdoc-matrix.shtml),withoutrevisingoreditingthoseconstructs.

CONSTRUCT:AROUSAL

GENERALISSUES:ThetaskofrecommendingparadigmstoassessarousalpresentedtheARSsubgroupwithanumberofchallenges.Arousalisnotwell-definedintheRDoCmatrix,perhapsbecausethetermhashistoricalrootsthatcutacrossconstructsincludingorienting,vigilance,attention,motivation,traitandstateanxiety,stressresponding,andcoping,amongothers.Theseconstructsaresubservedbyawidearrayofneurobiologicalprocessesandfunctions,somecortical,somesubcortical,andsomeperipheral.Theseneurobiologicalprocessesandfunctionsarefacilitated/regulatedbymultiplemonoamineandneuroendocrinesystemsthataredistributedacrossdiversebrainregions.Evensinglemonoamineneurotransmitters(e.g.,dopamine)canbesubdividedintoseparatesystems(e.g.,mesocortical,tuberoinfundibular)thatareimplicatedindistinctarousalfunctions(attention,sleep).Giventhesecomplexities,andthetendencyofwhatwethinkofasdistinctpsychologicalfunctionstobewidelydistributedacrossneuralnetworks,itmaynotbepossibletodefinearousalas“…distinctfrommotivationandvalence…”,asoutlinedintheRDoCmatrix(http://www.nimh.nih.gov/research-priorities/rdoc/constructs/arousal.shtml).

Thisaboveparagraphillustrateswhymanycontemporarypsychophysiologistsavoidthetermarousalaltogether.Thatsaid,thereisconsiderablepsychophysiologicalresearchonconstructs,suchasthoselistedabove,thatcanbeconstruedasrelatedtoarousal.Historically,muchofthisworkwasconductedattheautonomicnervoussystem(ANS)level.Morerecently,electroencephalography(EEG)andfunctionalneuroimaging(e.g.,fMRI)havebeenused..Validself-reportmeasuresarelacking,butwouldbevaluabletodevelop.

MEASUREMENTISSUES:Mostofthemeasuresconsidereddidnothaveagreeduponstandardsforadministrationoranalysisandallwouldbenefitfromnormativedata.Allarescalabletovaryingdegrees.Alltaskscanbeaffectedbymultiplefactors,manyofwhichcrossintootherRDoCdomains(negativeandpositivevalence,cognition).Allrequiretightlycontrolledexperimentalconditionsforreliableandexternallyvalidassessment.

BehavioralAssessmentMethodsforRDoCConstructs

106

AUTONOMICMEASURESOFAROUSAL

Mostautonomicmeasures,includingheartrate(HR),bloodpressure,andpupildiameter,areaffectedbyboththesympatheticandparasympatheticnervoussystems(SNS,PNS)1.Thisisproblematicwhenattemptingtoparserelativecontributionsofbottom-up,largelysubcortical,emotiongenerationsystemsfromtop-down,largelycortical,emotionregulationsystems(e.g.,prefrontal)2.Excitatorysympatheticefferenceisabetterindexofarousal,whereasinhibitoryparasympatheticefferenceisabetterindexofregulation3.HRcannotbeusedtocaptureeitherconstructbecauseitisrepresentedintwo-dimensionalspace,withSNSactivation(lowtohigh)ononeaxisandPNSactivation(lowtohigh)ontheotheraxis4.Thus,analmostunlimitednumberofSNSandPNScombinationscanresultinasingleHRvalue.Forthesereasonsandothers(bothfunctionalandanatomical),cardiacpre-ejectionperiod(PEP;assessedusingimpedancecardiography),anoninvasiveindexofSNSactivation(givenappropriatestimulusconditions),isabetterindexofarousal.PEPshortening,whichreflectsincreasedSNSactivation,isobservedreliablyduringstress-andemotion-inductiontasks,includingpublicspeakingandotherparadigmsinwhichone’sperformanceisevaluatedbyoutsideobservers5,6.

RECOMMENDEDMEASURE1:HEARTRATEVARIABILITY

Capturesbotharousalandregulation.Underappropriatestimulusconditions,highfrequencyheartratevariability(HRV,>.15Hzamongadults)assessesPNSefferencetotheheart7.AlthoughreductionsinHRVareobservedindisorderswherearousalisimplicatedinsymptomexpression(e.g.,panic,phobias,andotheranxietydisorders;non-suicidalself-injury;hostility),suchreductionsinHRVareinnowayspecificto‘disordersofarousal’.Infact,lowrestingHRVand/orexcessivereductionsinHRVduringemotionevocationarealsoobservedamongthosewithattentionproblems,autism,callousunemotionaltraits,conductdisorder,executivefunctiondifficulties,psychopathy,andschizophrenia2.StrongargumentshavebeenmadethatHRVisaperipheralindexofemotionregulatoryprocessesthatareaffectedbyprefrontalmechanisms.Thus,SNSmeasuresarelikelybetterindicesofarousal(particularlyduringsocialevaluation),whereasHRVislikelyabetterindexofregulation(particularlyduringemotionevocation).

• Reliability:SeveralstudieshaveevaluatedreliabilityofHRVmeasures8-12.Ingeneral,reliabilityisgoodforbothrestingstatemeasuresandtaskmeasures,whensuchtasksaretightlycontrolled(e.g.,welltrainedadministrator,nomovement,thesametaskusedacrossassessmentpoints),andwhenspectralanalysisisused.CleardevelopmentalincreasesinHRVareobserved,whichareobscuredwhenage-appropriaterespiratoryfrequenciesarenotusedwhenspectralanalyzingR-Rtimeseries.Perhapsunsurprisingly,reliabilityispoorwhendifferenttasksareusedtoevokeHRVreactivityatdifferenttimepoints.

• Norms:Althoughwell-establishednormsexistforrestingHRV,nosuchnormsexistforHRVreactivity,largelybecausetherearenoestablishedreactivitytasks13,14.Thisisproblematicgiventhatarousalislargelyaconstructofreactivity.However,reactivitydependsonanumberoffactorsthataredifficulttostandardize,includingageandothercomponentsoftheRDoCmatrix(seeabove),age,physicalfitness,individualdifferencesinexecutivefunction,andcardiovascularhealth,tonamebutafew.

• Otherpopulations:Therehasbeensomeworkdoneonpopulationsincludingchildren,adolescents,olderadults1,9,12,15-18.

BehavioralAssessmentMethodsforRDoCConstructs

107

• Genetics,heritabilityandmoleculeshavealsobeenexplored19-22.• Braincircuitrycorrelates:AsrecentlyreviewedbyBeauchaineandThayer2,extensive

neuroimagingstudiesusingPET,SPECT,andMRIindicatethatHRVfallsundercontrolofaninterconnectedcorticalandsubcorticalnetwork,includingefferentpathwaysfromthemedialprefrontalcortextothePNS.Throughthisnetwork,theprefrontalcortexprovidestop-downinhibitorycontroloversubcorticalandbrainstemsystemsthatregulateautonomicfunction23-25.AlteredfunctionofthisPFCnetworkisobservedacrossawiderangeofpsychopathologies26,27.

• Useinclinicaltrials(yogaRCTs,openCBTtrials,emotionalregulationtraining)28-32.Clinicaltrialsconductedtodateamongchildren,adolescents,andadultsindicatethatbothrestingstateHRVandHRVreactivityimproveinresponsetoclinicalinterventionsforseveralformsofpsychopathology.Thesechangescorrelatewithimprovedemotionregulationcapabilities.Anumberofadditionalclinicaltrialsareunderway.

• Clinicalcorrelates(depression,bipolar,schizophrenia)17,33,34.ClinicalcorrelatesoflowrestingstateHRVandexcessiveHRVreactivity(parasympatheticwithdrawal)arewide-rangingandcorrespondwithdifficultieswithemotionregulation.Allofthefollowingpsychiatricdisorders/clinicalsyndromesarecharacterizedbylowrestingstateHRVand/orexcessiveHRVreactivity(forareviewseeBeauchaine&Thayer,2015):anxiety,attentionproblems,autism,callousness,conductdisorder,depression,non-suicidalself-injury,panicdisorder,phobias,traithostility,psychopathy,schizophrenia.

RECOMMENDEDMEASURE2:ElectrodermalResponding

Description:Electrodermalresponding(EDR),alsoknownasgalvanicskinresponseorskinconductance,isagoodperipheralbiomarkeroflowarousalstates/traits,butnotasgoodatdemarcatinghigharousalstates/traits.Ithasbeenusedinstudiesofemotionandcognitionsincetheearly1900sandisthoughttoindexperceivedstimulussignificance35.Itisgenerallymeasuredbyindexingchangesinconductancethatoccurinsweatglandsintheskinafterpassingaweakelectricalcurrentthroughelectrodesplacedonthefingertips.Itdoesnotdifferentiatebetweenaffectivestates,butismoredependentonthearousalvalueofstimulus.Ithasbothtonicandphasiccomponents.Phasiccomponentsaremeasuredasthechangeinconductanceuponpresentationofastimulus,whiletonicresponsesincludeskinconductancelevelandskinconductancelevel(seeBoucsein,201236foracomprehensivereview).Someresearchhasshownthatitcovarieswithamygdalaactivationtoexternalstimuli37.

Measurementissues:EDRshowshighreliability(see38forareview)andbiometricheritability39.However,aswithmanybiomarkers,linkstocandidategeneshaveprovedtenuouswithinitialfindingsnotholdingupinlargersamples.39EDRiseasytomeasureandwearabledevicessuchasEmpaticaareavailablebutareonlynowstartingtobeincorporatedintolargerlab-basedstudies.Aswithotherpsychophysiologicalmeasures,stimulusconditionsareimportantwhenevaluatingwhetherEDRmarksarousal.EDRcovarieswithamygdalaactivationtoexternalstimuliinwell-controlledexperiments.Non-specificfluctuationsintheEDRsignalmaybemoresensitivethanotherindices(e.g.,amplitude,risetime,recoverytime,etc.).Informationonrecordingstandardsandresponserangesisavailable35,40.

BehavioralAssessmentMethodsforRDoCConstructs

108

Clinicalrelevance:DecreasedEDRhasbeenassociatedwithexternalizingdisorderssuchasantisocialbehaviorandalcoholabuse/dependenceconcurrentlyandpredictively41-47.Studiesofschizophreniaaredividedwithabouthalfshowingnoresponsetostimuliduringhabituationparadigms35,48.PTSDisassociatedwithincreasedelectrodermalresponding49,50.

RECOMMENDEDMEASURE3:Pupillometry

Pupillometryreferstothemeasurementofpupildiameter,includingconstrictionanddilation.Thisisaccomplishedusingvideorecordingandeye-tracking.Pupildilationcorrelateswithactivationofnoradrenergicfibersoriginatinginthelocuscoeruleus,whichsupportsuseofpupillometryasanindexofsympatheticnervoussystem(SNS)functionandarousal51,52.However,pupildiameterisalsodeterminedbyPNSinnervation.ItthereforesuffersfromthesameinterpretabilityproblemsasHR(seeabove).Furthermore,pupildilationisassociatedwithaspectsofemotionandcognition,andvariesasafunctionofemotionalsaliency53,taskdifficulty54,andattentiondeployment55.Thus,changesinpupildiameterarenotspecifictoarousal.Undersomecircumstances,pupildilationmaymoreaccuratelytracktemporalaspectsofattentionthanimagingmethodssuchasEEGandfMRI56,55.Althoughpupilsizechangesreflexivelydependingonambientlightconditions,pupillaryresponsesarealsoevokedbymechanismsunrelatedtovisualperception,whichmayormaynotberecognizedconsciously57.

• -Reliability:Alimitednumberofstudieshaveassessedreliabilityofpupillometry.However,existingstudiessuggestgoodtoexcellenttest-retestreliabilityforchangesinpupildiameter,dependingonthetaskusedandthepopulationbeingstudied58.

• -Useinclinicaltrials:Dataonchangesinpupillaryrespondingfollowingtreatmentforpsychopathologyaresparse.However,remissionfollowingcognitivetherapyfordepressionisassociatedwithlowsustainedpupillaryresponsestonegativewords59.

• -Clinicalcorrelates:Pupillometryhasbeenusedmostextensivelyamongchildren,adolescents,andadultswithautismspectrumdisorder.Whileviewingothers’faces,thosewithautismshowpupillaryconstriction,incontrasttotypicaldilatoryresponsesexhibitedbymental-ageandchronological-agematchedcontrols60.Martineauetal.61wereabletodifferentiatechildrenwithautismfrommental-andchronological-agematchedcontrolswith72%accuracybasedonreductionsinpupilsizewhenviewingneutralfaces,virtualfaces,andobjects.Pupildilationmaymarkmoregeneraltendenciestowardanxietyanddepression,atleastincertaincontexts62.Reducedpupildilationtonegativewordsisassociatedwithdepressionseverityandnegativeaffectivity,andwithlowlevelsofpositiveaffectivity63.

RECOMMENDEDMEASURE4:CARDIACPRE-EJECTIONPERIOD

Althoughnotdiscussedatthemeetingbecauseacommitteememberwithexpertisewasnotinattendance,cardiacpre-ejectionperiod(PEP)shouldbeincludedinanydiscussionofputativeautonomicindicesofarousal.PEPisdefinedbythetimeelapsed(ms)between(1)onsetofleftventriculardepolarizationand(2)ejectionofbloodintotheaorta64(seeSherwoodetal.,1990).PharmacologyblockadestudiesindicatethatPEPchangesinresponsetointernalandexternalstimuliaremediatedfullybybeta-adrenergic(SNS)mechanisms65.Wellcontrolledexperiments

BehavioralAssessmentMethodsforRDoCConstructs

109

demonstratePEPshorteningduringheightenedarousalstates,includingthoseinducedbyincentiveresponding,threat,andpsychologicalstress66,67.UnlikeHRVhowever,whichchangesduringtheseconditionsandmanyothers(seeabove),PEPrespondingismuchmorespecific68.

• -Reliability:CardiacPEPdemonstratesadequatetoexcellentinternalconsistencyandtest-retestreliability.Cronbach’salphasduringdifficulttaskswithsocialevaluativecomponents—whichelicitconsiderablearousal—areexcellent69.Furthermore,stabilityofPEPrespondingisobservedacrossintervalsaslongasadecade70.

• -Norms:AsreviewedbyZisnerandBeauchaine1,restingPEPincreasesmonotonicallyasafunctionofagethroughearlyadulthood,afterwhichage-relatedchangesarenegligible71.DevelopmentalnormsforPEPreactivityaremoredifficulttoestablish,sincedifferentlabsusedifferentstimulitoevokePEPresponses.However,researchusingrewardtasksinparticularshowsnoconsistentdifferencesacrosspreschool,middlechildhood,adolescence,andearlyadulthood68,72-74.Incontrast,QuigleyandStifter75reportedgreaterPEPreactivityamongyoungadultsthanamongpreschoolersinresponsetoaseriesofreactiontime,emotionevocation,andinterviewtasks.Thus,consistentwithrecommendationsthroughoutthisreport,stimulusconditionsneedtobeconsideredcarefullywheninterpretingautonomicresponding,andinevaluatingwhetherautonomicresponsesrepresentchangesinarousal(seeabove).

• -Genetics,heritability,molecules:RestingPEP,ambulatoryrecordingsofPEPthroughouttheday,andPEPreactivitytostressaremoderatelytohighlyheritableinadolescenceandmiddleage76,77.FewmoleculargeneticsstudiesspecificallyofPEP/PEPreactivityhavebeenconducted.However,sincePEPchangeiseffectedthroughtheSNSviabeta-adrenergicmechanisms,candidatesincludetheb1-andb2-adrenergicreceptorgenes(ADRB1,ADRB2)78,andothergenesthataffectSNS-linkedcardiovascularreactivity.

• -Braincircuitrycorrelates.SinceSNS-mediatedincreasesincardiacoutputservetofacilitatebehavioralmobilizationtomultiplearousalstates,includingincentiveresponding,threat,andstress,nosingleneuralnetworkisresponsibleforevokingPEPresponses.Duringincentivetasksinparticular,PEPshorteninglikelyoriginatesindopaminergicreactivitywithinthestriatum,whichinitiatesbrainstemrespondingtomobilizeacardiacresponse3,79.Duringconditionsofthreatandstress,PEPrespondingislikelyinitiatedbyother,wellcharacterizedneuralnetworks(e.g.,SAM).

• -Useinclinicaltrials:Todate,PEPhasnotbeenevaluatedinmanyclinicaltrials.However,inarecentRCTofabehavioralinterventionforearly-onsetconductproblems,Beauchaineetal.28(2013)foundmaineffectsofPEPactivityandreactivityontreatmentoutcomes.Althoughsample-wideimprovementsinbehaviorwereobservedatpost-treatment,thosewhoexhibitedlengthenedcardiacPEPatrestandreducedPEPreactivitytoincentivesscoredhigheronmeasuresofconductproblemsandaggressionbothbeforeandaftertreatment.Thisisconsistentwithalowarousalinterpretationofconductproblemsandtreatmentresponse.Moreover,crosssectionalresearchcomparingPEPreactivitytostressamongcurrentlydepressedversusremittedpatientsindicatesbluntedPEPreactivityonlyinthosewhoarecurrentlydepressed80.Thus,PEPreactivitymaybeastatedependentmarkerofclinicaldepression.

BehavioralAssessmentMethodsforRDoCConstructs

110

• -Clinicalcorrelates:Comparedwithcontrols,maleswithADHD,oppositionaldefiantdisorder,conductdisorder,andantisocialpersonalitytraitsexhibiteitherdiminishedPEPreactivitytomonetaryincentives,ornoPEPreactivityatall3.Similarfindingsapplytodepressedindividuals80.PEPnon-reactivitymaythereforemarkattenuatedmesolimbicreactivitytorewardinbothexternalizingbehavioranddepression.DiminishedPEPreactivitytoincentivesalsoprovidesprospectivepredictionofsubstanceuseinitiationandescalationamongmiddle-schoolers81.

Promisingmeasuresrequiringfurtherdevelopment

• ERPsduringsleep(e.g.,oddballparadigm)82• EEGbeta/gamma/thetaactivityduringsleepandwake83

Consideredbutnotrecommended

• HungerVisualAnalogueScale(insufficientdataonproperties)• Heartrate(seeabove)• Interoception(notaprimarymeasureofarousal)• CO2inhalation(usedtotriggeracutefear;negativevalencemeasure)• Startle(moreameasureofreactivitytonegativestimuli)• Bloodpressure(regulationtoocomplex)• Auditorysteadystateresponse(ASSR)measureofgammaband(ReferredtotheCognition

Group)• TrierSocialStressTest,FearFaces,IAPSpictures(Thesestimulievokearousalbutarenot

arousalmeasures)• Cortisolandserum/urinenorepinephrinelevels(insufficientpsychometricvalidity)

COGNITIVEMEASUREOFAROUSAL

RECOMMENDEDMEASURE4:PsychomotorVigilanceTask(PVT)

ThePVTrequiresparticipantstopressabuttonassoonasalightappearsonascreenatrandomintervals.RTandthenumbermissedbuttonpressesarethedependentmeasures.ThePVTrequiressustainedattentionandisthoughttoreflectalertness.Poorperformanceisassociatedwithsleepdeficit84.Performanceisalsoinfluencedbymotivationandcircadianfactors.AdvantagestothePVTarethatithasbeenwellstudied,hassimplemetrics,isbrief,freefromlearningeffectsandeasilyscored.Theanimalversionthathasbeenusedtodetecttheeffectsofsleepdeprivation85.Performancedependsonthebasalforebrain86andcanbedisruptedwithadenosineinfusionproducingbehavioraldeficitsresemblingsleepdeprivation87.

CONSTRUCT:SLEEP-WAKEFULNESS

BehavioralAssessmentMethodsforRDoCConstructs

111

Polysomnography(PSG):Thefirstfourrecommendedmeasuresdependonpolysomnography,thesleepEEG.GeneralissueswithPSGincludescalabilitygiventheexpenseandtimerequiredforsleepstudies.Itremainstobeestablishedunderwhatconditionsanaporhomesleeprecordingscansubstitutefornocturnalsleepinthelab.Scoringandartifactrejectioncanbelaborious,butautomaticmethodsexistandarebeingdeveloped.Scoringandmeasurementofsleeparchitectureandqualityarehighlystandardized.Aminimumoftwosleepsessionsisrecommendedasthefirstsessionisgenerallyconsideredanadaptationnight(ornap)thatacclimatestheparticipanttothesleeplabandrecording.

RECOMMENDEDMEASURES1:Latencytopersistentsleep(LPS),Waketimeaftersleeponset(WASO),TotalSleepTime(TST)88-90

• Theseareallstandardwell-establishedmeasures.• recommendedtwonightminimum

RECOMMENDEDMEASURE2:SleepSpindles(87,96Rechtschaffen&Kales1968;Iberetal.,2007)

Description:SleepspindlesareadefiningoscillationofStage2nonrapideyemovementsleep(N2)seenonPSGas12-15Hzoscillationslasting1to2secondsinawaxingwaningenvelope.SpindlesarealsoseeninN3,buthavedifferentcharacteristicsandfunctionalcorrelates.Themostcommonmetricsaresleepspindlenumberanddensity.Themorphologicalcharacteristicsofsleepspindlesarealsooftencharacterizedincludingpeakamplitude,sigmapower,durationandfrequency.

Measurementissues:Thereareseveralpubliclyavailableautomatedmethodstodetectspindlesthathavebeenvalidatedagainsthandscoringbyexperts.Butexpertsdonothaveperfectinter-raterreliability91andwhileinternallyconsistent,differentmethodsgiverisetodifferentestimates.Sigmapower(12-15Hz),whichisthespindlefrequency,isoftenusedasaproxyforspindleactivity,butcorrelatesonlymoderatelywithhandorautomaticallydetectedspindles.Spindleshavebeendividedintoslowandfastfrequencyevents,butdefinitionsdiffer.Somepapershavedefinedfastandslowspindlesascovering13.5-15Hzand12-13.5Hzbands,respectively,whileothershaveidentifiedalowerbandofspindlesfrom9-12Hz.Fastandslowspindleshavedifferentscalptopographies,relationswithotherNREMsleeposcillationsandrelationswithwakingcognition,includingsleep-dependentmemoryconsolidation.Spindleschangeoverthelifespan92.Normativedataissoontobeavailable.

Clinicalrelevance:spindleactivityishighlyheritableandisrelatedtothefunctioningofgenesthatconferincreasedriskforschizophrenia93,94andotherneurodevelopmentaldisordersincludingautism95.Spindlegenerationdependsonawell-definedphysiologyandcircuitryinvolvingthethalamicreticularnucleusandthalamocorticalcircuitrythatisimplicatedinpsychopathology.Sleepspindlesarerelevanttocognitionandcorrelatewithsleepdependentmemoryconsolidation,IQandmeasuresoflearningpotentialinhealth96andpsychopathology97,98.Theycanbeexperimentallymanipulatedinbothhumansandanimalsusingpharmacologicalandneurostimulationtechniquestoimprovesleep-dependentmemoryconsolidation99,100.

BehavioralAssessmentMethodsforRDoCConstructs

112

RECOMMENDEDMEASURE3:NON-RAPIDEYEMOVEMENTSLEEP(NREM)EEGSlowwaveactivity:Ameasureofsleephomeostasis(RateofDeclineinNREMEEGDeltaPoweracrossnight,NREMEEGAverageDeltaPower)88,101-115

Overview:Sleephomeostasisreferstotheincreaseinpropensitytosleepthatoccursinproportiontothedurationofpriorwakefulness.Theintensityofthepropensitytosleepatanygivenpointisreferredtoasthedegreeof“homeostaticsleepdrive”.ThereisacompellingbodyofliteratureinhumansandanimalsindicatingthatthedynamicsofEEGpowerintheDeltafrequencyband(typically0.5-4Hz)duringNREMsleepreflectthedegreeofhomeostaticsleepdrivethathasbuiltupatthetimeofsleeponsetandthedissipationofthisdrivethatoccurswithsleep.ThesestudiesdemonstratethatNREMEEGDeltaPowerintheearlypartofthenightandtherateofdeclineinNREMEEGDeltapoweroverthenightincreaseproportionallywiththedurationofpriorwakingandaredecreasedbymanipulationsthatdecreasehomeostaticsleepdrivesuchasextendingsleepandnapping.

Measurementissues:StudiesestablishingtherelationshipbetweenNREMEEGDeltaPowerdynamicsandhomeostaticsleepdrivehaveemployedanumberofstandardmethods.TheseincludetheuseofstandardmethodsforcomputingEEGDeltaPoweremployingtheFastFourierTransform(FFT)andidentifyingNREMsleepusingstandardsleepstagingcriteria88,101.However,studiesincludingNREMEEGDeltaPowerdynamicshavevariedinanumberofkeyaspectsofmethodology,whichremainunstandardized.TheseincludethenumberandlocationofscalpEEGelectrodesutilizedinestimatingNREMEEGDeltaPower,themethodsforidentifyingandremovingdatacontaminatedbyartifact,andtherangeoffrequencieswhichdefinetheDeltafrequencyband.

RECOMMENDEDMEASURE4:MultipleSleepLatencyTest(MSLT):AMeasureofDaytimeSleepiness

Overview:TheMultipleSleepLatencyTest(MSLT)isastandardizedlaboratoryassessmentofthedegreeofdaytimesleepiness.Itismeasuredasthepropensitytofallasleepwhenpresentedwithanopportunityinanenvironmentconducivetosleep.Subjectsaregiven4-5opportunitiestonapinaquiet,darkroomspreadacrosstheday.Foreachnapopportunity,thetimetosleeponsetisdeterminedfromPSGusingstandardscoringcriteria88.Theaveragetimetosleeponsetisthemeasureofsleeppropensity.BecausethetestrequiresPSGmonitoringinthelaboratorythenightbeforetesting,subjectsmustspendanightandasubsequentwholedayinthelaboratory.Althoughmethodshavevaried,astandardizedprotocolfortheMSLThasbeenproposedandwidelyadopted116.

Measurementissues:TheMSLThasgoodfacevalidityasameasureofsleepinessandithasbeenestablishedtohavegoodtest/retestreliability.Convergentvalidityhasbeenestablishedinthatitreflectstheeffectsofsleepdeprivationandtheeffectsofsedatingdrugs.Normativedatahavealsobeenestablished117.Itsmainlimitationsintermsofmeasurementissuesarethattherearefloorandceilingeffectsthataffectapplicationandthatithassignificantinter-individualvariabilitysuchthatitisinconsistentindistinguishinghealthycontrolswithoutsleepinesscomplaintsfromindividualswithdisordersofexcessivesleepiness.Assuch,itisabettermeasureofwithin-subjectchangeinsleepinessthananabsolutesleepinessmeasure.

BehavioralAssessmentMethodsforRDoCConstructs

113

RECOMMENDEDMEASURE5:Insomniaseverityindex(ISI)

Thisistheonlyself-reportmeasurethatwerecommend.Bettervalidatedself-reportmeasuresofsleepandsleepinessareneededsincewidelyusedmeasureshavepoorpsychometrics(e.g.,Sleeplogs/diariesarenotstandardizedorvalidated).TheISIislimitedtoinsomniaassessment,itisnotageneralsleep-wakemeasure118.

RECOMMENDEDMEASURE6:Fingertappingmotorsequencetask(MST)

Description:TheMSTisameasureofsleep-dependentdaytimefunction119.Itassessestherestorativeandtransformativepropertiesofsleeponcognitionmeasuredduringwake.Itisthemostwell-validatedmeasureofsleep-dependentmemoryconsolidation.TheMSTrequiresparticipantstorepeatedlytypea5-digitsequence(e.g.,4-1-3-2-4)onakeyboardwiththelefthand,“asquicklyandaccuratelyaspossible”fortwelve30strialsseparatedby30srestperiods.Participantstrainbeforesleepandaretestedonanadditional12trialsaftersleep.Theprimaryoutcomemeasureisovernightimprovementcalculatedasthepercentincreaseincorrectlytypedsequencesfromthelastthreetrainingtrialstothefirstthreetesttrials120.TheMSTtapsprocedurallearningandmemory.OvernightimprovementontheMSTcorrelateswithsleepspindledensity121-123and,inonestudy,changesinsigmaactivityinthesupplementarymotorareaasmeasuredbyMEG124.Patientswithschizophreniaanddepressiongenerallyperformaswellascontrolsintheinitialsessionintermsoftheamountandproportionoflearning,butshowaspecificdeficitinovernightimprovement97,98,125,thatinschizophrenia,correlateswithasleepspindledeficit126.Overnightimprovementhasbeenlinkedtoprefrontalhippocampalconnectivityduringlearning127.

Measurementissues:Administrationiscomputerized.Performancemaybeaffectedbykeyboardingexperience.Ideally,thetaskisadministeredonconsecutivedays.Measurementmaybehighlyvariableinsomeparticipantsandinvestigatorshavedifferentmethodsofeliminatingoutlyingresponses.

Consideredbutnotselected:

• Word-pairassociateslearning:Awell-validatedmeasureofsleep-dependentdeclarativememoryconsolidation.Apotentialissueinpsychopathologyresearchisthatparticipantsoftenhavedeclarativeencodingdeficitsthatrenderitdifficulttoattributepoorrecalltosleep128.

• MaintenanceofWakefulnessTest(MWT)(probesabilitytoremainawake,butinsufficientpsychometricdata/norms)

• Actigraphy(notareliablemeasureofsleep,includedundercircadianrhythms)

CONSTRUCT:CIRCADIANRHYTHMS

BehavioralAssessmentMethodsforRDoCConstructs

114

Generalconcerns:Mostmeasuresofcircadianrhythmscanbeinfluencedbycircadianentrainingfactorssuchaslight,activity,feedingandtimingofsleep.Forcircadianoutputsthatarealsoinfluencedbyhomeostaticsleepfactors,suchascognitiveperformance,durationofwakefulnesscanalsoeffectmeasurement.Asaresult,circadianrhythmsinhumanshaveoftenbeenmeasuredunderoneofseveralprotocols,includingtimeisolation(subjectsplacedinanenvironmentisolatedfromtimecues,nolongercommonlyused),forceddesynchrony(subjectsforcedtofollowrest-activityschedulesthataretooshortortoolongtopermitentrainment),andconstantroutine(subjectsremainawakeandsemi-recumbentindimlight,withnourishmentprovidedatauniformlevelthroughout)129-131.Corebodytemperaturerhythmmeasurement,whichusedtobeconsideredthegoldstandard,isnolongerfrequentlyusedduetoitsinvasiveness(subjectsneedtowearrectaltemperatureprobesorswallowthermometercapsules),andmeasurementofmelatoninsecretionpatternshasbecomeoneofthemostwidelyusedmarkersatthepresenttime.

RECOMMENDEDMEASURE1:DimLightMelatoninOnset(DLMO)132

Description:Melatoninissynthesizedbythepinealglandanditssecretionisregulatedbythecircadianrhythm(releaseoccursatnight),butsuppressedinthepresenceoflight.Itisthemostfrequentlyusedmarkerofcircadianrhythmsinceitcanbemeasuredinsaliva,bloodandurine.

Measurementissues:Althoughafrequentlyusedmeasure,thelackofconsistencyacrossstudiesinsamplingandmeasuringmelatoninhasmadecomparisonsofresultsdifficult.AworkgroupoftheAssociatedProfessionalSleepSocietieshasmaderecommendationsregardingthecollectionandanalysisofmelatonin133.Theysuggestedthaturinecollectionevery2-8hoursover24-48hoursmaybemostpracticalinthehomesetting,althoughlessprecisethanotherapproaches.Melatonincanalsobemeasuredfromsalivasamplescollectedathomeorinaresearchorclinicalsettingevery30-60minunderdimlightingconditions(<30lux),butthisrequireswakingthesubjectacrossthenight.Frequentbloodsamplingformelatoninthroughanindwellingcatheterpotentiallyallowsthepatienttosleep,butisthemostinvasivetechniqueandmustbeperformedinaresearchorclinicalsetting.Melatoninlevelsarehigherinplasmathaninsalivaorurine,makingplasmasamplingthemostsensitivemethodtoestimatecircadianphase,amplitudeanddurationofsecretion.Themostcommonlyusedphasemarkerisdim-lightmelatoninonset(DMLO),usuallyobtainedbymeasuringmelatoninevery20-30minforseveralhourspriortothenormalsleepperiod,ordim-lightmelatoninoffset(DLMOff),thetimewhenmelatoninlevelsdropattheendofthenight.ThereisstilllackofconsistencyastothethresholdsormethodologiesusedtocalculateDLMOorDLMOff,however.Otherissuesincludetheeffectsoflightexposurepriortoandduringsampling,andthefactthatmelatoninlevelsarelowinsomeindividuals.

RECOMMENDEDMEASURE2:Longitudinalactigraphy(acrophase,mesor,amplitude)134,135

Description:Actigraphyinvolveswearingawristwatch-likemonitorthatcontainsamovementdetector(accelerometer)andcansampleandstoremovementdatainaslittleas1secondbinsoverweeks.Wristactigraphyhasfrequentlybeenusedtoestimatesleep,basedonthefactthatlittlemovementoccursduringsleep.Italsomeasuresactivitypatternsoverthe24-hourday,

BehavioralAssessmentMethodsforRDoCConstructs

115

whichareusedtoestimatecircadianparameterssuchacrophase(timeofpeakactivity),mesor(averageactivity),phaseofthecircadianrhythmandregularityofrest-activitypatterns.Aminimumof1weekofdata,andpreferably2weeks,shouldbecollectedforassessment,andthemonitoristypicallywornonthenon-dominantwrist.Inclinicalsituationsitisusedtoestimatesleeppatternsandintheevaluationofpatientswithcircadianrhythmdisorders.Ithasalsobeenusedsuccessfullytoevaluaterest-activitypatternsandcircadianrhythmsinpatientswithpsychiatricdisorders.

Measurementissues:Whilerecommendedasameasureofcircadianrhythms,itisnotrecommendedasameasureofsleep.Actigraphycannotdistinguishsleepfromquietwakefulnessand,inonestudy,wasshowntobeanunreliablemeasureofsleepduration(basedonPSG)inschizophreniapatientswhotendedtospendlongperiodslyinginbedawakebutnotmoving136.Methodologiesforanalyzingdataarenotstandardized,andalgorithmsforcalculationofsleepandcircadianparametersvaryacrossmanufacturers.Thereisalsovariabilityacrosstheinstrumentsthemselvesintermsofvalidityandconcordancewithothermeasuresofcircadianrhythms.

RECOMMENDEDMEASURE3:Morningness-EveningnessQuestionnaire(MEQ)137

Description:TheHorneandOstbergMorningness-EveningnessQuestionnaireconsistsof19self-reportquestionsthataskaboutbedtimesandwakingtimes,preferredtimesforactivitiesandalertness.Scoresrangefrom16to86,withhigherscoresindicatinggreatermorningnesspreference.

Measurementissues:Scoringneedstobeadjustedforage,sinceyoungerpeopletendtoexpressmoreeveningness.Scoresarealsonotnecessarilyconsistentacrosssubjectsfromdifferentpopulationsorcultures.Otherfactorsthatmayinfluencescoresincludeworkschedule,particularlyshiftwork.Scoresreflectcircadianpreferencetraitandthereforethescalecannotbeusedtomeasurechange138.

RECOMMENDEDMEASURE4:MunichChronotypeQuestionnaire(MCQ)139

Description:TheMCTQassesseschronotypebyusingself-reportedsleeppatternsonwork/schooldaysanddaysoff.Themidpointofthesleepperiodormid-sleepondaysoffisusedtodeterminethechronotype,andconsideredtobemoreofastate-likemeasurethantheMEQ.

Measurementissues:Mid-sleepondaysoffisinfluencedbysleepdebtthatoccursduringwork/schooldays,particularlyforlatechronotypeswhomustawakenearlyforwork/school.Useofanalarmclockondaysoffalsoskewstheresults,andcannotbeusedinshiftworkers.ItisamuchlesswidelyusedinstrumentthantheMEQ138.

Promisingmeasuresrequiringfurtherdevelopment

BehavioralAssessmentMethodsforRDoCConstructs

116

• Geneexpressionpatterns140-142• Pupillarylightreflex143

Consideredbutnotrecommended

• Cortisol(toomanyotherfactorscanaffectdata)• Corebodytemperature(tooinvasive,melatoninfairlyequivalent)

References1. ZisnerA,BeauchaineTP.Psychophysiologicalmethodsanddevelopmentalpsychopathology.In:

CicchettiD,CohenDJ,eds.DevelopmentalPsychopathology.Vol2.DevelopmentalNeuroscience.Vol2.Hoboken,NJ:WIley.

2. BeauchaineTP,ThayerJF.Heartratevariabilityasatransdiagnosticbiomarkerofpsychopathology.InternationalJournalofPsychophysiology.2015;98(2):338-350.doi:10.1016/j.ijpsycho.2015.08.004.

3. BeauchaineTP,Gatzke-KoppLM.Instantiatingthemultiplelevelsofanalysisperspectiveinaprogramofstudyonexternalizingbehavior.DevelopmentandPsychopathology.2012;24(03):1003-1018.doi:10.1017/S0954579412000508.

4. BerntsonGG,CacioppoJT,QuigleyKS.Cardiacpsychophysiologyandautonomicspaceinhumans:Empiricalperspectivesandconceptualimplications.PsychologicalBulletin.1993;114(2):296.doi:10.1037/0033-2909.114.2.296.

5. SherwoodA.Useofimpedancecardiographyincardiovascularreactivityresearch.In:BlascovichJ,KatkinES,eds.CardiovascularReactivitytoPsychologicalStreeandDisease.Washington:AmericanPsychologicalAssociation;1993:157-199.doi:10.1037/10125-007.

6. SherwoodA,TurnerJR.Aconceptualandmethodologicaloverviewofcardiovascularreactivityresearch.In:TurnerJR,SherwoodA,LightKC,eds.IndividualDifferencesinCardiovascularResponsetoStress.NewYork,NY.

7. RitzT.Studyingnoninvasiveindicesofvagalcontrol:Theneedforrespiratorycontrolandtheproblemoftargetspecificity.BiologicalPsychology.2009;80(2):158-168.doi:10.1016/j.biopsycho.2008.08.003.

8. CipryanL,LitschmannovaM.Intra-dayandinter-dayreliabilityofheartratevariabilitymeasurement.JournalofSportsSciences.2013;31(2):150-158.doi:10.1080/02640414.2012.721931.

9. RelandS,VilleNS,WongS,CarraultG,CarréF.Reliabilityofheartratevariabilityinhealthyolderwomenatrestandduringorthostatictesting.AgingClinExpRes.2005;17(4):316-321.doi:10.1007/BF03324616.

10. SandercockGRH,BromleyPD,BrodieDA.Thereliabilityofshort-termmeasurementsofheartratevariability.InternationalJournalofCardiology.2005;103(3):238-247.doi:10.1016/j.ijcard.2004.09.013.

11. TakshitaSookanAJM.Heartratevariabilityinphysicallyactiveindividuals:reliabilityandgendercharacteristics.CardiovascularJournalofAfrica.2012;23(2):67.doi:10.5830/CVJA-2011-018.

12. ShaderTM,Gatzke-KoppLM,CrowellSE,etal.Quantifyingrespiratorysinusarrhythmia:Effectsofmisspecifyingbreathingfrequenciesacrossdevelopment.UnderReview.

13. FlemingS,ThompsonM,StevensR,etal.Normalrangesofheartrateandrespiratoryrateinchildrenfrombirthto18yearsofage:Asystematicreviewofobservationalstudies.TheLancet.

BehavioralAssessmentMethodsforRDoCConstructs

117

2011;377(9770):1011-1018.doi:10.1016/S0140-6736(10)62226-X.14. NUNAND,SandercockGRH,BrodieDA.AQuantitativeSystematicReviewofNormalValuesfor

Short-TermHeartRateVariabilityinHealthyAdults.PacingandClinicalElectrophysiology.2010;33(11):1407-1417.doi:10.1111/j.1540-8159.2010.02841.x.

15. BeauchaineTP.FutureDirectionsinEmotionDysregulationandYouthPsychopathology.JournalofClinicalChild&AdolescentPsychology.May2015.doi:10.1080/15374416.2015.1038827.

16. BeauchaineTP,Gatzke-KoppL,MeadHK.PolyvagalTheoryanddevelopmentalpsychopathology:Emotiondysregulationandconductproblemsfrompreschooltoadolescence.BiologicalPsychology.2007;74(2):174-184.doi:10.1016/j.biopsycho.2005.08.008.

17. YaroslavskyI,RottenbergJ.Atypicalpatternsofrespiratorysinusarrhythmiaindexanendophenotypefordepression.Developmentand….2014.

18. YaroslavskyI,RottenbergJ,BylsmaLM,etal.Parasympatheticnervoussystemactivitypredictsmoodrepairuseanditseffectivenessamongadolescentswithandwithouthistoriesofmajordepression.JournalofAbnormalPsychology.2016;125(3):323.doi:10.1037/abn0000149.

19. NeijtsM,VanLienR,KupperN,BoomsmaD,WillemsenG,GeusEJC.Heritabilityofcardiacvagalcontrolin24-hheartratevariabilityrecordings:Influenceofceilingeffectsatlowheartrates.Psychophysiology.2014;51(10):1023-1036.doi:10.1111/psyp.12246.

20. RieseH,MuñozLM,HartmanCA,etal.IdentifyingGeneticVariantsforHeartRateVariabilityintheAcetylcholinePathway.PLOSONE.2014;9(11):e112476.doi:10.1371/journal.pone.0112476.

21. SuS,LampertR,ZhaoJ,etal.PleiotropyofC-ReactiveProteinGenePolymorphismsWithC-ReactiveProteinLevelsandHeartRateVariabilityinHealthyMaleTwins.TheAmericanJournalofCardiology.2009;104(12):1748-1754.doi:10.1016/j.amjcard.2009.07.063.

22. SuS,LampertR,LeeF,BremnerJD.Commongenescontributetodepressivesymptomsandheartratevariability:theTwinsHeartStudy.…HumanGenetics.2010.

23. RichardJenningsJ,AllenB,GianarosPJ,ThayerJF,ManuckSB.Focusingneurovisceralintegration:Cognition,heartratevariability,andcerebralbloodflow.Psychophysiology.2015;52(2):214-224.doi:10.1111/psyp.12319.

24. JenningsJR,SheuLK,KuanDCH,ManuckSB,GianarosPJ.Restingstateconnectivityofthemedialprefrontalcortexcovarieswithindividualdifferencesinhigh-frequencyheartratevariability.Psychophysiology.2016;53(4):444-454.doi:10.1111/psyp.12586.

25. ThayerJF,HansenAL,Saus-RoseE,JohnsenBH.HeartRateVariability,PrefrontalNeuralFunction,andCognitivePerformance:TheNeurovisceralIntegrationPerspectiveonSelf-regulation,Adaptation,andHealth.annbehavmed.2009;37(2):141-153.doi:10.1007/s12160-009-9101-z.

26. MakovacE,MeetenF,WatsonDR,etal.AlterationsinAmygdala-PrefrontalFunctionalConnectivityAccountforExcessiveWorryandAutonomicDysregulationinGeneralizedAnxietyDisorder.BiologicalPsychiatry.October2015.doi:10.1016/j.biopsych.2015.10.013.

27. SmithR,AllenJJB,ThayerJF,FortC,LaneRD.IncreasedassociationovertimebetweenregionalfrontallobeBOLDchangemagnitudeandcardiacvagalcontrolwithsertralinetreatmentformajordepression.PsychiatryResearch-Neuroimaging.2014;224(3):225-233.doi:10.1016/j.pscychresns.2014.08.015.

28. BeauchaineTP,Gatzke-KoppL,NeuhausE,ChipmanJ,ReidMJ,Webster-StrattonC.Sympathetic-andparasympathetic-linkedcardiacfunctionandpredictionofexternalizingbehavior,emotionregulation,andprosocialbehavioramongpreschoolerstreatedforADHD.JournalofConsultingandClinicalPsychology.2013;81(3):481.doi:10.1037/a0032302.

29. GarakaniA,MartinezJM,AaronsonCJ,VoustianioukA,KaufmannH,GormanJM.Effectofmedicationandpsychotherapyonheartratevariabilityinpanicdisorder.Depressionand

BehavioralAssessmentMethodsforRDoCConstructs

118

Anxiety.2009;26(3):251-258.doi:10.1002/da.20533.30. PosadzkiP,KuzdzalA,LeeMS,ErnstE.YogaforHeartRateVariability:ASystematicReviewand

Meta-analysisofRandomizedClinicalTrials.AppliedPsychophysiologyBiofeedback.2015;40(3):239-249.doi:10.1007/s10484-015-9291-z.

31. ReineckeA,FilippiniN,BernaC,etal.EffectiveemotionregulationstrategiesimprovefMRIandECGmarkersofpsychopathologyinpanicdisorder:Implicationsforpsychologicaltreatmentaction.TranslationalPsychiatry.2015;5.doi:10.1038/tp.2015.160.

32. WangSM,LeeHK,KweonYS,etal.Effectofemotionregulationtraininginpatientswithpanicdisorder:Evidencedbyheartratevariabilitymeasures.GeneralHospitalPsychiatry.2016;40:68-73.doi:10.1016/j.genhosppsych.2016.01.003.

33. ClamorA,LincolnTM,ThayerJF,KoenigJ.Restingvagalactivityinschizophrenia:Meta-Analysisofheartratevariabilityasapotentialendophenotype.BritishJournalofPsychiatry.2016;208(1):9-16.doi:10.1192/bjp.bp.114.160762.

34. BassettD.Aliteraturereviewofheartratevariabilityindepressiveandbipolardisorders.AustralianandNewZealandJournalofPsychiatry.2015;50(6):511-519.doi:10.1177/0004867415622689.

35. DawsonME,SchellAM,FilionDL.Theelectrodermalsystem.In:CacioppoJT,TassinaryLG,BerntsonGG,eds.HandbookofPsychophysiology.3rded.NewYork;2007:159-181.

36. BoucseinW.ElectrodermalActivity.Boston,MA:SpringerUS;2011.doi:10.1007/978-1-4614-1126-0_1.

37. WilliamsLM,PhillipsML,BrammerMJ,etal.ArousalDissociatesAmygdalaandHippocampalFearResponses:EvidencefromSimultaneousfMRIandSkinConductanceRecording.NeuroImage.2001;14(5):1070-1079.doi:10.1006/nimg.2001.0904.

38. CriderA,KremenWS,XianH,etal.Stability,consistency,andheritabilityofelectrodermalresponselabilityinmiddle-agedmaletwins.Psychophysiology.2004;41(4):501-509.doi:10.1111/j.1469-8986.2004.00189.x.

39. VaidyanathanU,IsenJD,MaloneSM,MillerMB,McGueM,IaconoWG.Heritabilityandmoleculargeneticbasisofelectrodermalactivity:Agenome-wideassociationstudy.Psychophysiology.2014;51(12):1259-1271.doi:10.1111/psyp.12346.

40. BoucseinW,FowlesDC,GrimnersS,etal.Publicationrecommendationsforelectrodermalmeasurements.Psychophysiology.2012;49(8):1017-1034.doi:10.1111/j.1469-8986.2012.01384.x.

41. HerpertzSC,MuellerB,WenningB,QunaibiM,LichterfeldC,Herpertz-DahlmannB.Autonomicresponsesinboyswithexternalizingdisorders.JNeuralTransm.2003;110(10):1181-1195.doi:10.1007/s00702-003-0026-6.

42. HERPERTZSC,VLOETT,MUELLERB,DOMESG,WILLMESK,HERPERTZ-DAHLMANNB.SimilarAutonomicResponsivityinBoysWithConductDisorderandTheirFathers.JournaloftheAmericanAcademyofChild&AdolescentPsychiatry.2007;46(4):535-544.doi:10.1097/chi.0b013e3180306286.

43. IsenJD,IaconoWG,MaloneSM,McGueM.Examiningelectrodermalhyporeactivityasamarkerofexternalizingpsychopathology:Atwinstudy.Psychophysiology.2012;49(8):1039-1048.doi:10.1111/j.1469-8986.2012.01394.x.

44. IsenJD,IaconoWG,MaloneSM.Characterizingelectrodermalresponsehabituation:Alatentclassapproachwithapplicationtopsychopathology.Psychophysiology.2013;50(10):954-962.doi:10.1111/psyp.12080.

45. KnottVJ,BulmerDR.Effectsofrepetitivehighintensitystimulationonelectrodermalresponsivityinmalealcoholicsandnormalcontrols.AddictiveBehaviors.1985;10(2):181-185.doi:10.1016/0306-4603(85)90025-5.

BehavioralAssessmentMethodsforRDoCConstructs

119

46. RaineA,LenczT,BihrleS,LaCasseL,CollettiP.Reducedprefrontalgraymattervolumeandreducedautonomicactivityinantisocialpersonalitydisorder.ArchivesofGeneralPsychiatry.2000;57(2):119-127.doi:10.1001/archpsyc.57.2.119.

47. RaineA.BiosocialStudiesofAntisocialandViolentBehaviorinChildrenandAdults:AReview.JAbnormChildPsychol.2002;30(4):311-326.doi:10.1023/A:1015754122318.

48. IaconoWG,FickenJW,BeiserM.Electrodermalactivationinfirst-episodepsychoticpatientsandtheirfirst-degreerelatives.PsychiatryResearch.1999;88(1):25-39.doi:10.1016/S0165-1781(99)00071-2.

49. McTeagueLM,LangPJ,LaplanteM-C,CuthbertBN,ShumenJR,BradleyMM.AversiveImageryinPosttraumaticStressDisorder:TraumaRecurrence,Comorbidity,andPhysiologicalReactivity.BiologicalPsychiatry.2010;67(4):346-356.doi:10.1016/j.biopsych.2009.08.023.

50. PoleN.ThePsychophysiologyofPosttraumaticStressDisorder:AMeta-Analysis.PsychologicalBulletin.2007;133(5):725-746.doi:10.1037/0033-2909.133.5.725.

51. GilzenratMS,NieuwenhuisS,JepmaM,CohenJD.Pupildiametertrackschangesincontrolstatepredictedbytheadaptivegaintheoryoflocuscoeruleusfunction.CognAffectBehavNeurosci.2010;10(2):252-269.doi:10.3758/CABN.10.2.252.

52. KossMC.Pupillarydilationasanindexofcentralnervoussystemα2-adrenoceptoractivation.JournalofPharmacologicalMethods.1986;15(1):1-19.doi:10.1016/0160-5402(86)90002-1.

53. HessEH,PoltJM.PupilSizeasRelatedtoInterestValueofVisualStimuli.Science.1960;132(3423):349-350.doi:10.1126/science.132.3423.349.

54. KahnemanD,BeattyJ.PupilDiameterandLoadonMemory.Science.1966;154(3756):1583-1585.doi:10.1126/science.154.3756.1583.

55. WierdaSM,vanRijnH,TaatgenNA,MartensS.Pupildilationdeconvolutionrevealsthedynamicsofattentionathightemporalresolution.PNAS.2012;109(22):8456-8460.doi:10.1073/pnas.1201858109.

56. SiegleGJ,SteinhauerSR,StengerVA,KoneckyR,CarterCS.UseofconcurrentpupildilationassessmenttoinforminterpretationandanalysisoffMRIdata.NeuroImage.2003;20(1):114-124.doi:10.1016/S1053-8119(03)00298-2.

57. LaengB,SiroisS,GredebäckG.Pupillometry:AWindowtothePreconscious?PerspectivesonPsychologicalScience.2012;7(1):18-27.doi:10.1177/1745691611427305.

58. FarzinF,ScaggsF,HerveyC,Berry-KravisE,HesslD.ReliabilityofEyeTrackingandPupillometryMeasuresinIndividualswithFragileXSyndrome.JAutismDevDisord.2011;41(11):1515-1522.doi:10.1007/s10803-011-1176-2.

59. SiegleGJ,SteinhauerSR,FriedmanES,ThompsonWS,ThaseME.RemissionPrognosisforCognitiveTherapyforRecurrentDepressionUsingthePupil:UtilityandNeuralCorrelates.BiologicalPsychiatry.2011;69(8):726-733.doi:10.1016/j.biopsych.2010.12.041.

60. AndersonCJ,ColomboJ,ShaddyDJ.VisualScanningandPupillaryResponsesinYoungChildrenwithAutismSpectrumDisorder.JournalofClinicalandExperimentalNeuropsychology.February2007.doi:10.1080/13803390500376790.

61. MartineauJ,HernandezN,HiebelL,RochéL,MetzgerA,Bonnet-BrilhaultF.Canpupilsizeandpupilresponsesduringvisualscanningcontributetothediagnosisofautismspectrumdisorderinchildren?JournalofPsychiatricResearch.2011;45(8):1077-1082.doi:10.1016/j.jpsychires.2011.01.008.

62. PriceRB,SiegleGJ,SilkJS,etal.SUSTAINEDNEURALALTERATIONSINANXIOUSYOUTHPERFORMINGANATTENTIONALBIASTASK:APUPILOMETRYSTUDY.DepressionandAnxiety.2013;30(1):22-30.doi:10.1002/da.21966.

63. SilkJSPh.D.,DahlREM.D.,RyanNDM.D.,etal.PupillaryReactivitytoEmotionalInformationinChildandAdolescentDepression:LinkstoClinicalandEcologicalMeasures.AmericanJournalof

BehavioralAssessmentMethodsforRDoCConstructs

120

Psychiatry.2007;164(12):1873-1880.doi:10.1176/appi.ajp.2007.06111816.64. SherwoodA,AllenMT,FahrenbergJ,KelseyRM,LovalloWR,vanDoornenLJP.Methodological

GuidelinesforImpedanceCardiography.Psychophysiology.1990;27(1):1-23.doi:10.1111/j.1469-8986.1990.tb02171.x.

65. SherwoodA,AllenMT,ObristPA,LangerAW.EvaluationofBeta-AdrenergicInfluencesonCardiovascularandMetabolicAdjustmentstoPhysicalandPsychologicalStress.Psychophysiology.1986;23(1):89-104.doi:10.1111/j.1469-8986.1986.tb00602.x.

66. MillsPJ,DimsdaleJE.Sympatheticnervoussystemresponsestopsychosocialstressors.In:TurnerJR,SherwoodA,LightKC,eds.IndividualDifferencesinCardiovascularResponsetoStress.NewYork:Springer;2013:3-32.

67. RichterM,GendollaGHE.Theheartcontractstoreward:Monetaryincentivesandpreejectionperiod.Psychophysiology.2009;46(3):451-457.doi:10.1111/j.1469-8986.2009.00795.x.

68. BrennerSL,BeauchaineTP,SylversPD.Acomparisonofpsychophysiologicalandself-reportmeasuresofBASandBISactivation.Psychophysiology.2005;42(1):108-115.doi:10.1111/j.1469-8986.2005.00261.x.

69. KelseyRM,OrnduffSR,AlpertBS.Reliabilityofcardiovascularreactivitytostress:Internalconsistency.Psychophysiology.2007;44(2):216-225.doi:10.1111/j.1469-8986.2007.00499.x.

70. SherwoodA,GIRDLERSS,BRAGDONEE,etal.Ten-yearstabilityofcardiovascularresponsestolaboratorystressors.Psychophysiology.1997;34(2):185-191.doi:10.1111/j.1469-8986.1997.tb02130.x.

71. UchinoBN,UnoD,Holt-LunstadJ,FlindersJB.Age-RelatedDifferencesinCardiovascularReactivityDuringAcutePsychologicalStressinMenandWomen.JGerontolBPsycholSciSocSci.1999;54B(6):P339-P346.doi:10.1093/geronb/54B.6.P339.

72. BeauchaineTP,KatkinES,StrassbergZ,SnarrJ.Disinhibitorypsychopathologyinmaleadolescents:Discriminatingconductdisorderfromattention-deficit/hyperactivitydisorderthroughconcurrentassessmentofmultipleautonomicstates.JournalofAbnormalPsychology.2001;110(4):610.doi:10.1037/0021-843X.110.4.610.

73. MarshP,BeauchaineTP,WilliamsB.Dissociationofsadfacialexpressionsandautonomicnervoussystemrespondinginboyswithdisruptivebehaviordisorders.Psychophysiology.2008;45(1):100-110.doi:10.1111/j.1469-8986.2007.00603.x.

74. BeauchaineTP,HongJ,MarshP.SexDifferencesinAutonomicCorrelatesofConductProblemsandAggression.JournaloftheAmericanAcademyofChild&AdolescentPsychiatry.2008;47(7):788-796.doi:10.1097/CHI.Ob013e318172ef4b.

75. QuigleyKS,StifterCA.Acomparativevalidationofsympatheticreactivityinchildrenandadults.Psychophysiology.2006;43(4):357-365.doi:10.1111/j.1469-8986.2006.00405.x.

76. deGeusEJC,KupperN,BoomsmaDI,SniederH.BivariateGeneticModelingofCardiovascularStressReactivity:DoesStressUncoverGeneticVariance?PsychosomaticMedicine.2007;69(4):356.doi:10.1097/PSY.0b013e318049cc2d.

77. KupperN,WillemsenG,BoomsmaDI,deGeusEJC.HeritabilityofIndicesforCardiacContractilityinAmbulatoryRecordings.JournalofCardiovascularElectrophysiology.2006;17(8):877-883.doi:10.1111/j.1540-8167.2006.00535.x.

78. SniederH,HarshfieldGA,BarbeauP,PollockDM,PollockJS,TreiberFA.Dissectingthegeneticarchitectureofthecardiovascularandrenalstressresponse.BiologicalPsychology.2002;61(1-2):73-95.doi:10.1016/S0301-0511(02)00053-4.

79. BuuseM.ROLEOFTHEMESOLIMBICDOPAMINESYSTEMINCARDIOVASCULARHOMEOSTASIS.STIMULATIONOFTHEVENTRALTEGMENTALAREAMODULATESTHEEFFECTOFVASOPRESSINONBLOODPRESSUREINCONSCIOUSRATS.ClinicalandExperimentalPharmacologyandPhysiology.1998;25(9):661-668.doi:10.1111/j.1440-1681.1998.tb02273.x.

BehavioralAssessmentMethodsforRDoCConstructs

121

80. SalomonK,BylsmaLM,WhiteKE,PanaiteV,RottenbergJ.Isbluntedcardiovascularreactivityindepressionmood-statedependent?Acomparisonofmajordepressivedisorderremitteddepressionandhealthycontrols.InternationalJournalofPsychophysiology.2013;90(1):50-57.doi:10.1016/j.ijpsycho.2013.05.018.

81. BrennerSL,BeauchaineTP.Pre-ejectionperiodreactivityandpsychiatriccomorbidityprospectivelypredictsubstanceuseinitiationamongmiddle-schoolers:Apilotstudy.Psychophysiology.2011;48(11):1588-1596.doi:10.1111/j.1469-8986.2011.01230.x.

82. TamakiM,BangJW,WatanabeT,SasakiY.NightWatchinOneBrainHemisphereduringSleepAssociatedwiththeFirst-NightEffectinHumans.CurrentBiology.2016;26(9):1190-1194.doi:10.1016/j.cub.2016.02.063.

83. COTEKA,MILNERCE,SMITHBA,etal.CNSarousalandneurobehavioralperformanceinashort-termsleeprestrictionparadigm.JournalofSleepResearch.2009;18(3):291-303.doi:10.1111/j.1365-2869.2008.00733.x.

84. BasnerM,MolliconeD,DingesDF.Validityandsensitivityofabriefpsychomotorvigilancetest(PVT-B)tototalandpartialsleepdeprivation.ActaAstronautica.2011;69(11-12):949-959.doi:10.1016/j.actaastro.2011.07.015.

85. ChristieMA,BolortuyaY,ChenLC,McKennaJT,McCarleyRW,StreckerRE.Microdialysiselevationofadenosineinthebasalforebrainproducesvigilanceimpairmentsintheratpsychomotorvigilancetask.Sleep.2008;31(10):1393-1398.

86. DrummondS,Bischoff-GretheA.Theneuralbasisofthepsychomotorvigilancetask.SLEEP-NEWYORK….2005.

87. RéteyJV,AdamM,GottseligJM,etal.Adenosinergicmechanismscontributetoindividualdifferencesinsleepdeprivation-inducedchangesinneurobehavioralfunctionandbrainrhythmicactivity.JournalofNeuroscience.2006;26(41):10472-10479.doi:10.1523/JNEUROSCI.1538-06.2006.

88. IberC,Ancoli-IsraelC,ChessonA,QuanSF.TheAASMManualfortheScoringofSleepandAssociatedEvents:Rules,TerminologyandTechnicalSpecification.1sted.Weschester,IL:AmericanAcademyofSleepMedicine;2007.

89. KrystalAD,EdingerJD.Measuringsleepquality.SleepMedicine.2008;9:S10-S17.doi:10.1016/S1389-9457(08)70011-X.

90. SilberMH,Ancoli-IsraelS,BonnetMH.Thevisualscoringofsleepinadults.JClinSleep….2007.91. WarbySC,WendtSL,WelinderP,etal.Sleep-spindledetection:crowdsourcingandevaluating

performanceofexperts,non-expertsandautomatedmethods.NatureMethods.2014;11(4):385-392.doi:10.1038/nmeth.2855.

92. ClawsonBC,DurkinJ,AtonSJ.FormandFunctionofSleepSpindlesacrosstheLifespan.NeuralPlasticity.2016;2016(17):1-16.doi:10.1155/2016/6936381.

93. AstoriS,WimmerRD,ProsserHM,etal.TheCaV3.3calciumchannelisthemajorsleepspindlepacemakerinthalamus.PNAS.2011;108(33):13823-13828.doi:10.1073/pnas.1105115108.

94. ManoachDS,PanJQ,PurcellSM,StickgoldR.ReducedSleepSpindlesinSchizophrenia:ATreatableEndophenotypeThatLinksRiskGenestoImpairedCognition?BiologicalPsychiatry.October2015.doi:10.1016/j.biopsych.2015.10.003.

95. WellsMF,WimmerRD,SchmittLI,FengG,HalassaMM.ThalamicreticularimpairmentunderliesattentiondeficitinPtchd1Y/−mice.Nature.2016;532(7597):58-63.doi:10.1038/nature17427.

96. FogelSM,SmithCT.Thefunctionofthesleepspindle:Aphysiologicalindexofintelligenceandamechanismforsleep-dependentmemoryconsolidation.Neuroscience&BiobehavioralReviews.2011;35(5):1154-1165.doi:10.1016/j.neubiorev.2010.12.003.

97. ManoachDS,CainMS,VangelMG,KhuranaA,GoffDC,StickgoldR.Afailureofsleep-

BehavioralAssessmentMethodsforRDoCConstructs

122

dependentprocedurallearninginchronic,medicatedschizophrenia.BiologicalPsychiatry.2004;56(12):951-956.doi:10.1016/j.biopsych.2004.09.012.

98. ManoachDS,DemanueleC,WamsleyEJ,etal.Sleepspindledeficitsinantipsychotic-naïveearlycourseschizophreniaandinnon-psychoticfirst-degreerelatives.FrontHumNeurosci.2014;8:344.doi:10.3389/fnhum.2014.00762.

99. LustenbergerC,BoyleMR,AlagapanS,MellinJM,VaughnBV,FröhlichF.Feedback-ControlledTranscranialAlternatingCurrentStimulationRevealsaFunctionalRoleofSleepSpindlesinMotorMemoryConsolidation.CurrentBiology.2016;26(16):2127-2136.doi:10.1016/j.cub.2016.06.044.

100. MednickSC,McDevittEA,WalshJK,etal.TheCriticalRoleofSleepSpindlesinHippocampal-DependentMemory:APharmacologyStudy.JNeurosci.2013;33(10):4494-4504.doi:10.1523/JNEUROSCI.3127-12.2013.

101. KalesA,RechtschaffenA.AManualofStandardizedTerminology,TechniquesandScoringSystemforSleepStagesofHumanSubjects.

102. BrunnerDP,DijkD-J,ToblerI,BorbélyAA.EffectofpartialsleepdeprivationonsleepstagesandEEGpowerspectra:evidencefornon-REMandREMsleephomeostasis.ElectroencephalographyandClinicalNeurophysiology.1990;75(6):492-499.doi:10.1016/0013-4694(90)90136-8.

103. BrunnerDP,DijkD-J,BorbélyAA.RepeatedpartialsleepdeprivationprogressivelychangestheEEGduringsleepandwakefulness.Sleep:JournalofSleepResearch&SleepMedicine.February1993.

104. DijkD-J,HayesB,CzeislerCA.Dynamicsofelectroencephalographicsleepspindlesandslowwaveactivityinmen:effectofsleepdeprivation.BrainResearch.1993;626(1):190-199.doi:10.1016/0006-8993(93)90579-C.

105. DJD,CC,IT,AAB.Sleepextensioninhumans:sleepstages,EEGpowerspectraandbodytemperature.Sleep:JournalofSleepResearch&SleepMedicine.1991;14(4):294-306.

106. DijkD-J,BrunnerDP,BeersmaD,AAB.Electroencephalogrampowerdensityandslowwavesleepasafunctionofpriorwakingandcircadianphase.Sleep.1990.

107. DijkDJ,BrunnerDP,BorbélyAA.TimecourseofEEGpowerdensityduringlongsleepinhumans.AmericanJournalofPhysiology-Regulatory,IntegrativeandComparativePhysiology.1990;258(3):R650-R661.

108. DijkD-J,BrunnerDP,BorbélyAA.EEGpowerdensityduringrecoverysleepinthemorning.ElectroencephalographyandClinicalNeurophysiology.1991;78(3):203-214.doi:10.1016/0013-4694(91)90034-2.

109. EndoT,SchwierinB,BorbélyAA,ToblerI.Selectiveandtotalsleepdeprivation:effectonthesleepEEGintherat.PsychiatryResearch.1997;66(2-3):97-110.doi:10.1016/S0165-1781(96)03029-6.

110. FrankenP,DijkDJ,ToblerI,BorbélyAA.Sleepdeprivationinrats:effectsonEEGpowerspectra,vigilancestates,andcorticaltemperature.AmericanJournalofPhysiology-Regulatory,IntegrativeandComparativePhysiology.1991;261(1):R198-R208.

111. AndrewDKrystalJDE.SleepEEGPredictorsandCorrelatesoftheResponsetoCognitiveBehavioralTherapyforInsomnia.Sleep.2010;33(5):669.

112. ToblerI,BorbélyAA.SleepEEGintheratasafunctionofpriorwaking.ElectroencephalographyandClinicalNeurophysiology.1986;64(1):74-76.doi:10.1016/0013-4694(86)90044-1.

113. WerthE,DijkDJ,AchermannP,BorbélyAA.DynamicsofthesleepEEGafteranearlyeveningnap:experimentaldataandsimulations.AmericanJournalofPhysiology-Regulatory,IntegrativeandComparativePhysiology.1996;271(3):R501-R510.

114. AchermannP,DijkD-J,BrunnerDP,BorbélyAA.Amodelofhumansleephomeostasisbasedon

BehavioralAssessmentMethodsforRDoCConstructs

123

EEGslow-waveactivity:Quantitativecomparisonofdataandsimulations.BrainResearchBulletin.1993;31(1-2):97-113.doi:10.1016/0361-9230(93)90016-5.

115. BorbélyAA,BaumannF,BrandeisD,StrauchI,LehmannD.Sleepdeprivation:EffectonsleepstagesandEEGpowerdensityinman.ElectroencephalographyandClinicalNeurophysiology.1981;51(5):483-493.doi:10.1016/0013-4694(81)90225-X.

116. AmericanSOPCOT.Practiceparametersforclinicaluseofthemultiplesleeplatencytestandthemaintenanceofwakefulnesstest.Sleep.2005.

117. DA,MB,TH,MM,RR,RBS.TheclinicaluseoftheMSLTandMWT.Sleep:JournalofSleepResearch&SleepMedicine.2005;28(1):123-144.

118. BastienC.ValidationoftheInsomniaSeverityIndexasanoutcomemeasureforinsomniaresearch.SleepMedicine.2001;2(4):297-307.doi:10.1016/S1389-9457(00)00065-4.

119. KarniA,MeyerG,Rey-HipolitoC,etal.Theacquisitionofskilledmotorperformance:Fastandslowexperience-drivenchangesinprimarymotor cortex.PNAS.1998;95(3):861-868.

120. WalkerMP,BrakefieldT,MorganA,HobsonJA,StickgoldR.PracticewithSleepMakesPerfect.Neuron.2002;35(1):205-211.doi:10.1016/S0896-6273(02)00746-8.

121. AlbouyG,FogelS,PottiezH,etal.DaytimeSleepEnhancesConsolidationoftheSpatialbutNotMotoricRepresentationofMotorSequenceMemory.PLOSONE.2013;8(1):e52805.doi:10.1371/journal.pone.0052805.

122. BarakatM,DoyonJ,DebasK,etal.Fastandslowspindleinvolvementintheconsolidationofanewmotorsequence.BehaviouralBrainResearch.2011;217(1):117-121.doi:10.1016/j.bbr.2010.10.019.

123. NishidaM,WalkerMP.DaytimeNaps,MotorMemoryConsolidationandRegionallySpecificSleepSpindles.PLOSONE.2007;2(4):e341.doi:10.1371/journal.pone.0000341.

124. TamakiM,HuangTR,YotsumotoY,etal.Enhancedspontaneousoscillationsinthesupplementarymotorareaareassociatedwithsleep-dependentofflinelearningoffinger-tappingmotor-sequencetask.JournalofNeuroscience.2013;33(34):13894-13902.doi:10.1523/JNEUROSCI.1198-13.2013.

125. DreslerM,KlugeM,PawlowskiM,SchüsslerP,SteigerA,GenzelL.Adoubledissociationofmemoryimpairmentsinmajordepression.JournalofPsychiatricResearch.2011;45(12):1593-1599.doi:10.1016/j.jpsychires.2011.07.015.

126. WamsleyEJ,TuckerMA,ShinnAK,etal.ReducedSleepSpindlesandSpindleCoherenceinSchizophrenia:MechanismsofImpairedMemoryConsolidation?BiologicalPsychiatry.2012;71(2):154-161.doi:10.1016/j.biopsych.2011.08.008.

127. GenzelL,DreslerM,CornuM,etal.Medialprefrontal-hippocampalconnectivityandmotormemoryconsolidationindepressionandschizophrenia.BiologicalPsychiatry.2015;77(2):177-186.doi:10.1016/j.biopsych.2014.06.004.

128. BackhausJ,BornJ,HoeckesfeldR,FokuhlS,HohagenF,JunghannsK.Midlifedeclineindeclarativememoryconsolidationiscorrelatedwithadeclineinslowwavesleep.LearningandMemory.2007;14(5):336-341.doi:10.1101/lm.470507.

129. BlatterK,CajochenC.Circadianrhythmsincognitiveperformance:Methodologicalconstraints,protocols,theoreticalunderpinnings.Physiology&Behavior.2007;90(2-3):196-208.doi:10.1016/j.physbeh.2006.09.009.

130. GoelN,BasnerM,RaoH,DingesDF.CircadianRhythms,SleepDeprivation,andHumanPerformance.In:Chronobiology:BiologicalTiminginHealthandDisease.Vol119.ProgressinMolecularBiologyandTranslationalScience.Elsevier;2013:155-190.doi:10.1016/B978-0-12-396971-2.00007-5.

131. HermanJH.ChronobiologicMonitoringTechniques.In:PrinciplesandPracticeofSleepMedicine.ElsevierHealthSciences;2010.

BehavioralAssessmentMethodsforRDoCConstructs

124

132. BurgessHJ,WyattJK,ParkM,FoggLF.Homecircadianphaseassessmentswithmeasuresofcomplianceyieldaccuratedimlightmelatoninonsets.Sleep.2015;38(6):889-897.doi:10.5665/sleep.4734.

133. BenloucifS,BurgessHJ,KlermanEB,etal.Measuringmelatonininhumans.JournalofClinicalSleepMedicine.2008;4(1):66-69.

134. BriscoeS,HardyE,PengoMF,etal.Comparisonof7versus14dayswristactigraphymonitoringinasleepdisordersclinicpopulation.ChronobiologyInternational.2014;31(3):356-362.doi:10.3109/07420528.2013.858163.

135. TahmasianM,KhazaieH,GolshaniS,AvisKT.Clinicalapplicationofactigraphyinpsychoticdisorders:Asystematicreview.CurrentPsychiatryReports.2013;15(6):359.doi:10.1007/s11920-013-0359-2.

136. ManoachDS,ThakkarKN,StroynowskiE,etal.Reducedovernightconsolidationofprocedurallearninginchronicmedicatedschizophreniaisrelatedtospecificsleepstages.JournalofPsychiatricResearch.2010;44(2):112-120.doi:10.1016/j.jpsychires.2009.06.011.

137. HorneJA,OstbergO.AselfassessmentquestionnairetodetermineMorningnessEveningnessinhumancircadianrhythms.InternationalJournalofChronobiology.1976;4(2):97-110.

138. LevandovskiR,SassoE,HidalgoMP.Chronotype:Areviewoftheadvances,limitsandapplicabilityofthemaininstrumentsusedintheliteraturetoassesshumanphenotype.TrendsinPsychiatryandPsychotherapy.2013;35(1):3-11.doi:10.1590/S2237-60892013000100002.

139. RoennebergT,Wirz-JusticeA,MerrowM.Lifebetweenclocks:Dailytemporalpatternsofhumanchronotypes.JournalofBiologicalRhythms.2003;18(1):80-90.doi:10.1177/0748730402239679.

140. ChenCY,LoganRW,MaT,etal.Effectsofagingoncircadianpatternsofgeneexpressioninthehumanprefrontalcortex.ProceedingsoftheNationalAcademyofSciencesoftheUnitedStatesofAmerica.2016;113(1):206-211.doi:10.1073/pnas.1508249112.

141. LechK,AckermannK,RevellVL,LaoOSCAR,SkeneDJ,KayserM.DissectingDailyandCircadianExpressionRhythmsofClock-ControlledGenesinHumanBlood.JournalofBiologicalRhythms.2016;31(1):68-81.doi:10.1177/0748730415611761.

142. ZhangR,LahensNF,BallanceHI,HughesME,HogeneschJB.Acircadiangeneexpressionatlasinmammals:Implicationsforbiologyandmedicine.ProceedingsoftheNationalAcademyofSciencesoftheUnitedStatesofAmerica.2014;111(45):16219-16224.doi:10.1073/pnas.1408886111.

143. MünchM,LéonL,CrippaSV,KawasakiA.Circadianandwake-dependenteffectsonthepupillightreflexinresponsetonarrow-bandwidthlightpulses.InvestigativeOphthalmologyandVisualScience.2012;53(8):4546-4555.doi:10.1167/iovs.12-9494.

BehavioralAssessmentMethodsforRDoCConstructs

125

APPENDIXARS-Ia:Summaryofdiscussionofhowwelleachtaskmettheproposedcriteriafortaskevaluation.

Task:Electrodermalconductance(a)duringrestingstate(measureoftonicarousal);(b)inresponsetoatask

Construct:AROUSAL

1.HowstrongistheevidencethatthetaskprovidesavalidmeasureoftheRDoCconstruct?Verywidelyusedtest.

2.Howgoodistheevidenceaboutthepsychometricscharacteristicsofthetask(e.g.,internalreliability,testretest,floorandceilingeffects,practiceeffects,availabilityofalternateforms,longitudinalstability)?Reasonablygoodforlongitudinalstabilityandtest-retestreliabilityformeasureoftonicarousal;practiceeffectsforrepeatedmeasurementinresponsetostimuli.However,insufficientdataintermsofcorrelationwithtreatmentresponse.

3.Areparametersforadministeringthetask(e.g.,numberoftrials,stimuluscharacteristics,primarydependentmeasure)standardizedonanempiricalbasis?No.

4.Towhatextentisthetask(ordifferentversionsofthetask)suitableforuseacrosslab-basedstudies,clinicaltrials(asameasureoftargetengagementorclinicaloutcome),and/orhigh-throughputscreeningsettings?Nostandardizedparadigmsthathavebeenuse;hasnotbeenusedinclinicaloutcomestudies,althoughithasbeencorrelatedwithstressresponseandabnormalitiesreportedinpsychiatricpopulations.SeePeterLangstudies.

5.Isthetaskfreefromfloor/ceilingeffectssothatitcanbeusedacrossindividualswiththefullrangeofperformance/impairmentonthetasks?Unknown,buttherearenon-respondersintask-responseversion.

6.Canthetaskbeused(oradaptedforuse)withchildrenandotherspecialpopulations?Canitbeusedacrossagegroups?Canitbeusedacrossdifferentculturalsettings?Yes.

7.Canthetaskbeusedasastand-alonebehavioraltask?N/A

8.Isthetasksuitableforuseinhumansubjectsinavarietyoflabenvironments?Isthetaskfeasibleforadministrationacrosssites?Whatworkisneededtomakethetaskreadyforuseinclinicaltrials?

9.Areadequatenormativedataavailableacrossage,gender,education,ethnicity,SES?Somenormativedatainhealthyyoungadultsandwithrespecttotheseothervariables.

10.Isthetaskcurrentlyinwideusageorhasitsusebeenlimitedtoafewresearchgroups?Widelyused,butnotinrelationtotreatmentresponseinpsychiatricdisorders.

BehavioralAssessmentMethodsforRDoCConstructs

126

11.Isthetasksensitivetowithin-personchange?Yesfortonicmeasure;repeatedstimulicanpossiblyleadtohabituation.Hasbeenusedinsomebiofeedbackstudiestoshowchange.

12.Canthetaskbeusedwithmethodstointerrogatebraincircuitry(e.g.,fMRI,EEG,etc.)?Yes

13.Canthetask(oritsanalog)beusedinanimals?Isananimalversionavailable?No.

14.Aretherelationshipsbetweentaskperformanceandneuralsignal(s)known?Somestudiescorrelatingfunctionalimagingwithelectrodermalskinresponse.

15.Aretherelationshipsbetweentaskperformanceandclinicalfeature(s)known?Associatedwithstress/anxiety.

16.Isthetaskfreelydistributed(i.e.,notcopyrighted)?Yes

17.DoesthetaskassessmultipleRDoCconstructsorisitspecifictojustone?Ifitassessesmultipleconstructs,doesitallowforunambiguousconclusionsaboutthetargetedconstruct?Affected/assessesmultipleconstructssuchaspositive/negativevalence,relatedtostress/anxiety.

18.Ifthereisnoexistingtaskavailableforaconstruct,isthereataskthatcouldbemodifiedtofittheconstruct?N/A

BehavioralAssessmentMethodsforRDoCConstructs

127

APPENDIXARS-Ib:Summaryofdiscussionofhowwelleachtaskmettheproposedcriteriafortaskevaluation.

Task:Psychomotorvigilancetask(PVT)

Construct:AROUSAL

1.HowstrongistheevidencethatthetaskprovidesavalidmeasureoftheRDoCconstruct?Primarilyatestofalertness,whichisrelatedtoarousalandaffectedbysleep/sleeploss,circadianrhythm,timeontask.

2.Howgoodistheevidenceaboutthepsychometricscharacteristicsofthetask(e.g.,internalreliability,testretest,floorandceilingeffects,practiceeffects,availabilityofalternateforms,longitudinalstability)?Testneedstobedonemultipletimesduringthedayforeachtimepointifnotdoneundersleepdeprivationconditions;thereareceilingeffects.

3.Areparametersforadministeringthetask(e.g.,numberoftrials,stimuluscharacteristics,primarydependentmeasure)standardizedonanempiricalbasis?Yes.

4.Towhatextentisthetask(ordifferentversionsofthetask)suitableforuseacrosslab-basedstudies,clinicaltrials(asameasureoftargetengagementorclinicaloutcome),and/orhigh-throughputscreeningsettings?Maybeusedinthesesettings.

5.Isthetaskfreefromfloor/ceilingeffectssothatitcanbeusedacrossindividualswiththefullrangeofperformance/impairmentonthetasks?Ceilingeffects.

6.Canthetaskbeused(oradaptedforuse)withchildrenandotherspecialpopulations?Canitbeusedacrossagegroups?Canitbeusedacrossdifferentculturalsettings?Yes.

7.Canthetaskbeusedasastand-alonebehavioraltask?

8.Isthetasksuitableforuseinhumansubjectsinavarietyoflabenvironments?Isthetaskfeasibleforadministrationacrosssites?Whatworkisneededtomakethetaskreadyforuseinclinicaltrials?

9.Areadequatenormativedataavailableacrossage,gender,education,ethnicity,SES?Yes.

10.Isthetaskcurrentlyinwideusageorhasitsusebeenlimitedtoafewresearchgroups?Moderateuse.

11.Isthetasksensitivetowithin-personchange?Yes.

12.Canthetaskbeusedwithmethodstointerrogatebraincircuitry(e.g.,fMRI,EEG,etc.)?Yes.

13.Canthetask(oritsanalog)beusedinanimals?Isananimalversionavailable?No.

14.Aretherelationshipsbetweentaskperformanceandneuralsignal(s)known?No.

BehavioralAssessmentMethodsforRDoCConstructs

128

15.Aretherelationshipsbetweentaskperformanceandclinicalfeature(s)known?RelatedtoADHD,sleepdeprivation.

16.Isthetaskfreelydistributed(i.e.,notcopyrighted)?Yes.

17.DoesthetaskassessmultipleRDoCconstructsorisitspecifictojustone?Ifitassessesmultipleconstructs,doesitallowforunambiguousconclusionsaboutthetargetedconstruct?Relatedtoattention/arousal.

BehavioralAssessmentMethodsforRDoCConstructs

129

APPENDIXARS-Ic:Summaryofdiscussionofhowwelleachtaskmettheproposedcriteriafortaskevaluation.

Task:Pupillometryincontrolledcontext

Construct:AROUSAL

1.HowstrongistheevidencethatthetaskprovidesavalidmeasureoftheRDoCconstruct?Oneofthebettermeasuresofarousal.

2.Howgoodistheevidenceaboutthepsychometricscharacteristicsofthetask(e.g.,internalreliability,testretest,floorandceilingeffects,practiceeffects,availabilityofalternateforms,longitudinalstability)?Affectedbymanyfactors;within-andbetween-subjectvariabilitycanbeproblematic.Hassomeceilingandflooreffects.

3.Areparametersforadministeringthetask(e.g.,numberoftrials,stimuluscharacteristics,primarydependentmeasure)standardizedonanempiricalbasis?Moreworkneededonadministrationandanalysisstandardization.

4.Towhatextentisthetask(ordifferentversionsofthetask)suitableforuseacrosslab-basedstudies,clinicaltrials(asameasureoftargetengagementorclinicaloutcome),and/orhigh-throughputscreeningsettings?Suitableforclinicaltrials;maybemoresuitableforhigh-throughputastechnologyisdeveloped.

5.Isthetaskfreefromfloor/ceilingeffectssothatitcanbeusedacrossindividualswiththefullrangeofperformance/impairmentonthetasks?Reasonablygoodforthis.

6.Canthetaskbeused(oradaptedforuse)withchildrenandotherspecialpopulations?Canitbeusedacrossagegroups?Canitbeusedacrossdifferentculturalsettings?Yes.

7.Canthetaskbeusedasastand-alonebehavioraltask?No.

8.Isthetasksuitableforuseinhumansubjectsinavarietyoflabenvironments?Isthetaskfeasibleforadministrationacrosssites?Whatworkisneededtomakethetaskreadyforuseinclinicaltrials?Notenoughexperienceyet;needsmorework.

9.Areadequatenormativedataavailableacrossage,gender,education,ethnicity,SES?No.

10.Isthetaskcurrentlyinwideusageorhasitsusebeenlimitedtoafewresearchgroups?Notwidespreadbutuseincreasing.

11.Isthetasksensitivetowithin-personchange?Yes,butnotextensivestudies,mostlookingatwithin-subjectchangetosleeploss;alsowiththecaveatofvariability.

12.Canthetaskbeusedwithmethodstointerrogatebraincircuitry(e.g.,fMRI,EEG,etc.)?Yes.

BehavioralAssessmentMethodsforRDoCConstructs

130

13.Canthetask(oritsanalog)beusedinanimals?Isananimalversionavailable?Yes;limited.

14.Aretherelationshipsbetweentaskperformanceandneuralsignal(s)known?Yes.

15.Aretherelationshipsbetweentaskperformanceandclinicalfeature(s)known?Yes,relatedtosleepiness,interest.

16.Isthetaskfreelydistributed(i.e.,notcopyrighted)?Yes

17.DoesthetaskassessmultipleRDoCconstructsorisitspecifictojustone?Ifitassessesmultipleconstructs,doesitallowforunambiguousconclusionsaboutthetargetedconstruct?Fairlytightlyrelatedtoarousal,mainissueisstandardization.

18.Ifthereisnoexistingtaskavailableforaconstruct,isthereataskthatcouldbemodifiedtofittheconstruct?

BehavioralAssessmentMethodsforRDoCConstructs

131

APPENDIXARS-Id:Summaryofdiscussionofhowwelleachtaskmettheproposedcriteriafortaskevaluation.

Task:Heartratevariability

Construct:AROUSAL

1.HowstrongistheevidencethatthetaskprovidesavalidmeasureoftheRDoCconstruct?Providesinformationonparasympathetic/sympatheticNSbalance.

2.Howgoodistheevidenceaboutthepsychometricscharacteristicsofthetask(e.g.,internalreliability,testretest,floorandceilingeffects,practiceeffects,availabilityofalternateforms,longitudinalstability)?Isaffectedbyvariousfactors,canbeanoisymeasure.Inwideuse,reasonabletest-retestconsistency.

3.Areparametersforadministeringthetask(e.g.,numberoftrials,stimuluscharacteristics,primarydependentmeasure)standardizedonanempiricalbasis?Variabilityinadministrationandanalysis;recommendmoreworktostandardize.

4.Towhatextentisthetask(ordifferentversionsofthetask)suitableforuseacrosslab-basedstudies,clinicaltrials(asameasureoftargetengagementorclinicaloutcome),and/orhigh-throughputscreeningsettings?Easytoadminister,moreeasilyscalablethanmanyothermeasures.

5.Isthetaskfreefromfloor/ceilingeffectssothatitcanbeusedacrossindividualswiththefullrangeofperformance/impairmentonthetasks?

6.Canthetaskbeused(oradaptedforuse)withchildrenandotherspecialpopulations?Canitbeusedacrossagegroups?Canitbeusedacrossdifferentculturalsettings?

7.Canthetaskbeusedasastand-alonebehavioraltask?

8.Isthetasksuitableforuseinhumansubjectsinavarietyoflabenvironments?Isthetaskfeasibleforadministrationacrosssites?Whatworkisneededtomakethetaskreadyforuseinclinicaltrials?

9.Areadequatenormativedataavailableacrossage,gender,education,ethnicity,SES?Yes.

10.Isthetaskcurrentlyinwideusageorhasitsusebeenlimitedtoafewresearchgroups?Yes.

11.Isthetasksensitivetowithin-personchange?Yes,changesinresponsetointerventions.

12.Canthetaskbeusedwithmethodstointerrogatebraincircuitry(e.g.,fMRI,EEG,etc.)?Yes.

13.Canthetask(oritsanalog)beusedinanimals?Isananimalversionavailable?Yes.

BehavioralAssessmentMethodsforRDoCConstructs

132

14.Aretherelationshipsbetweentaskperformanceandneuralsignal(s)known?Someinformationavailable.

15.Aretherelationshipsbetweentaskperformanceandclinicalfeature(s)known?Yes;associatedwithmood,anxiety,stress,drugeffects,etc.

16.Isthetaskfreelydistributed(i.e.,notcopyrighted)?Yes.

17.DoesthetaskassessmultipleRDoCconstructsorisitspecifictojustone?Ifitassessesmultipleconstructs,doesitallowforunambiguousconclusionsaboutthetargetedconstruct?Yes,fairlyspecificforarousal.

18.Ifthereisnoexistingtaskavailableforaconstruct,isthereataskthatcouldbemodifiedtofittheconstruct?

BehavioralAssessmentMethodsforRDoCConstructs

133

APPENDIXARS-Ie:Summaryofdiscussionofhowwelleachtaskmettheproposedcriteriafortaskevaluation.

Task:Sleepspindlescharacteristics(density,amplitude,frequency,duration,topography)measuredbypolysomnography,particularlyinstageN2sleep.

Construct:SLEEP-WAKEFULNESS

1.HowstrongistheevidencethatthetaskprovidesavalidmeasureoftheRDoCconstruct?ValidasameasureofthalamocorticalcircuitrythatisinvolvedinNREMsleepprocess;mostinformationavailableforspindledensity.

2.Howgoodistheevidenceaboutthepsychometricscharacteristicsofthetask(e.g.,internalreliability,testretest,floorandceilingeffects,practiceeffects,availabilityofalternateforms,longitudinalstability)?Stablemeasurewithexcellenttest-retestreliability.

3.Areparametersforadministeringthetask(e.g.,numberoftrials,stimuluscharacteristics,primarydependentmeasure)standardizedonanempiricalbasis?EEGrecordingandvisualspindleidentificationstandardized,butthereissomevariabilityacrosslabsregardingfrequencydefinition.

4.Towhatextentisthetask(ordifferentversionsofthetask)suitableforuseacrosslab-basedstudies,clinicaltrials(asameasureoftargetengagementorclinicaloutcome),and/orhigh-throughputscreeningsettings?Dependsatpresentonperformingovernightsleepstudyinlaboratory,solesssuitableforhigh-throughputsettings.Needtodetermineifnapdatawouldbesufficient.

5.Isthetaskfreefromfloor/ceilingeffectssothatitcanbeusedacrossindividualswiththefullrangeofperformance/impairmentonthetasks?Yes.

6.Canthetaskbeused(oradaptedforuse)withchildrenandotherspecialpopulations?Canitbeusedacrossagegroups?Canitbeusedacrossdifferentculturalsettings?Yes.

7.Canthetaskbeusedasastand-alonebehavioraltask?N/A.

8.Areadequatenormativedataavailableacrossage,gender,education,ethnicity,SES?Pending.

9.Isthetaskcurrentlyinwideusageorhasitsusebeenlimitedtoafewresearchgroups?Usageincreasing.

10.Isthetasksensitivetowithin-personchange?Yes,butmoretrait-like.

11.Canthetaskbeusedwithmethodstointerrogatebraincircuitry(e.g.,fMRI,EEG,etc.)?Yes.

12.Canthetask(oritsanalog)beusedinanimals?Isananimalversionavailable?Yes.

BehavioralAssessmentMethodsforRDoCConstructs

134

13.Aretherelationshipsbetweentaskperformanceandneuralsignal(s)known?Yes.

14.Aretherelationshipsbetweentaskperformanceandclinicalfeature(s)known?Yes.

15.Isthetaskfreelydistributed(i.e.,notcopyrighted)?Yes.

16.DoesthetaskassessmultipleRDoCconstructsorisitspecifictojustone?Ifitassessesmultipleconstructs,doesitallowforunambiguousconclusionsaboutthetargetedconstruct?Fairlyspecifictosleep,althoughassociatedwithcognitionaswellassleep.

17.Ifthereisnoexistingtaskavailableforaconstruct,isthereataskthatcouldbemodifiedtofittheconstruct?N/A

BehavioralAssessmentMethodsforRDoCConstructs

135

APPENDIXARS-If:Summaryofdiscussionofhowwelleachtaskmettheproposedcriteriafortaskevaluation.

Task:MultipleSleepLatencyTest(MSLT)

Construct:SLEEP-WAKEFULNESS

1.HowstrongistheevidencethatthetaskprovidesavalidmeasureoftheRDoCconstruct?Strongmeasureofsleepiness;consideredagoldstandard.

2.Howgoodistheevidenceaboutthepsychometricscharacteristicsofthetask(e.g.,internalreliability,testretest,floorandceilingeffects,practiceeffects,availabilityofalternateforms,longitudinalstability)?Limitedonlyby“noise”relatedtovariability.

3.Areparametersforadministeringthetask(e.g.,numberoftrials,stimuluscharacteristics,primarydependentmeasure)standardizedonanempiricalbasis?Yes.

4.Towhatextentisthetask(ordifferentversionsofthetask)suitableforuseacrosslab-basedstudies,clinicaltrials(asameasureoftargetengagementorclinicaloutcome),and/orhigh-throughputscreeningsettings?Limitedbyneedtobeperformedinasleeplaboratory.

5.Isthetaskfreefromfloor/ceilingeffectssothatitcanbeusedacrossindividualswiththefullrangeofperformance/impairmentonthetasks?Yes,ceilingeffect.

6.Canthetaskbeused(oradaptedforuse)withchildrenandotherspecialpopulations?Canitbeusedacrossagegroups?Canitbeusedacrossdifferentculturalsettings?Yes.

7.Canthetaskbeusedasastand-alonebehavioraltask?Yes.

8.Isthetasksuitableforuseinhumansubjectsinavarietyoflabenvironments?Isthetaskfeasibleforadministrationacrosssites?Whatworkisneededtomakethetaskreadyforuseinclinicaltrials?Isusedinmanyofthesesettings.

9.Areadequatenormativedataavailableacrossage,gender,education,ethnicity,SES?Yes.

10.Isthetaskcurrentlyinwideusageorhasitsusebeenlimitedtoafewresearchgroups?Widelyused.

11.Isthetasksensitivetowithin-personchange?Yes.

12.Canthetaskbeusedwithmethodstointerrogatebraincircuitry(e.g.,fMRI,EEG,etc.)?Yes.

13.Canthetask(oritsanalog)beusedinanimals?Isananimalversionavailable?No.

14.Aretherelationshipsbetweentaskperformanceandneuralsignal(s)known?No.

15.Aretherelationshipsbetweentaskperformanceandclinicalfeature(s)known?Yes.

BehavioralAssessmentMethodsforRDoCConstructs

136

16.Isthetaskfreelydistributed(i.e.,notcopyrighted)?Yes.

17.DoesthetaskassessmultipleRDoCconstructsorisitspecifictojustone?Ifitassessesmultipleconstructs,doesitallowforunambiguousconclusionsaboutthetargetedconstruct?Specificforsleepiness.

BehavioralAssessmentMethodsforRDoCConstructs

137

APPENDIXARS-Ig:Summaryofdiscussionofhowwelleachtaskmettheproposedcriteriafortaskevaluation.

Task:Polysomnographically-definedsleeparchitecture(sleeplatency,wakefulnessaftersleeponset,totalsleeptime)

Construct:SLEEP-WAKEFULNESS

1. HowstrongistheevidencethatthetaskprovidesavalidmeasureoftheRDoCconstruct?Goldstandard.

2.Howgoodistheevidenceaboutthepsychometricscharacteristicsofthetask(e.g.,internalreliability,testretest,floorandceilingeffects,practiceeffects,availabilityofalternateforms,longitudinalstability)?Thereisaflooreffectonsomeparameters(eg,sleeplatencyandWASO),night-to-nightvariabilityandaccommodationeffectssleepinginthesleeplab.

3.Areparametersforadministeringthetask(e.g.,numberoftrials,stimuluscharacteristics,primarydependentmeasure)standardizedonanempiricalbasis?Yes.

4.Towhatextentisthetask(ordifferentversionsofthetask)suitableforuseacrosslab-basedstudies,clinicaltrials(asameasureoftargetengagementorclinicaloutcome),and/orhigh-throughputscreeningsettings?Dependsatpresentonperformingovernightsleepstudyinlaboratory,solesssuitableforhigh-throughputsettings.Needtodetermineifnapdatawouldbesufficient.

5.Isthetaskfreefromfloor/ceilingeffectssothatitcanbeusedacrossindividualswiththefullrangeofperformance/impairmentonthetasks?Canbeusedacrosswiderangeofindividualsbuttherearesomefloor/ceilingeffectsasnotedabove(2).

6.Canthetaskbeused(oradaptedforuse)withchildrenandotherspecialpopulations?Canitbeusedacrossagegroups?Canitbeusedacrossdifferentculturalsettings?Yes.

7.Canthetaskbeusedasastand-alonebehavioraltask?N/A.

8.Isthetasksuitableforuseinhumansubjectsinavarietyoflabenvironments?Isthetaskfeasibleforadministrationacrosssites?Whatworkisneededtomakethetaskreadyforuseinclinicaltrials?Suitableforuseinavarietyofenvironmentsandhasbeenusedextensivelyinmulti-siteclinicaltrials.

9.Areadequatenormativedataavailableacrossage,gender,education,ethnicity,SES?Yes.

10.Isthetaskcurrentlyinwideusageorhasitsusebeenlimitedtoafewresearchgroups?Widelyutilized.

11.Isthetasksensitivetowithin-personchange?Yes,butlimitedsomewhatbynight-to-nightvariability.

BehavioralAssessmentMethodsforRDoCConstructs

138

12.Canthetaskbeusedwithmethodstointerrogatebraincircuitry(e.g.,fMRI,EEG,etc.)?Yes.

13.Canthetask(oritsanalog)beusedinanimals?Isananimalversionavailable?Yes.

14.Aretherelationshipsbetweentaskperformanceandneuralsignal(s)known?SleepEEGisaneuralsignal.

15.Aretherelationshipsbetweentaskperformanceandclinicalfeature(s)known?Yes.

16.Isthetaskfreelydistributed(i.e.,notcopyrighted)?Yes.

17.DoesthetaskassessmultipleRDoCconstructsorisitspecifictojustone?Ifitassessesmultipleconstructs,doesitallowforunambiguousconclusionsaboutthetargetedconstruct?Specificforthisconstruct.

BehavioralAssessmentMethodsforRDoCConstructs

139

APPENDIXARS-Ih:Summaryofdiscussionofhowwelleachtaskmettheproposedcriteriafortaskevaluation.

Task:Slowwavemeasures(declineacrossthenightashomeostaticmeasure,NREMaverageslowwavepower)

Construct:SLEEP-WAKEFULNESS

1.HowstrongistheevidencethatthetaskprovidesavalidmeasureoftheRDoCconstruct?Definingelectrophysiologicalmarkerofsleep.

2.Howgoodistheevidenceaboutthepsychometricscharacteristicsofthetask(e.g.,internalreliability,testretest,floorandceilingeffects,practiceeffects,availabilityofalternateforms,longitudinalstability)?Somenight-to-nightvariability.

3.Areparametersforadministeringthetask(e.g.,numberoftrials,stimuluscharacteristics,primarydependentmeasure)standardizedonanempiricalbasis?Somevariabilityacrosslabsregardingmeasurement.

4.Towhatextentisthetask(ordifferentversionsofthetask)suitableforuseacrosslab-basedstudies,clinicaltrials(asameasureoftargetengagementorclinicaloutcome),and/orhigh-throughputscreeningsettings?Dependsatpresentonperformingovernightsleepstudyinlaboratory,solesssuitableforhigh-throughputsettings.Needtodetermineifnapdatawouldbesufficient.

5.Isthetaskfreefromfloor/ceilingeffectssothatitcanbeusedacrossindividualswiththefullrangeofperformance/impairmentonthetasks?TherecanbeflooreffectsinindividualswithoutmuchSWA;canbeconfoundedinelderlywithgeneralizedEEGslowing.

6.Canthetaskbeused(oradaptedforuse)withchildrenandotherspecialpopulations?Canitbeusedacrossagegroups?Canitbeusedacrossdifferentculturalsettings?Yes.

7.Canthetaskbeusedasastand-alonebehavioraltask?No;needstobecorrelatedwithothermeasures.

8.Isthetasksuitableforuseinhumansubjectsinavarietyoflabenvironments?Isthetaskfeasibleforadministrationacrosssites?Whatworkisneededtomakethetaskreadyforuseinclinicaltrials?Easytocollectdata,notalllabsanalyzeslowwaves.

9.Areadequatenormativedataavailableacrossage,gender,education,ethnicity,SES?Yes.

10.Isthetaskcurrentlyinwideusageorhasitsusebeenlimitedtoafewresearchgroups?Datacollectedwidelybutnotanalyzedinmanylabs.

11.Isthetasksensitivetowithin-personchange?Yes.

BehavioralAssessmentMethodsforRDoCConstructs

140

12.Canthetaskbeusedwithmethodstointerrogatebraincircuitry(e.g.,fMRI,EEG,etc.)?Yes.

13.Canthetask(oritsanalog)beusedinanimals?Isananimalversionavailable?Yes.

14.Aretherelationshipsbetweentaskperformanceandneuralsignal(s)known?Yes.

15.Aretherelationshipsbetweentaskperformanceandclinicalfeature(s)known?Yes.

16.Isthetaskfreelydistributed(i.e.,notcopyrighted)?Yes.

17.DoesthetaskassessmultipleRDoCconstructsorisitspecifictojustone?Ifitassessesmultipleconstructs,doesitallowforunambiguousconclusionsaboutthetargetedconstruct?Specifictosleep.

BehavioralAssessmentMethodsforRDoCConstructs

141

APPENDIXARS-Ii:Summaryofdiscussionofhowwelleachtaskmettheproposedcriteriafortaskevaluation.

Task:InsomniaSeverityIndex(ISI)

Construct:SLEEP-WAKEFULNESS

1.HowstrongistheevidencethatthetaskprovidesavalidmeasureoftheRDoCconstruct?Validmeasureofinsomniaanddaytimeconsequences.

2.Howgoodistheevidenceaboutthepsychometricscharacteristicsofthetask(e.g.,internalreliability,testretest,floorandceilingeffects,practiceeffects,availabilityofalternateforms,longitudinalstability)?Excellent.

3.Areparametersforadministeringthetask(e.g.,numberoftrials,stimuluscharacteristics,primarydependentmeasure)standardizedonanempiricalbasis?Yes.

4.Towhatextentisthetask(ordifferentversionsofthetask)suitableforuseacrosslab-basedstudies,clinicaltrials(asameasureoftargetengagementorclinicaloutcome),and/orhigh-throughputscreeningsettings?Easilyused;shortself-administeredscale.

5.Isthetaskfreefromfloor/ceilingeffectssothatitcanbeusedacrossindividualswiththefullrangeofperformance/impairmentonthetasks?Yes.

6.Canthetaskbeused(oradaptedforuse)withchildrenandotherspecialpopulations?Canitbeusedacrossagegroups?Canitbeusedacrossdifferentculturalsettings?Notvalidatedinchildren,hasbeentranslatedintoseverallanguages.

7.Canthetaskbeusedasastand-alonebehavioraltask?Notabehavioraltask.

8.Isthetasksuitableforuseinhumansubjectsinavarietyoflabenvironments?Isthetaskfeasibleforadministrationacrosssites?Whatworkisneededtomakethetaskreadyforuseinclinicaltrials?Usedwidelyinclinicaltrials.

9.Areadequatenormativedataavailableacrossage,gender,education,ethnicity,SES?Yes.

10.Isthetaskcurrentlyinwideusageorhasitsusebeenlimitedtoafewresearchgroups?Widelyused.

11.Isthetasksensitivetowithin-personchange?Yes.

12.Canthetaskbeusedwithmethodstointerrogatebraincircuitry(e.g.,fMRI,EEG,etc.)?N/A.

13.Canthetask(oritsanalog)beusedinanimals?Isananimalversionavailable?N/A.

14.Aretherelationshipsbetweentaskperformanceandneuralsignal(s)known?Yes.

BehavioralAssessmentMethodsforRDoCConstructs

142

15.Aretherelationshipsbetweentaskperformanceandclinicalfeature(s)known?Yes.

16.Isthetaskfreelydistributed(i.e.,notcopyrighted)?Yes.

17.DoesthetaskassessmultipleRDoCconstructsorisitspecifictojustone?Ifitassessesmultipleconstructs,doesitallowforunambiguousconclusionsaboutthetargetedconstruct?Measuresinsomnia.

BehavioralAssessmentMethodsforRDoCConstructs

143

APPENDIXARS-Ij:Summaryofdiscussionofhowwelleachtaskmettheproposedcriteriafortaskevaluation.

Task:FingertappingMotorSequenceTask(MST)

Construct:SLEEP-WAKEFULNESS

1.HowstrongistheevidencethatthetaskprovidesavalidmeasureoftheRDoCconstruct?Validmeasureofsleepdependentmemoryconsolidation.

2.Howgoodistheevidenceaboutthepsychometricscharacteristicsofthetask(e.g.,internalreliability,testretest,floorandceilingeffects,practiceeffects,availabilityofalternateforms,longitudinalstability)?Gooddataontheseparameters.

3.Areparametersforadministeringthetask(e.g.,numberoftrials,stimuluscharacteristics,primarydependentmeasure)standardizedonanempiricalbasis?Yes.

4.Towhatextentisthetask(ordifferentversionsofthetask)suitableforuseacrosslab-basedstudies,clinicaltrials(asameasureoftargetengagementorclinicaloutcome),and/orhigh-throughputscreeningsettings?Needstobedonetwiceseparatedby12or24hrs,whichcanbelimiting.

5.Isthetaskfreefromfloor/ceilingeffectssothatitcanbeusedacrossindividualswiththefullrangeofperformance/impairmentonthetasks?Flooreffectinelderly(maynotshowsleep-dependentlearning).

6.Canthetaskbeused(oradaptedforuse)withchildrenandotherspecialpopulations?Canitbeusedacrossagegroups?Canitbeusedacrossdifferentculturalsettings?Nonormsyetinchildren.Age-relatedchangesnotwellstudied.

7.Canthetaskbeusedasastand-alonebehavioraltask?Yes.

8.Isthetasksuitableforuseinhumansubjectsinavarietyoflabenvironments?Isthetaskfeasibleforadministrationacrosssites?Whatworkisneededtomakethetaskreadyforuseinclinicaltrials?Feasibletouseacrosssites.Usedinclinicaltrials.

9.Areadequatenormativedataavailableacrossage,gender,education,ethnicity,SES?No.

10.Isthetaskcurrentlyinwideusageorhasitsusebeenlimitedtoafewresearchgroups?Mostwidelyusedprobeforsleep-dependentlearning,butnotalotoflabsworkingonthis.

11.Isthetasksensitivetowithin-personchange?Yes.

12.Canthetaskbeusedwithmethodstointerrogatebraincircuitry(e.g.,fMRI,EEG,etc.)?Yes.

13.Canthetask(oritsanalog)beusedinanimals?Isananimalversionavailable?N/A.

BehavioralAssessmentMethodsforRDoCConstructs

144

14.Aretherelationshipsbetweentaskperformanceandneuralsignal(s)known?Neuroimagingstudiesexist,butnotmany.

15.Aretherelationshipsbetweentaskperformanceandclinicalfeature(s)known?Yes.

16.Isthetaskfreelydistributed(i.e.,notcopyrighted)?Yes.

17.DoesthetaskassessmultipleRDoCconstructsorisitspecifictojustone?Ifitassessesmultipleconstructs,doesitallowforunambiguousconclusionsaboutthetargetedconstruct?Measuressleep-dependentlearning/restorativeaspectsofsleepfairlyspecifically.

BehavioralAssessmentMethodsforRDoCConstructs

145

APPENDIXARS-Ik:Summaryofdiscussionofhowwelleachtaskmettheproposedcriteriafortaskevaluation.

Task:Dimlightmelatoninonset(DLMO)

Construct:CIRCADIANRHYTHMS

1.HowstrongistheevidencethatthetaskprovidesavalidmeasureoftheRDoCconstruct?Verystrong.

2.Howgoodistheevidenceaboutthepsychometricscharacteristicsofthetask(e.g.,internalreliability,testretest,floorandceilingeffects,practiceeffects,availabilityofalternateforms,longitudinalstability)?Probablythebestmarkerforcircadianphase;caveatisthatsomesubjectshavelowlevelsofmelatonin.

3.Areparametersforadministeringthetask(e.g.,numberoftrials,stimuluscharacteristics,primarydependentmeasure)standardizedonanempiricalbasis?Yes.

4.Towhatextentisthetask(ordifferentversionsofthetask)suitableforuseacrosslab-basedstudies,clinicaltrials(asameasureoftargetengagementorclinicaloutcome),and/orhigh-throughputscreeningsettings?Notidealforhigh-throughputstudies,otherwiseusefulinclinicalresearch/trials.

5.Isthetaskfreefromfloor/ceilingeffectssothatitcanbeusedacrossindividualswiththefullrangeofperformance/impairmentonthetasks?Fewsubjectsmayhavelowlevels(flooreffect).

6.Canthetaskbeused(oradaptedforuse)withchildrenandotherspecialpopulations?Canitbeusedacrossagegroups?Canitbeusedacrossdifferentculturalsettings?Yes.

7.Canthetaskbeusedasastand-alonebehavioraltask?N/A

8.Isthetasksuitableforuseinhumansubjectsinavarietyoflabenvironments?Isthetaskfeasibleforadministrationacrosssites?Whatworkisneededtomakethetaskreadyforuseinclinicaltrials?Yes.

9.Areadequatenormativedataavailableacrossage,gender,education,ethnicity,SES?Somedatainpublishedstudies.

10.Isthetaskcurrentlyinwideusageorhasitsusebeenlimitedtoafewresearchgroups?Usedinanumberoflabs;samplesneedtoberunbyqualifiedlabs.

11.Isthetasksensitivetowithin-personchange?Yes.

12.Canthetaskbeusedwithmethodstointerrogatebraincircuitry(e.g.,fMRI,EEG,etc.)?N/A.

BehavioralAssessmentMethodsforRDoCConstructs

146

13.Canthetask(oritsanalog)beusedinanimals?Isananimalversionavailable?Yes.

14.Aretherelationshipsbetweentaskperformanceandneuralsignal(s)known?Yes.

15.Aretherelationshipsbetweentaskperformanceandclinicalfeature(s)known?Moredataneeded.

16.Isthetaskfreelydistributed(i.e.,notcopyrighted)?Yes.

17.DoesthetaskassessmultipleRDoCconstructsorisitspecifictojustone?Ifitassessesmultipleconstructs,doesitallowforunambiguousconclusionsaboutthetargetedconstruct?Fairlyspecificforcircadianphase.

18.Ifthereisnoexistingtaskavailableforaconstruct,isthereataskthatcouldbemodifiedtofittheconstruct?

BehavioralAssessmentMethodsforRDoCConstructs

147

APPENDIXARS-Il:Summaryofdiscussionofhowwelleachtaskmettheproposedcriteriafortaskevaluation.

Task:Actigraphymeasuredlongitudinally(cosinoranalysis:acrophase,mesor,amplitude)

Construct:CIRCADIANRHYTHMS

1.HowstrongistheevidencethatthetaskprovidesavalidmeasureoftheRDoCconstruct?Fairlystrongbasedonactivitypattern.

2.Howgoodistheevidenceaboutthepsychometricscharacteristicsofthetask(e.g.,internalreliability,testretest,floorandceilingeffects,practiceeffects,availabilityofalternateforms,longitudinalstability)?Needsoptimization.

3.Areparametersforadministeringthetask(e.g.,numberoftrials,stimuluscharacteristics,primarydependentmeasure)standardizedonanempiricalbasis?Yes.

4.Towhatextentisthetask(ordifferentversionsofthetask)suitableforuseacrosslab-basedstudies,clinicaltrials(asameasureoftargetengagementorclinicaloutcome),and/orhigh-throughputscreeningsettings?Easilyusedinclinicalresearch,canbeusedforlargepopulationbasedstudies.

5.Isthetaskfreefromfloor/ceilingeffectssothatitcanbeusedacrossindividualswiththefullrangeofperformance/impairmentonthetasks?Flooreffectifsubjectsdonotmovearoundmuch.

6.Canthetaskbeused(oradaptedforuse)withchildrenandotherspecialpopulations?Canitbeusedacrossagegroups?Canitbeusedacrossdifferentculturalsettings?Yes.

7.Canthetaskbeusedasastand-alonebehavioraltask?N/A

8.Isthetasksuitableforuseinhumansubjectsinavarietyoflabenvironments?Isthetaskfeasibleforadministrationacrosssites?Whatworkisneededtomakethetaskreadyforuseinclinicaltrials?Morenormativedata.Moreanalytictoolstobetteranalyzeactivitydata(e.g.,functionaldataanalysisapproach).

9.Areadequatenormativedataavailableacrossage,gender,education,ethnicity,SES?Moreneeded.

10.Isthetaskcurrentlyinwideusageorhasitsusebeenlimitedtoafewresearchgroups?Fairlycommonlyusedincircadianresearch.

11.Isthetasksensitivetowithin-personchange?Yes.

12.Canthetaskbeusedwithmethodstointerrogatebraincircuitry(e.g.,fMRI,EEG,etc.)?N/A

BehavioralAssessmentMethodsforRDoCConstructs

148

13.Canthetask(oritsanalog)beusedinanimals?Isananimalversionavailable?Yes(activitymonitoringcommonlyused).

14.Aretherelationshipsbetweentaskperformanceandneuralsignal(s)known?Unknown.

15.Aretherelationshipsbetweentaskperformanceandclinicalfeature(s)known?Somedatainpsychiatricpopulations.

16.Isthetaskfreelydistributed(i.e.,notcopyrighted)?Needtobuysoftware.

17.DoesthetaskassessmultipleRDoCconstructsorisitspecifictojustone?Ifitassessesmultipleconstructs,doesitallowforunambiguousconclusionsaboutthetargetedconstruct?DatacanalsoassessSleep/WakefulnessandArousalconstructs.

18.Ifthereisnoexistingtaskavailableforaconstruct,isthereataskthatcouldbemodifiedtofittheconstruct?

BehavioralAssessmentMethodsforRDoCConstructs

149

APPENDIXARS-Im:Summaryofdiscussionofhowwelleachtaskmettheproposedcriteriafortaskevaluation.

Task:MunichChronotypeQuestionnaire

Construct:CIRCADIANRHYTHMS

1.HowstrongistheevidencethatthetaskprovidesavalidmeasureoftheRDoCconstruct?Measureschronotype.IncontrasttothemorewidelyusedMEQ,whichisbasedonself-reportedpreferencesforsleepschedule,thisquestionnairedetermineschronotypebasedonreportedsleepschedules.

2.Howgoodistheevidenceaboutthepsychometricscharacteristicsofthetask(e.g.,internalreliability,testretest,floorandceilingeffects,practiceeffects,availabilityofalternateforms,longitudinalstability)?Hassomelimitations,suchasthatitisnotaccurateforindividualswhousealarmclockstoawakenondaysofffromwork.Notvalidatedinshiftworkers.

3.Areparametersforadministeringthetask(e.g.,numberoftrials,stimuluscharacteristics,primarydependentmeasure)standardizedonanempiricalbasis?Yes.

4.Towhatextentisthetask(ordifferentversionsofthetask)suitableforuseacrosslab-basedstudies,clinicaltrials(asameasureoftargetengagementorclinicaloutcome),and/orhigh-throughputscreeningsettings?Maybeusedinallthesesituations.

5.Isthetaskfreefromfloor/ceilingeffectssothatitcanbeusedacrossindividualswiththefullrangeofperformance/impairmentonthetasks?Yes.

6.Canthetaskbeused(oradaptedforuse)withchildrenandotherspecialpopulations?Canitbeusedacrossagegroups?Canitbeusedacrossdifferentculturalsettings?Yes,althoughsocioculturalfactorscanaffectresults.Pediatricversionavailable.

7.Canthetaskbeusedasastand-alonebehavioraltask?Yes.

8.Isthetasksuitableforuseinhumansubjectsinavarietyoflabenvironments?Isthetaskfeasibleforadministrationacrosssites?Whatworkisneededtomakethetaskreadyforuseinclinicaltrials?Maybeusedinthesesettings;morenormativedataneeded.

9.Areadequatenormativedataavailableacrossage,gender,education,ethnicity,SES?No,moreneeded.

10.Isthetaskcurrentlyinwideusageorhasitsusebeenlimitedtoafewresearchgroups?LesswidelyusedthantheMEQ.

11.Isthetasksensitivetowithin-personchange?Notgenerallyusedforthispurpose;chronotypeatraitmarker.

BehavioralAssessmentMethodsforRDoCConstructs

150

12.Canthetaskbeusedwithmethodstointerrogatebraincircuitry(e.g.,fMRI,EEG,etc.)?N/A

13.Canthetask(oritsanalog)beusedinanimals?Isananimalversionavailable?N/A

14.Aretherelationshipsbetweentaskperformanceandneuralsignal(s)known?Notspecificallystudied.

15.Aretherelationshipsbetweentaskperformanceandclinicalfeature(s)known?Yes.

16.Isthetaskfreelydistributed(i.e.,notcopyrighted)?Yes,maybedownloadedbutwebsiteasksthatpermissionforuseberequested;nochargeindicated.

17.DoesthetaskassessmultipleRDoCconstructsorisitspecifictojustone?Ifitassessesmultipleconstructs,doesitallowforunambiguousconclusionsaboutthetargetedconstruct?Assesseschronotype.

18.Ifthereisnoexistingtaskavailableforaconstruct,isthereataskthatcouldbemodifiedtofittheconstruct?

BehavioralAssessmentMethodsforRDoCConstructs

151

APPENDIXARS-In:Summaryofdiscussionofhowwelleachtaskmettheproposedcriteriafortaskevaluation.

Task:HorneandOstbergMorningness-EveningnessQuestionnaire(MEQ)

Construct:CIRCADIANRHYTHMS

1.HowstrongistheevidencethatthetaskprovidesavalidmeasureoftheRDoCconstruct?Stronglycorrelatedwithbedandwakingtimes;strongevidenceforvalidity.

2.Howgoodistheevidenceaboutthepsychometricscharacteristicsofthetask(e.g.,internalreliability,testretest,floorandceilingeffects,practiceeffects,availabilityofalternateforms,longitudinalstability)?Dataavailableconfirmingreliability,stabilityinbothadultandchild-adolescentversions;test-retestdatamorescant.

3.Areparametersforadministeringthetask(e.g.,numberoftrials,stimuluscharacteristics,primarydependentmeasure)standardizedonanempiricalbasis?Yes

4.Towhatextentisthetask(ordifferentversionsofthetask)suitableforuseacrosslab-basedstudies,clinicaltrials(asameasureoftargetengagementorclinicaloutcome),and/orhigh-throughputscreeningsettings?Takesonlyminutestocomplete,sosuitableforclinicaltrialsandhigh-throughputsettings.

5.Isthetaskfreefromfloor/ceilingeffectssothatitcanbeusedacrossindividualswiththefullrangeofperformance/impairmentonthetasks?Yes.

6.Canthetaskbeused(oradaptedforuse)withchildrenandotherspecialpopulations?Canitbeusedacrossagegroups?Canitbeusedacrossdifferentculturalsettings?Hasbeentranslatedintoseverallanguagesandapediatricversionisavailable.

7.Canthetaskbeusedasastand-alonebehavioraltask?Yes.

8.Isthetasksuitableforuseinhumansubjectsinavarietyoflabenvironments?Isthetaskfeasibleforadministrationacrosssites?Whatworkisneededtomakethetaskreadyforuseinclinicaltrials?Yes,canbeusedinthesesettingsandinclinicaltrials.

9.Areadequatenormativedataavailableacrossage,gender,education,ethnicity,SES?Somenormativedata(cut-offscores)availableinyoungadults,butvariousfactors(age,gender,socioeconomiclevelcanaffectdistributionofscores).

10.Isthetaskcurrentlyinwideusageorhasitsusebeenlimitedtoafewresearchgroups?Fairlywideusage.

11.Isthetasksensitivetowithin-personchange?N/A

12.Canthetaskbeusedwithmethodstointerrogatebraincircuitry(e.g.,fMRI,EEG,etc.)?N/A

BehavioralAssessmentMethodsforRDoCConstructs

152

13.Canthetask(oritsanalog)beusedinanimals?Isananimalversionavailable?N/A

14.Aretherelationshipsbetweentaskperformanceandneuralsignal(s)known?N/A

15.Aretherelationshipsbetweentaskperformanceandclinicalfeature(s)known?Correlatedwithbiologicalmarkersofcircadianphase.

16.Isthetaskfreelydistributed(i.e.,notcopyrighted)?Yes.

17.DoesthetaskassessmultipleRDoCconstructsorisitspecifictojustone?Ifitassessesmultipleconstructs,doesitallowforunambiguousconclusionsaboutthetargetedconstruct?Specificforchronotype.

BehavioralAssessmentMethodsforRDoCConstructs

153

APPENDIXA:RDOCMATRIXDOMAIN,CONSTRUCTSANDSUBCONSTRUCTDEFINITIONS

AsdefinedduringtheinitialRDoCworkshops.

Arousal/RegulatorySystems:Systemsresponsibleforgeneratingactivationofneuralsystemsasappropriateforvariouscontexts,andprovidingappropriatehomeostaticregulationofsuchsystemsasenergybalanceandsleep.

o Arousal:Arousalisacontinuumofsensitivityoftheorganismtostimuli,bothexternalandinternal.Arousal:

§ facilitatesinteractionwiththeenvironmentinacontext-specificmanner(e.g.,underconditionsofthreat,somestimulimustbeignoredwhilesensitivitytoandresponsestoothersisenhanced,asexemplifiedinthestartlereflex);

§ canbeevokedbyeitherexternal/environmentalstimuliorinternalstimuli(e.g.,emotionsandcognition);

§ canbemodulatedbythephysicalcharacteristicsandmotivationalsignificanceofstimuli;

§ variesalongacontinuumthatcanbequantifiedinanybehavioralstate,includingwakefulnessandlow-arousalstatesincludingsleep,anesthesia,andcoma;

§ isdistinctfrommotivationandvalencebutcanco-varywithintensityofmotivationandvalence;

§ maybeassociatedwithincreasedordecreasedlocomotoractivity;and§ canberegulatedbyhomeostaticdrives(e.g.,hunger,sleep,thirst,sex).

o CircadianRhythms:CircadianRhythmsareendogenousself-sustainingoscillationsthatorganizethetimingofbiologicalsystemstooptimizephysiologyandbehavior,andhealth.CircadianRhythms:

§ aresynchronizedbyrecurringenvironmentalcues;§ anticipatetheexternalenvironment;§ alloweffectiveresponsetochallengesandopportunitiesinthephysicaland

socialenvironment;§ modulatehomeostasiswithinthebrainandother(central/peripheral)

systems,tissuesandorgans;and§ areevidentacrosslevelsoforganizationincludingmolecules,cells,circuits,

systems,organisms,andsocialsystems.o Sleepandwakefulness:Sleepandwakefulnessareendogenous,recurring,

behavioralstatesthatreflectcoordinatedchangesinthedynamicfunctionalorganizationofthebrainandthatoptimizephysiology,behavior,andhealth.

BehavioralAssessmentMethodsforRDoCConstructs

154

Homeostaticandcircadianprocessesregulatethepropensityforwakefulnessandsleep.Sleep:

§ isreversible,typicallycharacterizedbyposturalrecumbence,behavioralquiescence,andreducedresponsiveness;

§ hasacomplexarchitecturewithpredictablecyclingofNREM/REMstatesortheirdevelopmentalequivalents.NREMandREMsleephavedistinctneuralsubstrates(circuitry,transmitters,modulators)andEEGoscillatoryproperties

§ intensityanddurationisaffectedbyhomeostaticregulation;§ isaffectedbyexperiencesduringwakefulness;§ isevidentatcellular,circuit,andsystemlevels;and§ hasrestorativeandtransformativeeffectsthatoptimizeneurobehavioral

functionsduringwakefulness.

CognitiveSystems:Systemsresponsibleforvariouscognitiveprocesses(e.g.,attention,perception,memory,language,andcognitivecontrol).

o Attention:Attentionreferstoarangeofprocessesthatregulateaccesstocapacity-limitedsystems,suchasawareness,higherperceptualprocesses,andmotoraction.Theconceptsofcapacitylimitationandcompetitionareinherenttotheconceptsofselectiveanddividedattention.

o Perception:Perceptionreferstotheprocess(es)thatperformcomputationsonsensorydatatoconstructandtransformrepresentationsoftheexternalenvironment,acquireinformationfrom,andmakepredictionsabout,theexternalworld,andguideaction.

o DeclarativeMemory:Declarativememoryistheacquisitionorencoding,storageandconsolidation,andretrievalofrepresentationsoffactsandevents.Declarativememoryprovidesthecriticalsubstrateforrelationalrepresentations—i.e.,forspatial,temporal,andothercontextualrelationsamongitems,contributingtorepresentationsofevents(episodicmemory)andtheintegrationandorganizationoffactualknowledge(semanticmemory).Theserepresentationsfacilitatetheinferentialandflexibleextractionofnewinformationfromtheserelationships.

o Language:Languageisasystemofsharedsymbolicrepresentationsoftheworld,theselfandabstractconceptsthatsupportsthoughtandcommunication.

o CognitiveControl:Asystemthatmodulatestheoperationofothercognitiveandemotionalsystems,intheserviceofgoal-directedbehavior,whenprepotentmodesofrespondingarenotadequatetomeetthedemandsofthecurrentcontext.Additionally,controlprocessesareengagedinthecaseofnovelcontexts,whereappropriateresponsesneedtobeselectedfromamongcompetingalternatives.

BehavioralAssessmentMethodsforRDoCConstructs

155

o WorkingMemory:WorkingMemoryistheactivemaintenanceandflexibleupdatingofgoal/taskrelevantinformation(items,goals,strategies,etc.)inaformthathaslimitedcapacityandresistsinterference.Theserepresentations:mayinvolveflexiblebindingofrepresentations;maybecharacterizedbytheabsenceofexternalsupportfortheinternallymaintainedrepresentations;andarefrequentlytemporary,thoughthismaybeduetoongoinginterference.Itinvolvesactivemaintenance,flexibleupdating,limitedcapacity,andinterferencecontrol.

NegativeValenceSystems:Systemsprimarilyresponsibleforresponsestoaversivesituationsorcontexts,suchas:

o Responsestoacutethreat(Fear):Activationofthebrain’sdefensivemotivationalsystemtopromotebehaviorsthatprotecttheorganismfromperceiveddanger.Normalfearinvolvesapatternofadaptiveresponsestoconditionedorunconditionedthreatstimuli(exteroceptiveorinteroceptive).Fearcaninvolveinternalrepresentationsandcognitiveprocessing,andcanbemodulatedbyavarietyoffactors.

o Responsestopotentialharm(Anxiety):Activationofabrainsysteminwhichharmmaypotentiallyoccurbutisdistant,ambiguous,orlow/uncertaininprobability,characterizedbyapatternofresponsessuchasenhancedriskassessment(vigilance).Theseresponsestolowimminencethreatsarequalitativelydifferentthanthehighimminencethreatbehaviorsthatcharacterizefear.

o Responsestosustainedthreat:Anaversiveemotionalstatecausedbyprolonged(i.e.,weekstomonths)exposuretointernaland/orexternalcondition(s),state(s),orstimulithatareadaptivetoescapeoravoid.Theexposuremaybeactualoranticipated;thechangesinaffect,cognition,physiology,andbehaviorcausedbysustainedthreatpersistintheabsenceofthethreat,andcanbedifferentiatedfromthosechangesevokedbyacutethreat.

o Frustrativenon-reward:Reactionselicitedinresponsetowithdrawal/preventionofreward,i.e.,bytheinabilitytoobtainpositiverewardsfollowingrepeatedorsustainedefforts.

o Loss:Astateofdeprivationofamotivationallysignificantcon-specific,object,orsituation.Lossmaybesocialornon-socialandmayincludepermanentorsustainedlossofshelter,behavioralcontrol,status,lovedones,orrelationships.Theresponsetolossmaybeepisodic(e.g.,grief)orsustained.

PositiveValenceSystems:Systemsprimarilyresponsibleforresponsestopositivemotivationalsituationsorcontexts,suchas:

BehavioralAssessmentMethodsforRDoCConstructs

156

o Approachmotivation:Amulti-facetedconstructinvolvingmechanisms/processesthatregulatethedirectionandmaintenanceofapproachbehaviorinfluencedbypre-existingtendencies,learning,memory,stimuluscharacteristics,anddeprivationstates.Approachbehaviorcanbedirectedtowardinnateoracquiredcues(i.e.,unconditionedvs.learnedstimuli),implicitorexplicitgoals;itcanconsistofgoal-directedorPavlovianconditionedresponses.Componentprocessesincluderewardvaluation,effortvaluation/willingnesstowork,expectancy/rewardpredictionerror,andactionselection/decisionmaking.

§ Rewardvaluation:Processesbywhichtheprobabilityandbenefitsofaprospectiveoutcomearecomputedandcalibratedbyreferencetoexternalinformation,socialcontext(e.g.,groupinput,counterfactualcomparisons),and/orpriorexperience.Thiscalibrationisinfluencedbypre-existingbiases,learning,memory,stimuluscharacteristics,anddeprivationstates.Rewardvaluationmayinvolvetheassignmentofincentivesaliencetostimuli.

§ Effortvaluation/Willingnesstowork:Processesbywhichthecost(s)ofobtaininganoutcomeiscomputed;tendencytoovercomeresponsecoststoobtainareinforcer.

§ Expectancy/Rewardpredictionerror:Astatetriggeredbyexposuretointernalorexternalstimuli,experiencesorcontextsthatpredictthepossibilityofreward.Rewardexpectationcanaltertheexperienceofanoutcomeandcaninfluencetheuseofresources(e.g.,cognitiveresources).

§ Actionselection/Preference-baseddecisionmaking:Processesinvolvinganevaluationofcosts/benefitsandoccurringinthecontextofmultiplepotentialchoicesbeingavailablefordecision-making.

o Initialresponsivenesstorewardattainment:Mechanisms/processesassociatedwithhedonicresponses—asreflectedinsubjectiveexperiences,behavioralresponses,and/orengagementoftheneuralsystemstoapositivereinforcer—andculminationofrewardseeking.

o Sustained/Longer-termresponsivenesstorewardattainment:Mechanisms/processesassociatedwiththeterminationofrewardseeking,e.g.,satisfaction,satiation,regulationofconsummatorybehavior.

o RewardLearning:Aprocessbywhichorganismsacquireinformationaboutstimuli,actions,andcontextsthatpredictpositiveoutcomes,andbywhichbehaviorismodifiedwhenanovelrewardoccursoroutcomesarebetterthanexpected.Rewardlearningisatypeofreinforcementlearning,andsimilarprocessesmaybeinvolvedinlearningrelatedtonegativereinforcement.

BehavioralAssessmentMethodsforRDoCConstructs

157

o Habit:Sequential,repetitive,motor,orcognitivebehaviorselicitedbyexternalorinternaltriggersthat,onceinitiated,cangotocompletionwithoutconstantconsciousoversight.Habitscanbeadaptivebyvirtueoffreeingupcognitiveresources.Habitformationisafrequentconsequenceofrewardlearning,butitsexpressioncanbecomeresistanttochangesinoutcomevalue.Relatedbehaviorscouldbepathologicalexpressionofaprocessthatundernormalcircumstancessubservesadaptivegoals.

SystemsforSocialProcesses:Systemsthatmediateprocessestointerpersonalsettingsofvarioustypes,includingperceptionandinterpretationofothers’actions.

o AffiliationandAttachment:Affiliationisengagementinpositivesocialinteractionswithotherindividuals.Attachmentisselectiveaffiliationasaconsequenceofthedevelopmentofasocialbond.AffiliationandAttachmentaremoderatedbysocialinformationprocessing(processingofsocialcues)andsocialmotivation.Affiliationisabehavioralconsequenceofsocialmotivationandcanmanifestitselfinsocialapproachbehaviors.AffiliationandAttachmentrequiredetectionofandattentiontosocialcues,aswellassociallearningandmemoryassociatedwiththeformationofrelationships.AffiliationandAttachmentincludeboththepositivephysiologicalconsequencesofsocialinteractionsandthebehavioralandphysiologicalconsequencesofdisruptionstosocialrelationships.ClinicalmanifestationsofdisruptionsinAffiliationandAttachmentincludesocialwithdrawal,socialindifferenceandanhedonia,andover-attachment.

o SocialCommunication:Adynamicprocessthatincludesbothreceptiveandproductiveaspectsusedforexchangeofsociallyrelevantinformation.Socialcommunicationisessentialfortheintegrationandmaintenanceoftheindividualinthesocialenvironment.Thisconstructisreciprocalandinteractive,andsocialcommunicationabilitiesmayappearveryearlyinlife.Socialcommunicationisdistinguishablefromothercognitivesystems(e.g.,perception,cognitivecontrol,memory,attention)inthatitparticularlyinvolvesinteractionswithconspecifics.Theunderlyingneuralsubstratesofsocialcommunicationevolvedtosupportbothautomatic/reflexiveandvolitionalcontrol,includingthemotivationandabilitytoengageinsocialcommunication.Receptiveaspectsmaybeimplicitorexplicit;examplesincludeaffectrecognition,facialrecognitionandcharacterization.Productiveaspectsincludeeyecontact,expressivereciprocation,andgazefollowing.Althoughfacialcommunicationwassetasideasaseparatesub-constructforthepurposesofidentifyingmatrixelements,socialcommunicationtypicallyutilizesinformationfromseveralmodalities,includingfacial,vocal,gestural,postural,andolfactoryprocessing.SocialCommunicationwasorganizedintothefollowingsub-constructs:

BehavioralAssessmentMethodsforRDoCConstructs

158

§ ReceptionofFacialCommunication:Thecapacitytoperceivesomeone’semotionalstatenon-verballybasedonfacialexpressions.

§ ProductionofFacialCommunication:Thecapacitytoconveyone’semotionalstatenon-verballyviafacialexpression.

§ ReceptionofNon-FacialCommunication:Thecapacitytoperceivesocialandemotionalinformationbasedonmodalitiesotherthanfacialexpression,includingnon-verbalgestures,affectiveprosody,distresscalling,cooing,etc.

§ ProductionofNon-FacialCommunication:Thecapacitytoexpresssocialandemotionalinformationbasedonmodalitiesotherthanfacialexpression,includingnon-verbalgestures,affectiveprosody,distresscalling,cooing,etc.

o PerceptionandUnderstandingofSelf:Theprocessesand/orrepresentationsinvolvedinbeingawareof,accessingknowledgeabout,and/ormakingjudgmentsabouttheself.Theseprocesses/representationscanincludecurrentcognitiveoremotionalinternalstates,traits,and/orabilities,eitherinisolationorinrelationshiptoothers,aswellasthemechanismsthatsupportself-awareness,self-monitoring,andself-knowledge.PerceptionandUnderstandingofSelfwasorganizedintothefollowingsub-constructs:

§ Agency:Theabilitytorecognizeone’sselfastheagentofone’sactionsandthoughts,includingtherecognitionofone’sownbody/bodyparts.

§ Self-Knowledge:Theabilitytomakejudgmentsaboutone’scurrentcognitiveoremotionalinternalstates,traits,and/orabilities.

o PerceptionandUnderstandingofOthers:Theprocessesand/orrepresentationsinvolvedinbeingawareof,accessingknowledgeabout,reasoningabout,and/ormakingjudgmentsaboutotheranimateentities,includinginformationaboutcognitiveoremotionalstates,traitsorabilities.PerceptionandUnderstandingofOtherswasorganizedintothefollowingsub-constructs:

§ AnimacyPerception:Theabilitytoappropriatelyperceivethatanotherentityisanagent(i.e.,hasaface,interactscontingently,andexhibitsbiologicalmotion).

§ ActionPerception:Theabilitytoperceivethepurposeofanactionbeingperformedbyananimateentity.

§ UnderstandingMentalStates:Theabilitytomakejudgmentsand/orattributionsaboutthementalstateofotheranimateentitiesthatallowsonetopredictorinterprettheirbehaviors.Mentalstatereferstointentions,beliefs,desires,andemotion

BehavioralAssessmentMethodsforRDoCConstructs

159

APPENDIXB:NAMHCROSTER

NationalAdvisoryMentalHealthCouncilDEPARTMENTOFHEALTHANDHUMANSERVICES

NATIONALINSTITUTESOFHEALTHNATIONALINSTITUTEOFMENTALHEALTH

NATIONALADVISORYMENTALHEALTHCOUNCIL(Termsend9/30ofdesignatedyear)

CHAIRPERSONBruceN.Cuthbert,Ph.D.ActingDirectorNationalInstituteofMentalHealthBethesda,MD

EXECUTIVESECRETARYJeanNoronha,Ph.D.DirectorDivisionofExtramuralActivitiesNationalInstituteofMentalHealthBethesda,MD

MembersPatriciaA.Areán,Ph.D.(16)ProfessorDirectorofTargetedTreatmentDevelopmentDepartmentofPsychiatryandBehavioralSciencesUniversityofWashingtonSeattle,WADeannaM.Barch,Ph.D.(16)GregoryB.CouchProfessorofPsychiatryDepartmentofPsychology,PsychiatryandRadiologyWashingtonUniversitySt.Louis,MODavidA.Brent,M.D.(17)AcademicChiefChild&AdolescentPsychiatryEndowedChairinSuicideStudiesProfessorofPsychiatry,PediatricsandEpidemiologyDirector,ServicesforTeensatRiskUniversityofPittsburghSchoolofMedicinePittsburgh,PABJCasey,Ph.D.(16)SacklerProfessorDepartmentofPsychiatryandNeuroscienceSacklerInstituteforDevelopmentalPsychobiologyWeillMedicalCollegeofCornellUniversityNewYork,NYBenjaminG.Druss,M.D.,M.P.H.(18)RosalynnCarterChairinMentalHealthandProfessorDepartmentofHealthPolicyandManagementRollinsSchoolofPublicHealthEmoryUniversityAtlanta,GAHakonHeimer,M.S.(16)FoundingEditorSchizophreniaResearchForumBrainandBehaviorResearchFoundationProvidence,RI

MichaelF.Hogan,Ph.D.(18)ConsultantandAdvisorHoganHealthSolutionsLLCDelmar,NYRichardL.Huganir,Ph.D.(17)ProfessorandDirectorDepartmentofNeuroscienceInvestigator,HowardHughesMedicalInstituteCo-Director,BrainScienceInstituteTheJohnsHopkinsUniversitySchoolofMedicineBaltimore,MDJohnH.Krystal,M.D.(19)RobertL.McNeil,Jr.ProfessorofTranslationalResearchChair,ProfessorofNeurobiologyChiefofPsychiatry,Yale-NewHavenHospitalDepartmentofPsychiatryYaleUniversitySchoolofMedicineNewHaven,CTMarshaM.Linehan,Ph.D.(17)ProfessorandDirectorBehavioralResearchandTherapyClinicsDepartmentofPsychologyUniversityofWashingtonSeattle,WAMariaA.Oquendo,M.D.(17)ViceChairforEducationProfessorofPsychiatryDepartmentofPsychiatryColumbiaUniversityNewYorkStatePsychiatricInstituteNewYork,NY

BehavioralAssessmentMethodsforRDoCConstructs

160

GeneE.Robinson,Ph.D.(16)Director,CarlR.WoeseInstituteforGenomicBiologySwanlundChairCenterforAdvancedStudyProfessorinEntomologyAndNeuroscienceUniversityofIllinoisatUrbana-ChampaignUrbana,ILRhondaRobinsonBeale,M.D.(19)SeniorVicePresidentandChiefMedicalOfficerBlueCrossofIdahoMeridian,IDMaryJaneRotheram,Ph.D.(16)Bat-YaacovProfessorofChildPsychiatryAndBehavioralSciencesDirector,GlobalCenterforChildrenandFamiliesDirector,CenterforHIVIdentificationPreventionAndTreatmentServices(CHIPTS)SemelInstituteandtheDepartmentofPsychiatry,UniversityofCalifornia,LosAngelesLosAngeles,CA

J.DavidSweatt,Ph.D.(16)ProfessorandChairmanDepartmentofPharmacologyVanderbiltUniversityNashville,TNHyongUn,M.D.(17)HeadofEAP&ChiefPsychiatricOfficerAETNABlueBell,PAChristopherA.Walsh,M.D.(19)Chief,DivisionofGeneticsandGenomicsBostonChildren’sHospitalBullardProfessorofPediatricsandNeurologyHarvardMedicalSchoolBoston,MA

EXOFFICIOMEMBERSOfficeoftheSecretary,DHHSSylviaM.BurwellSecretaryDepartmentofHealthandHumanServicesWashington,DCNationalInstitutesofHealthFrancisCollins,M.D.,Ph.D.DirectorNationalInstitutesofHealthBethesda,MD

DepartmentofVeteransAffairsTheresaGleason,Ph.D.Deputy,ChiefResearch&DevelopmentOfficerOfficeofResearch&DevelopmentDepartmentofVeteransAffairsWashingtonDCDepartmentofDefenseJohnW.Davison,M.B.A.,Ph.D.Chief,Conditioned-BasedSpecialtyCareSectionClinicalSupportDivisionDefenseHealthAgencyDepartmentofDefenseOfficeoftheChiefMedicalOfficer(OCMO)TRICAREManagementActivity,OASD(HA)FallsChurch,VALiaisonRepresentativePaolodelVecchio,M.S.W.DirectorCenterforMentalHealthServicesRockville,MD

BehavioralAssessmentMethodsforRDoCConstructs

161

APPENDIXC:WORKGROUPROSTER

WorkgroupCo-ChairsDeannaM.Barch,Ph.D.,Co-Chair,WashingtonUniversityMariaOquendo,M.D.,Co-Chair,ColumbiaUniversityNAMCHMembersPatriciaAreán,Ph.D.,UniversityofWashingtonDavidBrent,M.D.,UniversityofPittsburghSchoolofMedicineWorkgroupMembersArousalandRegulatorySystemsDaraManoach,Ph.D.,Chair,HarvardMedicalSchool,MassachusettsGeneralHospitalTheodoreBeauchaine,Ph.D.,OhioStateUniversityRuthBenca,M.D.,Ph.D.,UniversityofWisconsin-MadisonAndrewKrystal,M.D.,DukeUniversityCognitiveSystemsCameronCarter,M.D.,Chair,UniversityofCalifornia,DavisNealCohen,Ph.D.,UniversityofIllinoisatUrbana-ChampaignJordanDeVylder,Ph.D.,UniversityofMarylandDwightDickinson,Ph.D.,J.D.,NationalInstituteofMentalHealthDamienFair,Ph.D.,PA-C,OregonHealthSciencesUniversityMartaKutas,Ph.D.,UniversityofCalifornia,SanDiegoSoheePark,Ph.D.,VanderbiltUniversityLucinaUddin,Ph.D.,UniversityofMiamiNegativeValenceSystemsStewartShankman,Ph.D.,Chair,UniversityofIllinoisatChicagoMariadelasMercedesPerez-Rodriguez,M.D.,Ph.D.,MountSinaiSchoolofMedicineEmilyDurbin,Ph.D.,MichiganStateUniversityIanGotlib,Ph.D.,StanfordUniversitySheriJohnson,Ph.D.,UniversityofCalifornia,BerkeleyPositiveValenceSystemsDiegoPizzagalli,Ph.D.,Chair,McLeanHospital/HarvardMedicalSchoolMauricioDelgado,Ph.D.,RutgersUniversityPaulGlimcher,Ph.D.,NewYorkUniversityGregHajcak,Ph.D.,StonyBrookUniversityMichaelTreadway,Ph.D.,EmoryUniversityBenYerys,Ph.D.,Children’sHospitalofPhiladelphia

BehavioralAssessmentMethodsforRDoCConstructs

162

SystemsforSocialProcessesKevinPelphrey,Ph.D.,Chair,GeorgeWashingtonUniversityJedElison,Ph.D.,UniversityofMinnesotaWilliamP.Horan,Ph.D.,UniversityofCalifornia,LosAngelesJamesMorris,Ph.D.,UniversityofVirginiaLynnPaul,Ph.D.,CaliforniaInstituteofTechnologyNIMHRDoCUnitBruceCuthbert,PhD.,ActingDirectoroftheInstituteSarahMorris,Ph.D.,ActingDirectoroftheRDoCUnitDedeGreenstein,Ph.D.,NIMHRDocUnitArinaKadam,MPH.,NIMHRDoCUnitJenniPacheco,Ph.D.,NIMHRDoCUnitUmaVaidyanathan,Ph.D.,NIMHRDoCUnit

BehavioralAssessmentMethodsforRDoCConstructs

163

APPENDIXD:WORKGROUPAGENDA

BehavioralAssessmentMethodsforRDoCConstructs

164

BehavioralAssessmentMethodsforRDoCConstructs

165

BehavioralAssessmentMethodsforRDoCConstructs

166

BehavioralAssessmentMethodsforRDoCConstructs

167

top related