a systematic review of emergency department technology-based behavioral health interventions
TRANSCRIPT
CONSENSUS CONFERENCE FOLLOW-UP
A Systematic Review of EmergencyDepartment Technology-based BehavioralHealth InterventionsEsther K. Choo, MD, MPH, Megan L. Ranney, MD, MPH, Nitin Aggarwal, MD,and Edwin D. Boudreaux, PhD
AbstractObjectives: This systematic review evaluated the evidence for use of computer technologies to assessand reduce high-risk health behaviors in emergency department (ED) patients.
Methods: A systematic search was conducted of electronic databases, references, key journals, andconference proceedings. Studies were included if they evaluated the use of computer-based technologiesfor ED-based screening, interventions, or referrals for high-risk health behaviors (e.g., unsafe sex, part-ner violence, substance abuse, depression); were published since 1990; and were in English, French, orSpanish. Study selection and assessment of methodologic quality were performed by two independentreviewers. Data extraction was performed by one reviewer and then independently checked forcompleteness and accuracy by a second reviewer.
Results: Of 17,744 unique articles identified by database search, 66 underwent full-text review, and 20met inclusion criteria. The greatest number of studies targeted alcohol ⁄ substance use (n = 8, 40%), fol-lowed by intentional or unintentional injury (n = 7, 35%) and then mental health (n = 4, 20%). Ten of thestudies (50%) were randomized controlled trials; the remainder were observational or feasibility studies.Overall, studies showed high acceptability and feasibility of individual computer innovations, althoughstudy quality varied greatly. Evidence for clinical efficacy across health behaviors was modest, with fewstudies addressing meaningful clinical outcomes. Future research should aim to establish the efficacy ofcomputer-based technology for meaningful health outcomes and to ensure that effective interventionsare both disseminable and sustainable.
Conclusions: The number of studies identified in this review reflects recent enthusiasm about the poten-tial of computers to overcome barriers to behavioral health screening, interventions, and referrals totreatment in the ED. The available literature suggests that these types of tools will be feasible andacceptable to patients and staff.
ACADEMIC EMERGENCY MEDICINE 2012; 19:318–328 ª 2012 by the Society for Academic EmergencyMedicine
T he emergency department (ED) is well situated toplay a central role in identifying and addressingcritical high-risk health behaviors. ED patients
are more likely than the general U.S. population to reportrisky health behaviors, such as use of alcohol, drugs, andtobacco; involvement in violence; and unsafe sexual
ISSN 1069-6563 ª 2012 by the Society for Academic Emergency Medicine318 PII ISSN 1069-6563583 doi: 10.1111/j.1553-2712.2012.01299.x
From the Injury Prevention Center, Department of Emergency Medicine, Rhode Island Hospital, Warren Alpert Medical Schoolof Brown University (EKC, MLR), Providence, RI; the Department of Emergency Medicine, Vanderbilt University Medical Center(NA), Nashville, TN; and the Departments of Emergency Medicine, Psychiatry and Quantitative Health Science, University ofMassachusetts Medical School (EDB), Worcester, MA.Received September 6, 2011; revision received September 28, 2011; accepted September 28, 2011.The authors have no relevant financial information or potential conflicts of interest to disclose.Supervising Editor: Shariar Zehtabchi, MD.Address for correspondence and reprints: Esther K. Choo, MD, MPH; e-mail: [email protected]’s note: Academic Emergency Medicine (AEM) highlights articles that follow up on the research agendas created at the Jour-nal’s annual consensus conferences. This article relates to the 2009 AEM consensus conference, ‘‘Public Health in the EmergencyDepartment: Surveillance, Screening, and Intervention.’’ All prior consensus conference proceedings issues are available open-access at http://www.aemj.org, and authors interested in submitting a consensus conference follow-up paper should consult theauthor guidelines.
behavior.1–3 Many ED patients endorse more than one ofthese risky behaviors, placing them at even higher risk ofsubsequent illness and injury.4
The Society for Academic Emergency Medicine(SAEM) has recognized that emergency care ‘‘includespreventive and educational, as well as curative, medicalservice.’’5 However, there are attitudinal, cultural,administrative, educational, technological, and systemsbarriers to integrating behavioral health measures sothat they become a routine part of emergency care.6
Emergency physicians receive little training in theassessment of patients’ psychosocial or behavioralhealth risks or in the skills needed to address theseproblems.7 Many EDs struggle with long wait times,high acuity, limited budgets, and insufficient staff andare challenged to add preventive programs to theirscope of practice.8
One proposed solution to these relatively fixed barri-ers to ED behavioral health interventions is the use ofcomputer technology. Computers offer the potential ofdelivering cost-effective, individually tailored, evidence-based interventions for an array of health behaviors;reducing the time and resources needed for implemen-tation of behavioral health measures; and allowing theED to provide such measures consistently and with uni-form quality. Importantly, computer-based screeningand interventions are likely to be highly acceptable topatients. In national samples, over three-fourths ofAmerican Internet users report using the Internet toaccess health information.9 A recent study showed thatmany ED patients show interest in and even preferencefor technology-based interventions for a wide variety ofbehavioral health topics.10 A meta-analysis evaluatingthe efficacy of computer-delivered interventions to pro-mote healthy behaviors in outpatient (non-ED) settingsconcluded that participants who received these inter-ventions improved their knowledge, attitudes, andintentions toward changing their high-risk healthbehavior.11
A growing number of studies are examining the use ofcomputers for behavioral health screening or interven-tions in the ED setting. However, this emerging litera-ture has not been synthesized to allow recommendationsfor use of technology for targeted health issues or to for-mulate recommendations for future directions inresearch. The objectives of this systematic review wereto evaluate the existing evidence for use of computertechnologies in addressing health behaviors in EDs, toassess the quality of the existing literature, and to iden-tify notable gaps in research on computer technologyfor behavioral health efforts in the ED.
METHODS
Search StrategyFor this systematic review, the research team workedin conjunction with a medical research librarian todevelop and implement a systematic search strategy.The search was conducted in 14 databases: AcademicSearch Premier, CINAHL, Cochrane Central Register ofControlled Trials, Cochrane Reviews, Cochrane, Data-base of Abstracts of Reviews of Effects, EMBASE, GreyLiterature Report, Health Technology Assessments
Database, Nursing at OVID, ProQuest Theses and Dis-sertations, PsychInfo, PubMed, and SocIndex. We alsosearched ClinicalTrials.gov for ongoing studies andcontacted investigators of pertinent studies to deter-mine if there were studies pending publication. Last,we hand-searched the reference sections of all includedarticles and related review articles to identify otherpotentially relevant studies. An initial search was per-formed in December 2010. A final search was per-formed in February 2011 to capture any newlypublished articles. Data extraction and synthesis wereconducted from March to June 2011.
Search terms included emergencies, emergency ser-vice, emergency medicine, accident and emergency,casualty, electronic mail, Internet, computers, software,technology, wireless, mobile, laptop, and social net-work. The full list of search terms and a detailed searchstrategy can be found in Data Supplement S1 (availableas supporting information in the online version of thispaper). Articles selected were limited to those publishedin English, Spanish, or French language and thosepublished in or after 1990.
Study SelectionStudies were included if they employed computer tech-nology for behavioral screening, interventions, and ⁄ orreferrals for patients presenting to the ED and if theyused computers to address risky behaviors (e.g., unsafesex, partner violence, substance abuse, depression). Wedid not use standard or uniform definitions of the indi-vidual high-risk behaviors, but accepted the authors’definition of these behaviors. Studies were excluded ifthey used computers solely to improve documentation,for follow-up after general ED care, or for detection orcare of chronic medical illnesses. Studies were alsoexcluded if they used research assistants, social work-ers, or nurses to improve ED-based behavioral screen-ing, interventions, or referrals, unless the keycomponent of the intervention involved computers.Both observational and experimental studies wereincluded. If multiple articles were published analyzingthe results of a single study (e.g., a preliminary analysisfollowed by a final analysis), the most comprehensiveor final article was retained.
One study investigator (NA) performed an initialscreen of all titles to identify potentially eligible articlesand to eliminate duplicates across databases. Two studyinvestigators (EKC and MLR) repeated the screen witha sample (200 articles) from the full list of titles to verifythe quality of the initial screen. EKC and MLR thenindependently reviewed the abstracts of each retainedarticle. If at least one investigator felt a study waspotentially eligible based on abstract review, the fullmanuscript was obtained. The same two study investi-gators (EKC and MLR) then independently performed areview of the full manuscripts to determine if the studymet all of the inclusion criteria. Any discrepancies inopinion were resolved by discussion with a fourthstudy investigator (EDB).
Data Abstraction and AnalysisInformation on each eligible study was collected usinga standardized data abstraction form that captured
ACADEMIC EMERGENCY MEDICINE • March 2012, Vol. 19, No. 3 • www.aemj.org 319
study design, study characteristics, patient population,target behavior, description of the innovation or inter-vention, outcomes, and results. One reviewer (EKCor MLR) extracted data for each study, with accuracy ofinformation confirmed by a second reviewer (EKCor MLR). Given the broad range of topics included inour search, meta-analysis of the data was not possible;studies were analyzed descriptively only.
Quality AssessmentEligible studies were assessed for methodologic qualityand risk of bias using a modification of the criteriadeveloped by Downs and Black.12 The Downs and Blackinstrument uses 27 criteria assessing the quality ofreporting, power, and internal and external validity of aresearch study. To optimize the uniformity of scoring,we simplified the two subscales with multicategoricalanswer options to dichotomous answer options, makingthe maximum score possible 27. We divided the totalscore into tertiles and considered scores of 19 to 27‘‘high quality,’’ scores of 10–18 ‘‘moderate quality,’’ andscores 9 or below ‘‘low quality.’’13,14 Two investigators(EKC and MLR) independently completed quality scor-ing of each study; in case of discrepancy, a third inves-tigator (EB) was involved and disagreements wereresolved through consensus. Inter-rater reliability wasdetermined by calculating a r statistic.
RESULTS
The study selection process is outlined in Figure 1. Of685 studies retained after review of titles, 66 full-textarticles were evaluated, and 20 met inclusion criteriafor the review. Although the search included studiespublished from 1990 to the present, the eligible studieswere all published since 2001. Eight (40%) of the eligi-ble studies were federally funded; the remaining 12studies were supported by state or provincial govern-ments or by private corporations or foundations. Thegreatest number of ED-based computer studies tar-geted alcohol ⁄ substance use (n = 8, 40%), followed byinjury (intentional or unintentional; n = 7, 35%) and
then mental health (n = 4, 20%). One study15 addressedboth alcohol use and violence and was counted in bothcategories. Most (n = 19, 95%) were conducted at a sin-gle center. Two studies (10%) included non–English-speaking populations. Table 1 summarizes the reviewedstudies’ characteristics, including the behavioral targetand the function or functions of the computer innova-tion tested.16–34
Tables 2 through 5 provide further details of individ-ual studies by topic, including data on key variables andquality assessment scores. The single paper addressingboth violence and alcohol use15 is listed in Table 2.Inter-rater reliability for the quality scores was high,with 24 discrepancies out of 540 data points (96% con-currence, j = 0.67).
Computer-based ED Alcohol and Substance UseInnovationsAmong the eight studies addressing alcohol and sub-stance use (Table 2),15–22 four (50%) were randomizedcontrolled trials (RCTs) that employed computer tech-nology to deliver interventions aimed at reducing riskydrinking,15,19–21 with measured outcomes of alcoholconsumption. The remaining studies’ outcomes mea-sured intervention feasibility and acceptability forpatients and ⁄ or providers. Many of these studies usedthe standard ED care as a control group (30%) or hadno comparison condition (25%). Clinical outcomes forthe four RCTs included alcohol use; one study15 addi-tionally measured negative social consequences of alco-hol use (e.g., missed school, trouble getting along withfriends). Overall, the studies showed acceptability andfeasibility and some evidence of efficacy in reducinghigh-risk alcohol use.
Computer-based ED Violence and UnintentionalInjury InterventionsOf the seven studies that addressed violence or unin-tentional injury in the ED23–28 (Table 3 and Waltonet al.15), five23–27 targeted intimate partner violence(IPV). The IPV studies largely focused on screening,with limited interventions. Most of the outcomesmeasured were proximal, occurring within the initialED visit, such as detected prevalence of IPV, physiciandocumentation, and provision of referrals to services.Only Houry et al.23 measured occurrence of IPV afterthe ED visit. The study by MacMillan et al.24 was theonly one to provide a comparison with an alternative,nontechnological means of identifying IPV. Overall,these studies showed high feasibility and accept-ability of computerized screening and few negativeconsequences.
Computer-based ED Mental Health InterventionsAs with the injury studies, the mental health studies(Table 4) focused primarily on patient screening.29–32
Two studies (50%) were RCTs31,32 of a computer-basedscreening program that included physician notificationof the results of the mental health screen. Outcomesincluded rate of detection of occult psychiatric prob-lems, referrals, and receipt of services; none of thestudies measured clinical outcomes related to the psy-chiatric conditions. None of the studies compared the
Records iden�fied throughdatabase searching
(n = 20,950)
Records a�er duplicates removed(n = 17,744)
Records excluded on:Language – 46Title – 16,980Abstract – 652Total – 17,678Full-text ar�cles assessed
for eligibility(n = 66)
Studies included inqualita�ve synthesis
(n = 20)
Figure 1. Study selection.
320 Choo et al. • SYSTEMATIC REVIEW OF ED TECHNOLOGY STUDIES FOR PUBLIC HEALTH
technological innovation with a non–technology-basedprocess. Overall, these studies showed high acceptabil-ity and feasibility of screening, but limited clinicaloutcomes.
Other Computer-based ED InterventionsOf the remaining two studies (Table 5), one34 used acomputerized survey to screen for a variety of healthbehaviors, including drug and alcohol use, cardiovascu-lar health risk behaviors, high-risk sexual behaviors,depression, and other ‘‘injury-prone behaviors.’’ Thisstudy measured acceptability, feasibility, and knowledgeretention, but not actual behavior change. Merchantet al.33 used audio computer-assisted self-interviewtechnology to increase ED patient attitudes to theirown HIV risk; however, actual risk behaviors were notmeasured.
DISCUSSION
There are many barriers to implementing interventionsfor behavioral health issues in the ED setting. ED clini-cians work in a high-volume, high-acuity setting withsignificant time constraints and receive little training inproviding assessments or interventions for commonproblems such as substance abuse, smoking cessation,involvement in violence, or HIV risk. The institutionalresources available for management of these issues arehighly variable but generally insufficient for the largenumber of patients who might benefit from them.35,36
Studied behavioral interventions in the ED setting areoften performed by social workers or case managers,yet the lack of availability of these resources, especiallyin remote or small EDs,37 limits the dissemination oftreatments designed to be performed by these individu-als. At the same time, many ED patients lack a consis-
tent source of follow-up care, so failing to addressthese health issues during the visit may mean failing totake advantage of individuals’ sole point of contact withhealth care.
Computer technology-based screening, interventions,and referrals have several clinical advantages that makethem potentially advantageous for use in the ED set-ting.38 They provide a sense of anonymity and privacyand may increase reporting of unhealthy behaviors.26,39
They require little direct clinician involvement. They canbe adapted to be culturally and linguistically specific, andaudio capabilities allow them to be used among low-lit-eracy individuals. They can provide individualized healthinformation to participants immediately and in an engag-ing manner. They are able to store information so thatprogress over time can be accurately monitored andreviewed with the participant during follow-up after theED visit. They minimize the bias that can arise in clinicalrelationships. An intervention, if proven effective, maybe able to be disseminated while maintaining treatmentfidelity among clinical sites.
This review supports the promise of computer-basedtechnology as a means to filling a recognized healthcare gap in the ED. All the studies we identified werepublished within the past 10 years, reflecting the surgeof interest and investment in applying emerging tech-nologies to behavioral health problems. The broadrange of health issues studied within a relatively shorttime period speaks to the many areas ED clinicians areeager to address—and likely feel constrained fromaddressing—in their current practice. While screeningis arguably the simplest, and perhaps the most obvious,use of technology in the ED, a number of studies usedcomputers in more core patient care functions, such ascreating personalized referrals to treatment services orproviding interactive interventions.
Table 1Study Characteristics
Behavioral Target First Author (Year) Country
Project Purpose
Screening Interventions Referral
Alcohol ⁄ substance use Bendtsen (2007)16 Sweden XBoudreaux (2009)17 United States X XKarlsson (2005)18 Sweden X XMaio (2005)19 United States XNeumann (2006)20 Germany X XTrinks (2010)21 Sweden X XVaca (2010)22 United States X X X
Alcohol and youth violenceIPV
Walton (2010)15 United States XHoury (2008)23 United States X XMacMillan (2006)24 Canada XRhodes (2002)25 United States XRhodes (2006)26 United States XTrautman (2007)27 United States X X
Unintentional injuryMental health
Gielen (2007)28 United States X XClaassen (2005)29 United States XFein (2010)30 United States XSchriger (2001)31 United States XSchriger (2005)32 United States X
HIV risk behaviorsMultiple health behaviors
Merchant (2009)33 United States X XRhodes (2001)34 United States X X
IPV = intimate partner violence.
ACADEMIC EMERGENCY MEDICINE • March 2012, Vol. 19, No. 3 • www.aemj.org 321
Tab
le2
Alc
oh
olan
dS
ub
stan
ceU
seS
tud
ies
Stu
dy
Desi
gn
Fir
stA
uth
or
(Year)
Targ
et
Po
pu
lati
on
Exp
eri
men
tal
Co
nd
itio
n(L
en
gth
of
Part
icip
ati
on
)*C
om
pari
son
Co
nd
itio
n(s
)P
rim
ary
Ou
tco
me(s
)S
am
ple
Siz
e�
Main
Resu
lts
QA
S
Cro
ss-s
ect
ion
al
Karl
sso
n(2
005)1
8A
du
lt(1
8–7
0)
pati
en
tsC
om
pu
ter
scre
en
ing
an
dta
ilo
red
pri
nto
ut
of
ad
vic
e(o
ne
tim
e,
2m
inu
tes)
No
ne
Acc
ep
tab
ilit
y44
Acc
ep
tab
le:
mo
stp
ati
en
tsfe
ltp
osi
tive
ab
ou
tE
Dalc
oh
ol
scre
en
ing
an
dco
mp
ute
rize
dsc
reen
ing
an
dta
ilo
red
pri
nto
uts
.
11
Vaca
(2010)2
2A
du
lt(‡
18)
pati
en
tsB
ilin
gu
al
com
pu
teri
zed
alc
oh
ol
SB
IRT
kio
sk(o
ne
tim
e,
1–8
min
)
No
ne
Feasi
bil
ity�
an
dacc
ep
tab
ilit
y5,1
03
Feasi
ble
an
dacc
ep
tab
le.
Mo
stp
ati
en
tsre
po
rted
ease
of
use
an
dco
mfo
rtw
ith
com
pu
ters
.
15
Pro
spect
ive
coh
ort
Bo
ud
reau
x(2
009)1
7A
du
lt(‡
18)
pati
en
tsin
the
ED
an
dch
est
pain
ob
serv
ati
on
un
it
Co
mp
ute
rize
dsc
reen
an
dta
ilo
red
refe
rrals
reg
ard
ing
dru
gs,
alc
oh
ol,
tob
acc
o(o
ne
tim
e,
med
ian
13
min
ute
s)
No
ne
Feasi
bil
ity
an
dacc
ep
tab
ilit
y85
pati
en
ts,
51
pro
vid
ers
Feasi
ble
an
dacc
ep
tab
le:
hig
hm
ean
pati
en
tan
dE
Dan
dsu
bst
an
ceu
sep
rovid
er
sati
sfact
ion
sco
res.
Lo
wu
seo
ftr
eatm
en
tre
ferr
als
.
19
Qu
asi
-exp
eri
men
tal
Ben
dts
en
(2006)1
6E
Dn
urs
es
Co
mp
ute
rize
dsc
reen
ing
an
db
rief
inte
rven
tio
no
fp
ati
en
ts(e
SB
I)(o
ne
tim
e)
Usu
al
care
,in
peri
od
befo
reim
ple
men
tati
on
of
eS
BI
Feasi
bil
ity
an
dacc
ep
tab
ilit
yto
nu
rses
48
nu
rses
Mo
dest
acc
ep
tab
ilit
yto
nu
rses;
low
uti
liza
tio
n.
10
RC
TM
aio
(2005)1
9A
do
lesc
en
t(1
4–1
8)
pati
en
tsw
ith
min
or
inju
ry
Inte
ract
ive
com
pu
ter
pro
gra
m(o
ne
tim
e,
mean
25
min
ute
s)
Usu
al
care
Alc
oh
ol
mis
use
580
(at
12
mo
nth
s)N
oeff
ect
for
gen
era
lst
ud
yp
op
ula
tio
n;
decr
ease
dalc
oh
ol
use
am
on
gsu
bg
rou
po
fri
sky
dri
nke
rs.
24
Neu
man
n(2
006)2
0A
du
lt(‡
18)
at-
risk
dri
nke
rsp
rese
nti
ng
du
eto
inju
ry
Co
mp
ute
rize
dsc
reen
ing
an
dta
ilo
red
feed
back
an
dad
vic
eo
nalc
oh
ol
use
(on
eti
me)
No
inte
rven
tio
nA
t-ri
skd
rin
kin
g660
(at
12
mo
nth
s)D
ecr
ease
dalc
oh
ol
use
at
12
mo
nth
sb
ut
pro
po
rtio
no
fat-
risk
dri
nke
rsd
idn
ot
chan
ge.
19
Tri
nks
(2010)2
1A
du
lt(1
8–6
9)
pati
en
tsC
om
pu
teri
zed
scre
en
ing
an
dta
ilo
red
,p
rin
ted
feed
back
an
dad
vic
eo
nalc
oh
ol
use
(on
eti
me)
Sh
ort
feed
back
wit
hin
form
ati
on
on
risk
level
of
dri
nki
ng
Pati
en
tp
art
icip
ati
on
an
deff
ect
iven
ess
for
red
uci
ng
alc
oh
ol
use
at
6m
on
ths
93
(at
6m
on
ths)
On
ly41%
com
ple
ted
the
inte
rven
tio
nan
do
nly
17%
follo
w-u
p;
no
dif
fere
nce
in6-m
on
thalc
oh
ol
use
.
15
Walt
on
(2010)1
5A
do
lesc
en
t(1
4–1
8)
pati
en
ts
Co
mp
ute
rize
db
rief
inte
rven
tio
nfo
rvio
len
cean
dalc
oh
ol
(on
eti
me,
mean
35
min
ute
s)
Co
ntr
ol
(bro
chu
rew
ith
com
mu
nit
yre
sou
rces)
or
thera
pis
tb
rief
inte
rven
tio
n
Self
-rep
ort
ed
peer
vio
len
cean
dalc
oh
ol
use
an
dre
late
dco
nse
qu
en
ces
726
Decr
ease
dalc
oh
ol
con
seq
uen
ces
at
6m
on
ths.
No
decr
ease
inse
lf-
rep
ort
ed
alc
oh
ol
use
an
din
vo
lvem
en
tin
vio
len
ce.
22
QA
S=
qu
ality
ass
ess
men
tsc
ore
;S
BIR
T=
Scr
een
ing
,B
rief
Inte
rven
tio
nan
dR
efe
rral
toT
reatm
en
t.*If
du
rati
on
of
inte
rven
tio
nis
no
tp
rovid
ed
,it
was
no
tm
en
tio
ned
inth
eart
icle
.�S
am
ple
size
rep
ort
ed
was
that
use
din
the
main
an
aly
sis.
Ing
en
era
l,sa
mp
leat
fin
al
foll
ow
-up
was
use
d,
un
less
au
tho
rsre
po
rted
inte
nti
on
-to
-tre
at
an
aly
sis,
inw
hic
hca
seth
en
um
ber
of
all
part
icip
an
tsra
nd
om
ized
totr
eatm
en
tw
as
use
d.
�Th
ed
efi
nit
ion
of
feasi
bil
ity,
an
dm
easu
res
use
dto
ass
ess
it,
vari
ed
fro
mst
ud
yto
stu
dy.
322 Choo et al. • SYSTEMATIC REVIEW OF ED TECHNOLOGY STUDIES FOR PUBLIC HEALTH
Tab
le3
Inju
ryS
tud
ies
Stu
dy
Desi
gn
Fir
stA
uth
or
(Year)
Targ
et
Po
pu
lati
on
Exp
eri
men
tal
Co
nd
itio
n(L
en
gth
of
Part
icip
ati
on
)*C
om
pari
son
Co
nd
itio
n(s
)P
rim
ary
Ou
tco
me(s
)S
am
ple
Siz
e�
Main
Resu
lts
QA
S
IPV C
ross
-se
ctio
nal
Rh
od
es
(2002)2
5A
du
lt(1
8–6
5)
pati
en
tsC
om
pu
teri
zed
scre
en
ing
an
dta
ilo
red
pri
nte
dre
com
men
dati
on
s(o
ne
tim
e,
mean
17
min
ute
s)
Usu
al
care
Feasi
bil
ity,�
acc
ep
tab
ilit
y,
IPV
dete
ctio
nra
tes
470
Hig
her
ph
ysi
cian
do
cum
en
tati
on
of
IPV
inco
mp
ute
r-sc
reen
ed
gro
up
.
16
Pro
spect
ive
coh
ort
Ho
ury
(2008)2
3A
du
lt(1
8–5
5)
pati
en
tsC
om
pu
teri
zed
scre
en
ing
an
dre
ferr
als
(on
eti
me)
N⁄A
Safe
tyan
du
seo
fre
ferr
als
3,0
83
(in
ED
);1,0
37
(9-1
-1ca
llfo
llo
w-
up
);131
(at
3m
on
ths)
No
sig
nifi
can
tsa
fety
issu
es;
red
uce
d9-1
-1ca
lls;
rela
tively
hig
hu
seo
fre
sou
rces
at
3-m
on
thfo
llo
w-u
p.
17
Qu
asi
-exp
eri
men
tal
Tra
utm
an
(2007)2
7Fem
ale
ad
ult
(‡18)
pati
en
tsC
om
pu
teri
zed
scre
en
ing
(on
eti
me,
mean
6m
inu
tes)
Co
mp
ute
rize
dh
ealt
hsu
rvey
wit
ho
ut
IPV
qu
est
ion
s
Scr
een
ing
,d
ete
ctio
n,
refe
rral,
an
dse
rvic
es
for
IPV
1,0
05
Hig
her
com
ple
tio
no
fsc
reen
ing
,h
igh
er
dete
ctio
no
fIP
V,
an
dh
igh
er
rece
ipt
of
refe
rrals
an
dse
rvic
es.
18
RC
TM
acM
illa
n(2
006)2
4Fem
ale
ad
ult
(18–6
4)
pati
en
ts
Co
mp
ute
rize
dsc
reen
ing
(on
eti
me)
Face
-to
-face
inte
rvie
wo
rw
ritt
en
self
-co
mp
lete
dq
uest
ion
nair
e
Acc
ep
tab
ilit
yan
dd
ete
ctio
no
fIP
V768§
Acc
ep
tab
leto
pati
en
ts.
Co
mp
ute
rd
idn
ot
dete
cth
igh
er
pre
vale
nce
of
IPV
.
18
Rh
od
es
(2006)2
6Fem
ale
ad
ult
(18–6
5)
pati
en
ts
Co
mp
ute
rize
dsc
reen
ing
(on
eti
me,
mean
18
min
)
Usu
al
care
IPV
dis
clo
sure
toan
dd
iscu
ssio
nw
ith
pro
vid
ers
;re
ceip
to
fse
rvic
es
871
Rate
so
fIP
Vd
iscu
ssio
n,
dis
clo
sure
,an
dre
ferr
al
tose
rvic
es.
23
Ped
iatr
icin
jury
pre
ven
tio
nG
iele
n(2
007)2
8P
are
nts
of
ped
iatr
icE
Dp
ati
en
ts(4
–66
mo
nth
s)
Co
mp
ute
rize
dta
ilo
red
inju
ryp
reven
tio
nin
terv
en
tio
n(o
ne
tim
e)
Rep
ort
on
un
rela
ted
child
healt
hto
pic
s
Safe
tykn
ow
led
ge
an
db
eh
avio
rsre
gard
ing
car
seat,
smo
keala
rm,
po
iso
nst
ora
ge
safe
ty
901
Hig
her
safe
tykn
ow
led
ge,
hig
her
use
of
chil
dsa
fety
seats
.
23
IPV
=in
tim
ate
part
ner
vio
len
ce;
QA
S=
qu
ality
ass
ess
men
tsc
ore
.*S
am
ple
size
rep
ort
ed
was
that
use
din
the
main
an
aly
sis.
Ing
en
era
l,sa
mp
leat
fin
al
foll
ow
-up
was
use
d,
un
less
au
tho
rsre
po
rted
inte
nti
on
-to
-tre
at
an
aly
sis,
inw
hic
hca
seth
en
um
ber
of
all
part
icip
an
tsra
nd
om
ized
totr
eatm
en
tw
as
use
d.
�If
du
rati
on
of
inte
rven
tio
nis
no
tp
rovid
ed
,it
was
no
tm
en
tio
ned
inth
eart
icle
.�T
he
defi
nit
ion
of
feasi
bil
ity,
an
dm
easu
res
use
dto
ass
ess
it,
vari
ed
fro
mst
ud
yto
stu
dy.
§S
tud
yw
as
con
du
cted
inm
ult
iple
site
s;n
um
ber
list
ed
rep
rese
nts
size
of
sub
sam
ple
recr
uit
ed
fro
mth
eE
D.
ACADEMIC EMERGENCY MEDICINE • March 2012, Vol. 19, No. 3 • www.aemj.org 323
Tab
le4
Men
talH
ealt
hS
tud
ies
Stu
dy
Desi
gn
Fir
stA
uth
or
(Year)
Targ
et
Po
pu
lati
on
Exp
eri
men
tal
Co
nd
itio
n(L
en
gth
of
Part
icip
ati
on
)*C
om
pari
son
Co
nd
itio
n(s
)P
rim
ary
Ou
tco
me(s
)S
am
ple
Siz
e�
Main
Resu
lts
QA
S
Cro
ss-s
ect
ion
al
Cla
ass
en
(2005)2
9A
du
lt(‡
18)
pati
en
tsw
ith
no
np
sych
iatr
icch
ief
com
pla
ints
Co
mp
ute
rize
db
ilin
gu
al
men
tal
healt
hsc
reen
ing
(on
eti
me,
6m
inu
tes)
N⁄A
Feasi
bil
ity�
an
dd
ete
ctio
n1,5
90
Feasi
ble
toad
min
iste
r;h
igh
levels
of
occ
ult
suic
idali
tyco
mp
are
dw
ith
exis
tin
gli
tera
ture
.
9
Fein (2010)3
0A
do
lesc
en
ts(1
4–1
8)
pre
sen
tin
gto
the
ED
wit
hn
on
psy
chia
tric
com
pla
ints
Bri
ef
com
pu
teri
zed
men
tal
healt
hsc
reen
(on
eti
me,
10
min
ute
s)
Usu
al
care
,in
the
19
mo
nth
sp
rio
rto
imp
lem
en
tati
on
Feasi
bil
ity,
dete
ctio
n,
an
dso
cial
wo
rker
or
psy
chia
tris
tass
ess
men
t
11,2
01
Feasi
ble
;sm
all
bu
tsi
gn
ifica
ntl
yin
crease
did
en
tifi
cati
on
an
dass
ess
men
to
fp
ati
en
tsw
ith
psy
chia
tric
pro
ble
ms.
17
RC
TS
chri
ger
(2001)3
1A
du
lt(‡
18)
pati
en
tsw
ith
dif
fuse
or
un
usu
al
com
pla
ints
⁄b
eh
avio
r
Co
mp
ute
rize
dp
sych
iatr
icsc
reen
ing
inte
rvie
w(o
ne
tim
e,
5–1
0m
inu
tes)
wit
hp
hysi
cian
no
tifi
cati
on
Ph
ysi
cian
no
tn
oti
fied
of
scre
en
ing
resu
lts
Dete
ctio
n,
con
sult
ati
on
or
refe
rral
190
No
dif
fere
nce
betw
een
gro
up
sin
psy
chia
tric
dia
gn
osi
s,co
nsu
ltati
on
or
refe
rral.
20
Sch
rig
er
(2005)3
2A
du
lt(‡
18)
ED
pati
en
tsw
ith
‘‘n
on
speci
fic
som
ati
cco
mp
lain
ts’’
Co
mp
ute
rize
dp
sych
iatr
icsc
reen
(on
eti
me,
2–3
5m
inu
tes)
wit
hp
ati
en
tan
dp
hysi
cian
no
tifi
cati
on
Scr
een
ing
on
ly,
or
scre
en
ing
plu
sn
oti
fica
tio
no
fp
ati
en
tso
nly
Acc
ep
tab
ilit
y,
dete
ctio
nan
du
seo
fre
ferr
als
95
Hig
hacc
ep
tab
ilit
y;
hig
hra
tes
of
occ
ult
men
tal
illn
ess
;tr
en
dto
ward
incr
ease
dre
ferr
al
wit
hp
ati
en
tan
dp
hysi
cian
no
tifi
cati
on
.
14
QA
S=
qu
ali
tyass
ess
men
tsc
ore
.*If
du
rati
on
of
inte
rven
tio
nis
no
tp
rovid
ed
,it
was
no
tm
en
tio
ned
inth
eart
icle
.�S
am
ple
size
rep
ort
ed
was
that
use
din
the
main
an
aly
sis.
Ing
en
era
l,sa
mp
leat
fin
al
foll
ow
-up
was
use
d,
un
less
au
tho
rsre
po
rted
inte
nti
on
-to
-tre
at
an
aly
sis,
inw
hic
hca
seth
en
um
ber
of
all
part
icip
an
tsra
nd
om
ized
totr
eatm
en
tw
as
use
d.
�Th
ed
efi
nit
ion
of
feasi
bil
ity,
an
dm
easu
res
use
dto
ass
ess
it,
vari
ed
fro
mst
ud
yto
stu
dy.
324 Choo et al. • SYSTEMATIC REVIEW OF ED TECHNOLOGY STUDIES FOR PUBLIC HEALTH
However, this literature review also identifies manyareas for growth in the research on technology use forbehavioral change in the ED. First, there are notablegaps in the types of risky health behaviors addressedby studied technologies. Most of the existingstudies addressed alcohol or substance abuse; withinthis category, there was only one study examiningdrug use and no studies addressing tobacco use. Mostof the computer-based work on violence examined IPV,with little directed toward youth violence and nothingdirected toward other types of community violence,elder violence, or child abuse. Only one studyaddressed unintentional injuries, and only oneaddressed high-risk sexual behaviors. Walton’s inter-vention for alcohol use and violence among adolescentswas the sole study to acknowledge the importance ofaddressing co-occurring high-risk behaviors together.
Some studies identified clinical or behavioral out-comes: four of the substance use intervention studiesmeasured alcohol use before and after the ED interven-tion, with one measuring negative social consequencesof alcohol use. One violence-related study measuredoccurrence of IPV—not just use of resources—after theED visit. However, the majority of the studies, even theexperimental studies, lacked patient-related outcomes.Many lacked comparison against valid nontechnologicalinterventions and instead used ‘‘usual care’’ as the com-parison group, presuming that the only option to tech-nology-based interventions is no treatment at all. Insome cases, this may be attributable to the lack of cur-rent nontechnological evidence-based practices, suchas in the treatment of IPV or mental health problemsidentified in the ED setting. In other cases, this short-coming reflects the early stage of research on imple-menting computer-based technologies into the EDsetting. Feasibility and acceptability were still the pri-mary questions for many researchers, as demonstratedby the 55% of studies in our review that focused onthese topics.
Additionally, while many of the studies we reviewedreported their technological innovation to be feasibleand acceptable, and a few reported efficacy in reducingharmful behaviors, none as yet have addressed howsustainable these innovations will be. Can these tech-nologies truly be disseminated to resource-poor areas?Can they be implemented in places that do not havesignificant resources of institutional support and infor-mation technology specialization? Technology-basedinterventions may be a solution to resource and timelimitations in the ED, but they have high start-up costsand a commitment to maintenance. ED staff must betrained to use the technological program, device, orsoftware. Hardware and software can break, malfunc-tion, become outdated, or be vandalized or stolen; theymust be replaced or updated on a regular basis. Com-mercial products are rapidly becoming available thatmay allow researchers and hospitals to develop com-puter-based resources with increasing ease and afford-ability; however, few studies in our review comment onthe cost-effectiveness of their innovations or otherpractical potential limitations to long-term and wide-spread use of technologies. Most studies were single-center, making it as yet difficult to imagine how theseT
ab
le5
Oth
er
Stu
die
s
Stu
dy
Desi
gn
Fir
stA
uth
or
(Year)
Targ
et
Po
pu
lati
on
Exp
eri
men
tal
Co
nd
itio
n(L
en
gth
of
Part
icip
ati
on
)*C
om
pari
son
Co
nd
itio
n(s
)P
rim
ary
Ou
tco
me(s
)S
am
ple
Siz
e�
Main
Resu
lts
QA
S
Qu
asi
-exp
eri
men
tal
Rh
od
es
(2001)3
4A
du
lt(1
8–6
5)
pati
en
tsC
om
pu
teri
zed
surv
ey
an
dta
ilo
red
pri
nto
ut
of
reco
mm
en
dati
on
sre
gard
ing
avari
ety
of
beh
avio
ral
risk
fact
ors
(on
eti
me,
mean
18
min
ute
s)
Usu
al
care
Feasi
bil
ity�
an
dacc
ep
tab
ilit
y;
reca
llo
fh
ealt
hin
form
ati
on
454
Feasi
ble
an
dacc
ep
tab
le;
incr
ease
dre
call
of
rece
ivin
gh
ealt
hin
form
ati
on
.
17
RC
TM
erc
han
t(2
009)3
3A
du
lt(1
8–6
4)
pati
en
tsC
om
pu
teri
zed
scre
en
ing
an
dta
ilo
red
feed
back
reg
ard
ing
HIV
risk
beh
avio
rsw
ith
feed
back
(on
eti
me,
10–1
5m
inu
tes)
Scr
een
ing
on
lyS
elf
-perc
eiv
ed
risk
for
curr
en
tH
IVin
fect
ion
566
Scr
een
ing
alo
ne
sig
nifi
can
tly
incr
ease
dse
lf-p
erc
eiv
ed
HIV
risk
;n
osi
gn
ifica
nt
incr
ease
for
scre
en
ing
an
dfe
ed
back
.
21
RC
T=
ran
do
miz
ed
con
tro
lled
tria
l;Q
AS
=q
uality
ass
ess
men
tsc
ore
.*If
du
rati
on
of
inte
rven
tio
nis
no
tp
rovid
ed
,it
was
no
tm
en
tio
ned
inth
eart
icle
.�S
am
ple
size
rep
ort
ed
was
that
use
din
the
main
an
aly
sis.
Ing
en
era
l,sa
mp
leat
fin
al
follo
w-u
pw
as
use
d,
un
less
au
tho
rsre
po
rted
inte
nti
on
-to
-tre
at
an
aly
sis,
inw
hic
hca
seth
en
um
ber
of
all
part
icip
an
tsra
nd
om
ized
totr
eatm
en
tw
as
use
d.
�Th
ed
efi
nit
ion
of
feasi
bilit
y,
an
dm
easu
res
use
dto
ass
ess
it,
vari
ed
fro
mst
ud
yto
stu
dy.
ACADEMIC EMERGENCY MEDICINE • March 2012, Vol. 19, No. 3 • www.aemj.org 325
innovations would function outside of the specific envi-ronment in which they were developed.
These are all challenges that surely accompany anymajor innovation in the systems we use to deliverhealth care. However, they bear recognition, lest ourenthusiasm for incorporating computers to fill the gapsin emergency services prevent us from anticipating andaddressing the challenges and costs specific to technol-ogy-based interventions.
Finally, most of the studies we identified used com-puters in the ED for fairly ‘‘traditional’’ functions, suchas administering patient surveys or providing statichealth information. We anticipate that upcomingresearch will examine newer computer applications,such as social networking or telehealth applications,and employ computer technology for more advancedand complex functions, including delivering interactiveand highly tailored ED-based interventions, performingpatient boosters or follow-ups after the ED visit, andproviding dynamic linkages to needed services.
LIMITATIONS
First, it is possible that we failed to include relevantstudies, whether because we missed them in the initialsearch or erroneously excluded them when reviewingstudies by title or abstract. Any studies published sinceour final review (in February 2011) would also not beincluded in this review. Our determinations of studyquality were also subject to the biases of the studyinvestigators.
We did take a number of steps to ensure that all eligi-ble studies were included and that our assessments ofquality were objective. We made our search as compre-hensive as possible by including multiple, diverse, andredundant databases. We also had two investigatorsindependently review abstracts and articles for inclu-sion and used a standardized process for achievingconsensus to avoid reviewer fatigue and subjectivityand to minimize error. Nevertheless, a systematicreview is ultimately a subjective process, and the possi-bility for error or bias remains.
Well-validated quality assessment instruments forboth randomized and nonrandomized studies are lack-ing. Therefore, the process of quality scoring adds tothe subjective nature of systematic review. AlthoughDowns and Black has come to be accepted as a standardfor assessing quality of studies and is commonly used inthe medical literature, it is an unvalidated measure, andcategorization into ‘‘high,’’ ‘‘moderate,’’ and ‘‘low’’ qual-ity categories remains an imperfect and somewhat arbi-trary process. This is all the more true given thatwe used a modified version of the scale to optimize itsprecision. We included the Downs and Black instrumentto include some objective measure of the likelihoodof bias and to put study findings in context of theirmethodologic rigor; however, judgment of the quality ofindividual studies should be moderated by an acknowl-edgement of the limitations of the scale itself.
While the studies we reviewed supported the feasibil-ity of computer-based interventions, there are twocaveats to this statement. First, there was wide varia-tion in the criteria authors used to define feasibility,
ranging from patient willingness to participate to theability to incorporate the technology into existing EDfunctions; this discrepancy is reflected in the contradic-tion between the number of studies asserting feasibilityand the lack of information provided on the technicaland financial aspects of implementing these interven-tions. Second, it is likely that some researchersattempted technological innovations for health behav-iors, but failed to initiate or completely implement themdue to some of the potential barriers discussed. Suchfailures would not be represented in the published liter-ature. Additionally, computer-based applications forbehavioral modification that are commercially or pri-vately developed are typically not formally tested in aclinical setting, so this study cannot begin to commenton their appropriateness or effectiveness for our popu-lation. While missing unpublished studies or unstudiedtechnologies is not a flaw of our research methods, it isimportant to acknowledge that our review may dispro-portionately represent the successes and thereforepaint a misleadingly rosy picture of these technologies.
CONCLUSIONS
Computerized tools hold great potential for overcomingthe multiple barriers to behavioral health screening,interventions, and referrals to treatment in the ED. Weidentified 20 studies that examined the feasibility,acceptability, or efficacy of using computer technologyin the ED to provide screening or services for awide variety of common high-risk health behaviors.While initial findings suggest that these types of toolswill be feasible and acceptable, further research isneeded to establish their efficacy for meaningful healthoutcomes and to identify approaches to overcomingbarriers to dissemination and sustainability.
References
1. U.S. Preventive Services Task Force, Guide to Clini-cal Preventive Services. 2nd ed. Baltimore, MD:Williams & Wilkins, 1996.
2. Hirshon JM, Morris DM. Emergency medicine andthe health of the public: the critical role of emer-gency departments in US public health. Emerg MedClin North Am. 2006; 24:815–9.
3. Clancy CM, Eisenberg JM. Emergency medicine inpopulation-based systems of care. Ann Emerg Med.1997; 30:800–3.
4. Bernstein SL. The clinical impact of health behav-iors on emergency department visits. Acad EmergMed. 2009; 16:1054–9.
5. Bernstein E, Goldfrank LR, Kellerman AL, et al.A public health approach to emergency medicine:preparing for the twenty-first century. Acad EmergMed. 1994; 1:277–86.
6. McKay MP, Vaca FE, Field C, Rhodes K. Publichealth in the emergency department: overcomingbarriers to implementation and dissemination. AcadEmerg Med. 2009; 16:1132–7.
7. Rhodes KV, Pollock DA. The future of emergencymedicine public health research. Emerg Med ClinNorth Am. 2006; 24:1053–73.
326 Choo et al. • SYSTEMATIC REVIEW OF ED TECHNOLOGY STUDIES FOR PUBLIC HEALTH
8. Rhodes KV, Gordon JA, Lowe RA. Preventive carein the emergency department, Part I: Clinical pre-ventive services–are they relevant to emergencymedicine? Society for Academic Emergency Medi-cine Public Health and Education Task Force Pre-ventive Services Work Group. Acad Emerg Med.2000; 7:1036–41.
9. Fox S. Health Topics. Washington, DC: PewResearch Center, 2011.
10. Ranney M, Choo E, Wang Y, Baum A, Clark M, MelloM. Emergency department patient preferences fortechnology-based behavioral interventions [abstract].Acad Emerg Med. 2011; 18(Suppl 1):10.
11. Portnoy DB, Scott-Sheldon LA, Johnson BT, CareyMP. Computer-delivered interventions for healthpromotion and behavioral risk reduction: a meta-analysis of 75 randomized controlled trials, 1988–2007. Prev Med. 2008; 47:3–16.
12. Downs SH, Black N. The feasibility of creating achecklist for the assessment of the methodologicalquality both of randomised and non-randomisedstudies of health care interventions. J EpidemiolComm Health. 1998; 52:377–84.
13. Newton AS, Hamm MP, Bethell J, et al. Pediatricsuicide-related presentations: a systematic review ofmental health care in the emergency department.Ann Emerg Med. 2010; 56:649–59.
14. Newton AS, Zou B, Hamm MP, et al. Improving childprotection in the emergency department: a system-atic review of professional interventions for healthcare providers. Acad Emerg Med. 2010; 17:117–25.
15. Walton MA, Chermack ST, Shope JT, et al. Effectsof a brief intervention for reducing violence andalcohol misuse among adolescents: a randomizedcontrolled trial. JAMA. 2010; 304:527–35.
16. Bendtsen P, Holmqvist M, Johansson K. Implemen-tation of computerized alcohol screening and advicein an emergency department–a nursing staff per-spective. Accid Emerg Nurs. 2007; 15:3–9.
17. Boudreaux ED, Bedek KL, Gilles D, et al. TheDynamic Assessment and Referral System for Sub-stance Abuse (DARSSA): development, functional-ity, and end-user satisfaction. Drug AlcoholDepend. 2009; 99:37–46.
18. Karlsson A, Bendtsen P. Acceptability of a comput-erized alcohol screening and advice routine in anemergency department setting–a patient perspec-tive. Addict Behav. 2005; 30:767–76.
19. Maio RF, Shope JT, Blow FC, et al. A randomizedcontrolled trial of an emergency department-basedinteractive computer program to prevent alcoholmisuse among injured adolescents. Ann EmergMed. 2005; 45:420–9.
20. Neumann T, Neuner B, Weiss-Gerlach E, et al. Theeffect of computerized tailored brief advice onat-risk drinking in subcritically injured traumapatients. J Trauma. 2006; 61:805–14.
21. Trinks A, Festin K, Bendtsen P, Nilsen P. Reach andeffectiveness of a computer-based alcohol interven-tion in a Swedish emergency room. Int EmergNurs. 2010; 18:138–46.
22. Vaca F, Winn D, Anderson C, Kim D, Arcila M.Feasibility of emergency department bilingual com-
puterized alcohol screening, brief intervention, andreferral to treatment. Subst Abus. 2010; 31:264–9.
23. Houry D, Kaslow NJ, Kemball RS, et al. Doesscreening in the emergency department hurt orhelp victims of intimate partner violence? AnnEmerg Med. 2008; 51:433–42.
24. MacMillan HL, Wathen CN, Jamieson E, et al.Approaches to screening for intimate partner vio-lence in health care settings: a randomized trial.JAMA. 2006; 296:530–6.
25. Rhodes KV, Lauderdale DS, He T, Howes DS, Levin-son W. Between me and the computer: increaseddetection of intimate partner violence using a com-puter questionnaire. Ann Emerg Med. 2002; 40:476–84.
26. Rhodes KV, Drum M, Anliker E, Frankel RM,Howes DS, Levinson W. Lowering the threshold fordiscussions of domestic violence: a randomizedcontrolled trial of computer screening. Arch InternMed. 2006; 166:1107–14.
27. Trautman DE, McCarthy ML, Miller N, CampbellJC, Kelen GD. Intimate partner violence and emer-gency department screening: computerized screen-ing versus usual care. Ann Emerg Med. 2007;49:526–34.
28. Gielen AC, McKenzie LB, McDonald EM, et al.Using a computer kiosk to promote child safety:results of a randomized, controlled trial in an urbanpediatric emergency department. Pediatrics. 2007;120:330–9.
29. Claassen CA, Larkin GL. Occult suicidality in anemergency department population. Br J Psychiatry.2005; 186:352–3.
30. Fein JA, Pailler ME, Barg FK, et al. Feasibility andeffects of a Web-based adolescent psychiatricassessment administered by clinical staff in thepediatric emergency department. Arch Pediatr Ado-lesc Med. 2010; 164:1112–7.
31. Schriger DL, Gibbons PS, Langone CA, Lee S,Altshuler LL. Enabling the diagnosis of occultpsychiatric illness in the emergency department: arandomized, controlled trial of the computerized,self-administered PRIME-MD diagnostic system.Ann Emerg Med. 2001; 37:132–40.
32. Schriger DL, Gibbons PS, Nezami WA, LangoneCA. Failure of a patient-centered intervention tosubstantially increase the identification and referralfor-treatment of ambulatory emergency departmentpatients with occult psychiatric conditions: a ran-domized trial. BMC Emerg Med. 2005; 5:e2.
33. Merchant RC, Clark MA, Langan TJ, Seage GR,Mayer KH, DeGruttola VG. Effectiveness of increas-ing emergency department patients’ self-perceivedrisk for being human immunodeficiency virus (HIV)infected through audio computer self-interview-based feedback about reported HIV risk behaviors.Acad Emerg Med. 2009; 16:1143–55.
34. Rhodes KV, Lauderdale DS, Stocking CB, HowesDS, Roizen MF, Levinson W. Better health whileyou wait: a controlled trial of a computer-basedintervention for screening and health promotion inthe emergency department. Ann Emerg Med. 2001;37:284–91.
ACADEMIC EMERGENCY MEDICINE • March 2012, Vol. 19, No. 3 • www.aemj.org 327
35. Birnbaum A, Calderon Y, Gennis P, Rao R, Galla-gher EJ. Domestic violence: diurnal mismatchbetween need and availability of services. AcadEmerg Med. 1996; 3:246–51.
36. Rockett IR, Putnam SL, Jia H, Smith GS. Assessingsubstance abuse treatment need: a statewide hospi-tal emergency department study. Ann Emerg Med.2003; 41:802–13.
37. Choo E, Newgard CD, Lowe RA, Hall MK, McCon-nell KJ. Rural-Urban disparities in intimate partnerviolence resources in the emergency department.West J Emerg Med. 2010; 12:178–83.
38. Miller JH, Hester RK. Computer-based tools fordiagnosis and treatment of alcohol problems. Alco-hol Res Health. 2006; 29:36–40.
39. Turner CF, Ku L, Rogers SM, Lindberg LD, PleckJH, Sonenstein FL. Adolescent sexual behavior,
drug use, and violence: increased reporting withcomputer survey technology. Science. 1998;280:867–73.
Supporting Information:
The following supporting information is available in theonline version of this paper:
Data Supplement S1. Final search strategy.The document is in PDF format.Please note: Wiley Periodicals Inc. is not responsible
for the content or functionality of any supporting infor-mation supplied by the authors. Any queries (other thanmissing material) should be directed to the correspond-ing author for the article.
328 Choo et al. • SYSTEMATIC REVIEW OF ED TECHNOLOGY STUDIES FOR PUBLIC HEALTH