validating appriss safety incarceration data to determine ... · david speights, phd, chief data...

16
WHITE PAPER David Speights, PhD, Chief Data Scientist, Appriss Daniel Downs, PhD, Senior Statistical Criminologist, Appriss Adi Raz, DBA, Senior Director, Data Sciences, Appriss Validating Appriss Safety Incarceration Data to Determine Real-Time Criminal Justice Statistics

Upload: others

Post on 22-Aug-2020

10 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Validating Appriss Safety Incarceration Data to Determine ... · David Speights, PhD, Chief Data Scientist, Appriss Daniel Downs, PhD, Senior Statistical Criminologist, Appriss Adi

1

WHITE PAPER

David Speights, PhD, Chief Data Scientist, ApprissDaniel Downs, PhD, Senior Statistical Criminologist, ApprissAdi Raz, DBA, Senior Director, Data Sciences, Appriss

Validating Appriss Safety Incarceration Data to Determine Real-Time Criminal Justice Statistics

Page 2: Validating Appriss Safety Incarceration Data to Determine ... · David Speights, PhD, Chief Data Scientist, Appriss Daniel Downs, PhD, Senior Statistical Criminologist, Appriss Adi

The purpose of this study was to assess the

quality of Appriss’ incarceration data, collected

in association with its proprietary victim

notification system, VINE (Victim Information

and Notification Everyday). Through VINE,

Appriss collects incarceration information from

over 2,900 jail and Department of Correction

(DOC) facilities nationwide. This data validation

study compared Appriss’ data to data collected

by the Bureau of Justice Statistics’ (BJS) 2014

Annual Survey of Jails1 (ASJ). The BJS is widely

regarded as a reliable and valid source of

crime and justice data. To compare data sets,

Appriss employed the BJS’ methodology for

strata weighting in order to estimate national

incarceration statistics. Using Appriss’ incarceration

database with a weighted adjustment, the overall

estimates of the confined (i.e., incarcerated)

population could be replicated within 0.8% error

rate. Additional results of the study found that

within several key fields (confined population, adult

count, male count, female count, peak population,

and average daily population), Appriss’ incarceration

data elements had a 0.978 (or higher) correlation

to the ASJ for each compared variable. The

implications of this validation study show that

Appriss can replicate several key variables in the

ASJ with a latency of days, versus the current ASJ

latency of one year or longer.

Abstract

The Bureau of Justice Statistics funded this third-party report through award 2015-R2-CX-K029. It is not a BJS report and does

not release official government statistics. The report is released to help inform interested parties of the research or analysis contained

within and to encourage discussion. BJS has performed a limited review of the report to ensure the general accuracy of information

and adherence to confidentiality and disclosure standards. Any statistics included in this report are not official BJS statistics unless

they have been previously published in a BJS report. Any analysis, conclusions, or opinions expressed herein are those of the authors

and do not necessarily represent the views, opinions, or policies of the Bureau of Justice Statistics or the U.S. Department of Justice.

D I S C L A I M E R

Using Appriss’ incarceration database with a weighted adjustment, the overall estimates of the confined (i.e., incarcerated) population could be replicated within 0.8% error rate.

1 Most recent ASJ data available at the time of the study.

F O O T N O T E S

Page 3: Validating Appriss Safety Incarceration Data to Determine ... · David Speights, PhD, Chief Data Scientist, Appriss Daniel Downs, PhD, Senior Statistical Criminologist, Appriss Adi

33

Introduction..................................................................................................................3

Appriss Overview.........................................................................................................4

The Bureau of Justice Statistics and its Annual Survey of Jails.......................4

Data and Methodology...............................................................................................6

Results............................................................................................................................8

Conclusion....................................................................................................................14

Table of Contents

Page 4: Validating Appriss Safety Incarceration Data to Determine ... · David Speights, PhD, Chief Data Scientist, Appriss Daniel Downs, PhD, Senior Statistical Criminologist, Appriss Adi

4

Appriss receives real-time incarceration data

from more than 2,900 incarceration facilities

across 48 states. This data supports and informs

its automated victim notification service, VINE

(Victim Information and Notification Everyday).

The quality and consistency of Appriss’ data

is critical to ensuring victim safety. Data is

considered “high quality” when it represents

the construct to which it refers and can be used

to make accurate decisions. Assessing the quality

and consistency of data requires data standards.

This paper discusses a data validation study that

Appriss conducted in conjunction with the Bureau

of Justice Statistics (BJS)−a subset of the U.S.

Department of Justice.

In 2009, the National Research Council,

Division of Behavioral and Social Sciences

and Education, Committee on National Statistics,

and Committee on Law and Justice created an

objective panel to review BJS research and data.

The panel subsequently published a report titled,

“Ensuring the Quality, Credibility, and Relevance

of U.S. Justice Statistics” in which they concluded

that the BJS’ research and data was a “solid body

of work.” In addition, the American Association

for Public Opinion Research (AAPOR), a leading

association of survey research professionals,

awarded the BJS the 2014 Policy Impact Award

for their state-of-the art, multi-measure,

multi-mode data collections. Nationally, the BJS

is highly regarded as having reliable and valid crime

and justice systems data. The purpose of this study,

therefore, was to evaluate Appriss’ data against

the BJS standard.

Introduction

3

Appriss receives real-time incarceration data from more than 2,900 incarceration facilities across 48 states.

Page 5: Validating Appriss Safety Incarceration Data to Determine ... · David Speights, PhD, Chief Data Scientist, Appriss Daniel Downs, PhD, Senior Statistical Criminologist, Appriss Adi

4

Appriss operates the nation’s most

comprehensive and up-to-date incarceration

data network. Appriss delivers data-driven

solutions that help deliver real-time notifications,

context-sensitive risk assessments, and actionable

insights. It enables government agencies and

commercial enterprises to save lives, fight and

solve crime, prevent fraud, and manage risk.

Appriss’ proprietary incarceration database is

updated in real time and is made up of over 135

million current and historical booking records—with

1 million additional records added each month.

Appriss utilizes proprietary consolidation and

linking technology to tie together various

identifiers (e.g., name, driver license, address,

offender ID, phone number, social security number

and DOB) to determine the bookings associated

with an individual.

The BJS develops national standards for justice

statistics and is the federal agency primarily

responsible for measuring national incarceration

statistics. The BJS measures incarceration

metrics at federal, state, tribal, and local levels.

The data collected by the BJS includes: criminal

victimization, criminal offenders, victims of crime,

correlates of crime, and the operation of criminal

and civil justice systems. The BJS also collects,

analyzes, and disseminates reliable and valid

statistics on justice systems in the United States

to support improvements to criminal justice

information systems.

Every five-to-six years, the BJS conducts a census,

collecting data from all local U.S. jails. In the interim,

the BJS conducts the Annual Survey of Jails (ASJ).

Since 1982, it has been the sole data collection

effort providing annual data and statistics on local

jails and inmates. The BJS collects data for the

ASJ from a sample of jails (or “jurisdictions”),

and from that sample estimates the number

and baseline characteristics of the nation’s jails

and inmates. Through the ASJ, data are provided

on bookings and releases, growth in the number

of jail facilities, changes in facilities’ rated capacities

and levels of occupancy, population growth

regarding those supervised in the community,

changes in methods of community supervision,

and prison overcrowding.

Since BJS methods and data are considered the

national standard, they have been used to conduct

a plethora of research. For example, Steadman et

al. (1999) used BJS data to study incarceration

rates among inmates with serious mental illnesses

and co-occurring substance abuse disorders.

They found that 75% of mentally ill inmates had

Since BJS methods and data are considered the national standard, they have been used to conduct a plethora of research.

Appriss’ proprietary incarceration database is made up of over 135 million current and historical booking records.

Appriss Overview

The Bureau of Justice Statistics and its Annual Survey of Jails

Page 6: Validating Appriss Safety Incarceration Data to Determine ... · David Speights, PhD, Chief Data Scientist, Appriss Daniel Downs, PhD, Senior Statistical Criminologist, Appriss Adi

6

a co-occurring substance abuse disorder.

Greenburg and Rosenheck (2008) used BJS

data to assess the link between incarceration,

homelessness and mental health and found mental

illness was significantly higher in homeless inmates

when compared to domiciled inmates. Florence et

al. (2013) utilized BJS data to assess the economic

burden (i.e., criminal justice costs) of opioid abuse,

while Roach and Schanzenbach (2015) studied the

effect of incarceration on crime over time and used

BJS data to validate their findings on recidivism.

Miller (2016) used BJS data to assess injuries

and arrest-related deaths resulting from

police intervention.

The BJS also produces research on the etiology

of crime and victimization. For example, an annual

BJS report provides statistics on the nature of

crime and responses to violence in schools (Zhang,

Truman, & Snyder, 2011). BJS data has also been

used to study and assess victims and perpetrators

of crime. Notable topics include:

• Violent victimization among individuals with disabilities (Harrell, 2015)

• Perpetrators of violent victimization (Oudekerk & Morgan, 2016)

• Statistics and sentencing for perpetrators of human trafficking (Motivans & Snyder, 2018)

• Victims of identity theft (Harrell, 2014)

• Police response times to domestic violence (Reaves, 2017)

• Victims of hate crimes and police report statistics (Langton & Masucci, 2017)

• Statistics on repeat victimization (Oudekerk & Truman, 2017)

BJS data has been used to assess incarceration

statistics and rates. For example, 54% of drug

offenders were serving sentences for cocaine

(Taxy, Samuels & Adams, 2015), 72% of females

in local jails met the criteria in the DSM-IV for

drug dependence or abuse compared to 62% of

males (Bronson, et al., 2017), psychological distress

among prisoners (Bronson & Berzofsky, 2017),

and recidivism rates among prisoners (Alper &

Durose, 2018). Moreover, the FBI partnered with

the BJS to make policing more effective by creating

the National Crime Statistics Exchange (NSC-X).

NCS-X is a system of nationally representative

incident-based data on crimes reported to law

enforcement agencies (Snyder, 2013).

While BJS and ASJ methods and data are

considered high quality, it falls short in its latency.

The data are intended for multiple users, including

federal and state agencies, local officials, and jail

administrators, who often require timely data.

Given the time needed to collect and analyze the

ASJ data, the survey data are at least one year

old when the reports are published. Alternatively,

Appriss receives real-time incarceration data. The

objective of this paper is to describe an analysis

estimating Appriss’ data validity, when compared

with the ASJ, to assess whether Appriss data can

be used in lieu of—or in conjunction with—ASJ data.

While BJS and ASJ methods and data are considered high quality, it falls short in its latency.

5

BJS data has also been used to study and assess victims and perpetrators of crime.

Page 7: Validating Appriss Safety Incarceration Data to Determine ... · David Speights, PhD, Chief Data Scientist, Appriss Daniel Downs, PhD, Senior Statistical Criminologist, Appriss Adi

776

Data and Methodology

When conducting the ASJ, the BJS uses a stratified probability

sampling procedure that divides jurisdictions nationwide into

subgroups (or “strata”) that are based on the characteristics of

each (defined in Table 1, following page). Jurisdictions represented

in each stratum are then randomly selected for inclusion in the

sample. This study’s sampling procedure resulted in 878 jurisdictions,

representing 2,750 jurisdictions nationwide. The BJS then uses

a cross-sectional analysis to compare different groups at a single

point in time.

The ASJ defines ten strata, where each stratum is determined

by a jail’s average daily population (ADP) and presence of

incarcerated juveniles. The ASJ sample also includes three strata

or sub-strata that are referred to as “certainty strata.” Within

each certainty stratum, all jurisdictions that contain facilities

that qualify for that certainty stratum are analyzed (i.e., no

sample population is selected; the entire population is analyzed).

Page 8: Validating Appriss Safety Incarceration Data to Determine ... · David Speights, PhD, Chief Data Scientist, Appriss Daniel Downs, PhD, Senior Statistical Criminologist, Appriss Adi

6

sample data. Weights are based on the number

of jurisdictions in a stratum divided by the number

of jurisdictions in the census. Appriss worked closely

with BJS staff, using their methodology in order to

replicate the confined population and ADP estimates

by stratum. Appriss assessed its own offender data

accuracy by assessing atypical values and trends

over time. ASJ data was matched to Appriss data

by facility ID, facility name, city, state, and zip code.

Correlation Analyses

Comparisons between Appriss and the ASJ were

assessed by jurisdiction for key metrics: the total

number of confined individuals, the adult confined

population, the male confined population, the female

confined population, ADP, and peak population

confinement. Since this analysis assessed raw ASJ

and Appriss data by site, no weights were applied.

STRATUM DESCRIPTION

1 Jurisdiction certainties based on ADP

1.1 California jail certainties

2 ADP between 264 and 499

3 ADP between 141 and 263

4 ADP between 69 and 140

5 ADP between 0 and 68

7 ADP between 227 and 749

8 ADP between 103 and 226

9 ADP between 40 and 102

10 ADP between 0 and 39

12 Regional jail certainties

Holding at least one juvenile on Census day

Holding adults only on Census day

Table 1: BJS Stratum and Description (ASJ, 2014)

As a result, certainty strata receive a sampling

weight of 1. To qualify for inclusion in a certainty

strata, a jail must retain one of the following

characteristics:

• Operated jointly by two or more jurisdictions (i.e., multijurisdictional jails)

• Located in the State of California

• Holds juvenile inmates and has an ADP of 500 or more inmates OR holds adult inmates only and has an ADP of 750 or more

Within the other eight strata, the BJS selects

a random sample of jail jurisdictions.

Appriss analyzed data from the 2014 ASJ, in which

the BJS drew a sample of local jail jurisdictions

that administered one or more local jails. To

accurately estimate the national incarcerated

population, the BJS applies weights to their

This study’s sampling procedure resulted in 878 jurisdictions, representing 2,750 jurisdictions nationwide.

7

Page 9: Validating Appriss Safety Incarceration Data to Determine ... · David Speights, PhD, Chief Data Scientist, Appriss Daniel Downs, PhD, Senior Statistical Criminologist, Appriss Adi

98

Using the Pearson correlation coefficient, key

variables between Appriss and the ASJ were

assessed. A correlation analysis measures

the direction and strength of a linear relationship

between two variables. A correlation coefficient

(r) has a value between -1 and 1. A ‘0’ indicates

that there is no relationship between two

variables. If a correlation is greater than 0,

then the relationship between two variables

is considered positively correlated (i.e., as

one variable increases, the other variable also

Results

Table 2: Correlations Between BJS and Appriss on Key Incarceration Variables

-

1,000

2,000

3,000

4,000

5,000

6,000

7,000

8,000

9,000

10,000

11,000

12,000

13,000

14,000

15,000

16,000

17,000

18,000

19,000

20,000

- 5,000 10,000 15,000 20,000

BJS

Con

fine

d P

opul

ati

on

Appriss Confined Population

VARIABLE CORRELATIONAVERAGE

ASJAVERAGE APPRISS

PERCENT DIFF

CONFINED POPULATION (6/30/2014) 0.999 618.9 641.2 3.6%

ADULT COUNT (6/30/2014) 0.999 613.3 634.9 3.5%

MALE COUNT (6/30/2014) 0.998 526.0 539.5 2.6%

PEAK POPULATION (6/24-6/30/2014) 0.998 633.6 659.1 4.0%

ADP 2014 0.997 577.1 595.7 3.2%

FEMALE COUNT (6/30/2014) 0.978 86.2 90.2 4.6%

increases). If r = 1 then there is a perfect positive

linear relationship between two variables. Table 2

shows the correlation coefficient of key variables

between ASJ and Appriss and illustrates near

perfect correlation.

Figures 1, 2, and 3 illustrate the correlation between

Appriss and the ASJ’s respective estimations of the

confined population by site (r = .999), adult count by

site (r = .999), and male count (r = .998).

Figure 1: Compare BJS Confined Population to Appriss Confined Population

BJS and Appriss comparison of confined populations by facility is strongly associated

Correlation = 0.999

Page 10: Validating Appriss Safety Incarceration Data to Determine ... · David Speights, PhD, Chief Data Scientist, Appriss Daniel Downs, PhD, Senior Statistical Criminologist, Appriss Adi

10

-

2,000

4,000

6,000

8,000

10,000

12,000

14,000

16,000

18,000

- 2,000 4,000 6,000 8,000 10,000 12,000 14,000 16,000 18,000

BJS

Ma

le C

ount

Appriss Male Count

-

2,000

4,000

6,000

8,000

10,000

12,000

14,000

16,000

18,000

20,000

- 5,000 10,000 15,000 20,000

BJS

Ad

ult

Cou

nt

Appriss Adult Count

Figure 2: Compare BJS Adult Count to Appriss Adult Count

Figure 3: Compare BJS Male Count to Appriss Male Count

9

Correlation = 0.999

Correlation = 0.998

Page 11: Validating Appriss Safety Incarceration Data to Determine ... · David Speights, PhD, Chief Data Scientist, Appriss Daniel Downs, PhD, Senior Statistical Criminologist, Appriss Adi

1110

0

2000

4000

6000

8000

10000

12000

14000

16000

18000

20000

0 2000 4000 6000 8000 10000 12000 14000 16000 18000 20000

BJS

Pea

k P

opul

ati

on

Appris Peak Population

-

1,000

2,000

3,000

4,000

5,000

6,000

7,000

8,000

9,000

10,000

11,000

12,000

13,000

14,000

15,000

16,000

17,000

18,000

19,000

20,000

- 2,000 4,000 6,000 8,000 10,000 12,000 14,000 16,000 18,000 20,000

BJS

Ave

rag

e D

aily

Pop

ula

tion

Appriss Average Daily Population

Figure 4: Compare BJS Peak Population to Appriss Peak Population

Figure 5: Compare BJS Average Daily Population to Appriss Average Daily Population

Figures 4, 5, and 6 illustrate the correlation between Appriss and the ASJ’s respective estimations

of peak population by site (r = .998), ADP by site (r = .997), and female count (r = .978).

Correlation = 0.998

Correlation = 0.997

Page 12: Validating Appriss Safety Incarceration Data to Determine ... · David Speights, PhD, Chief Data Scientist, Appriss Daniel Downs, PhD, Senior Statistical Criminologist, Appriss Adi

12

Comparisons by Stratum

To best estimate the confined population

between census collections, the ASJ groups

comparable jails together into strata, and

from there, deduces a representative sample

from each. Knowing the total number of

jurisdictions represented in each stratum (based

on census data) allows the BJS to make national

estimates from the sample using sample weights

and the ADP. The ADP is calculated by summing

the number of incarcerated individuals each day

for a year, and dividing that sum by the number

of days in the year. Since the ASJ is a sample

of jails used to estimate the national numbers,

the BJS uses a sampling weight. The weight is

multiplied by the ASJ’s ADP for each stratum

to estimate a national figure. The sampling

-

500

1,000

1,500

2,000

2,500

3,000

- 500 1,000 1,500 2,000 2,500 3,000

BJS

Fem

ale

Cou

nt

Appriss Female Count

weight and estimated confined population

calculations are:

• Weight = # of jurisdictions in the census / # of jurisdictions in the ASJ

• Estimated Confined Population = weight x ADP

ASJ data elements were matched against Appriss

data elements by jurisdiction. Appriss used BJS

weighting and methodologies to first replicate

the 2014 ASJ findings. Appriss then applied BJS

weighting and methods to its own data (e.g.,

number of Appriss jurisdictions in a stratum and

Appriss’ ADP) to estimate the national confined

population. Additionally, Appriss applied a modified

weighting approach using ADP to adjust for the

bias of not selecting a random sample (Appriss’

Figure 6: Compare BJS Female Count to Appriss Female Count

11

Correlation = 0.978

Page 13: Validating Appriss Safety Incarceration Data to Determine ... · David Speights, PhD, Chief Data Scientist, Appriss Daniel Downs, PhD, Senior Statistical Criminologist, Appriss Adi

1312

data collection is determined by the contracts it

has within each state). The formula for Appriss’

ADP weight:

Appriss ADP Weight = (ADP for ASJ / # of

jurisdictions in the census) / (ADP for Appriss

/ # of Appriss jurisdictions) * (the original BJS

weighting methodology applied to Appriss’

reporting jurisdictions)

For example, out of the 246 jurisdictions in

Stratum 1, 128 report their data to Appriss

and 228 are surveyed in the ASJ. Without

bias weighting adjustments, Appriss’ estimation

of confined population was 320,380 individuals,

compared to ASJ’s estimate of 355,897

individuals. Appriss estimates the average

ADP to be 1,343 individuals, compared to ASJ’s

estimate of 1,448 individuals. To correct for the

estimation, Appriss calculated a new weight for

each stratum to adjust for the fact that Appriss’

selection of jails was not representative of the

stratum average. The adjusted weight being more

stable, Appriss used it in its final calculations. See

Table 3 for an example of Appriss’ ADP weight

results for Stratum 1. The new results show the

difference in the estimation between Appriss

and BJS, once adjusting for the bias, is .1%.

The new results show the difference in the estimation between Appriss and BJS is .1%.

Table 3: Example ADP Weights and Results

STRATUMNUMBER

OF APPRISS JURISDICTIONS

NUMBER OF ASJ JURISDICTIONS

NUMBER OF JURISDICTIONS

IN CENSUSAPPRISS ADP ASJ ADP

1 128 228 246 171,921 330,193

FINAL ASJ WEIGHT

APPRISS WEIGHT W/O BIAS

ADJUSTMENT

APPRISS ADP WEIGHT

TOTAL ASJ CONFINED

POPULATION

NEW TOTAL APPRISS

CONFINED POPULATION

PERCENT DIFF

1.08 1.92 2.07 355,897 356,261 0.1%

Page 14: Validating Appriss Safety Incarceration Data to Determine ... · David Speights, PhD, Chief Data Scientist, Appriss Daniel Downs, PhD, Senior Statistical Criminologist, Appriss Adi

14

-

50,000

100,000

150,000

200,000

250,000

300,000

350,000

400,000

1 1.1 2 3 4 5 7 8 9 10 12

Con

fine

d P

opul

ati

on

Stratum

ASJ Confined Population Appriss ADP Weight

STRATUMASJ CONFINED POPULATION

APPRISS CONFINED POPULATION

(BASED ON ADP WEIGHT)

ABSOLUTE DIFFERENCE BETWEEN ASJ AND APPRISS

1 355,882 356,261 0.1%

1.1 84,115 83,664 0.5%

2 32,589 32,186 1.2%

3 25,294 25,201 0.4%

4 11,473 11,222 2.2%

5 5,330 5,034 5.5%

7 83,746 82,321 1.7%

8 56,341 55,838 0.9%

9 43,326 42,306 2.4%

10 16,421 15,114 8.0%

12 30,058 29,830 0.8%

TOTAL 744,576 738,975 0.8%

Figure 7: Confined Population Estimates for Appriss and BJS by Stratum

Figure 7 shows ASJ and Appriss’ estimates for the confined population by stratum. As noted

in the table, estimates were comparable.

Table 4, below, corresponds to Figure 7. The absolute difference between ASJ and Appriss

estimations is .75%.

Table 4: Estimated Confined Population by Stratum

13

Page 15: Validating Appriss Safety Incarceration Data to Determine ... · David Speights, PhD, Chief Data Scientist, Appriss Daniel Downs, PhD, Senior Statistical Criminologist, Appriss Adi

151514

In this paper we illustrate the accuracy and validity

of Appriss’ data by comparing it to the nationally

recognized standard for criminal justice data−the

BJS and its ASJ data. Two methods were used for

validating Appriss’ data. The first method compared

data on key incarceration variables between Appriss

and the ASJ by jurisdiction. The second method

involved a new approach−formalized for estimating

the confined population by stratum and validating the

estimates of the confined population against ASJ data.

This analysis also supports the value of Appriss’ data

in assessing:

• Differing levels of crime by location

• Crime patterns over time

• Various types of recidivism by offense type and location

In addition, Appriss’ real-time data would allow for

continual monitoring of key incarceration metrics,

and could also be useful to bridge research and

practice by aiding in public policy decisions.

In conclusion, having timely and accurate data is

important in making critical decisions and responding

to public safety concerns. This study found that using

Appriss data to estimate the confined population

was congruent and highly correlated to ASJ data on

six key characteristics:

• Total number of confined individuals

• Adult confined population

• Male confined population

• Female confined population

• Average daily population

• Peak population confinement

This study indicates that Appriss’ incarceration data

is valid, reliable, and timely. This study concludes with

confidence that Appriss’ data can be used as an ASJ

substitute for certain key variables, with the benefit

of real-time availability.

Conclusion

Page 16: Validating Appriss Safety Incarceration Data to Determine ... · David Speights, PhD, Chief Data Scientist, Appriss Daniel Downs, PhD, Senior Statistical Criminologist, Appriss Adi

16rev 12/18

About Appriss Safety

Appriss Safety is the developer of the Appriss Insights Platform, the nation’s most comprehensive source of

incarceration, justice, and risk intelligence data. We are a team of technology and data science experts who

provide insights and analytic solutions that support informed decisions for early response to people-driven

fraud and risk.

apprisssafety.com [email protected]

Alper, M. & Durose, M. (2018). 2018 update on prisoner recidivism: A 9-Year follow-up period (2005-2014) (NCJ 250975), Bureau of Justice Statistics, Office of Justice

Programs, U.S. Department of Justice. Washington, DC.

Bronson, J. Stroop, J., Zimmer, S. & Berzofsky, M. (2017). Drug use, dependence, and abuse among state prisoners and jail inmates, 2007-2009 (NCJ 250546). Bureau of

Justice Statistics, Office of Justice Programs, U.S. Department of Justice. Washington, DC.

Bronson, J. & Berzofsky, M. (2017). Indicators of mental health problems reported by prisoners and jail inmates, 2011-12 (NCJ 250612). Bureau of Justice Statistics, Office

of Justice Programs, U.S. Department of Justice. Washington, DC.

Curtis S. F., Chao Z., Feijun L., & Likang X. (2016). The economic burden of prescription opioid overdose, abuse, and dependence in the United States. Medical Care, 54 (10).

Greenberg, G. A. & Rosenheck, R.A. (2008). Jail incarceration, homelessness, and mental health: A national study, Psychiatric Services, 59(2):170-7.

Groves, R. M., Barron Jr., W. G., Clements, W., Lattimore, P. K., Lauritsen, J. L., Loftin, C., ... Cork, D. L. (Ed.) (2009). Ensuring the Quality, Credibility, and Relevance of U.S.

Justice Statistics: Panel to Review the Programs of the Bureau of Justice Statistics, National Research Council. Washington, D.C.: The National Academies Press.

Harrell, E. (2015). Victims of identity theft, 2014 (NCJ 248991). Bureau of Justice Statistics, Office of Justice Programs, U.S. Department of Justice. Washington, DC.

Harrell, E. (2015). Crime against persons with disabilities, 2009–2013 - statistical tables (NCJ 248676). Bureau of Justice Statistics, Office of Justice Programs, U.S. De-

partment of Justice. Washington, DC.

Langton, L. & Masucci, M. (2017). Hate crime victimization, 2004-2015 (NCJ 250653). Bureau of Justice Statistics, Office of Justice Programs, U.S. Department of Justice.

Washington, DC.

Miller T.R., et al. (2017). Perils of police action: A cautionary tale from US data sets. BMJ. Inj Prev, 23:27– 32.

Minton, T. D. & Zeng, Z. (2015). Jail inmates at midyear 2014. Bureau of Justice Statistics. Retrieved from http://www.bjs.gov/index.cfm?ty=pbdetail&iid=5299

Motivans, M. & Snyder, H. N. (2018). Federal prosecution of human-trafficking cases, 2015, (NCJ 251390). Bureau of Justice Statistics, Office of Justice Programs, U.S.

Department of Justice. Washington, DC.

Oudekerk, B.A. & Morgan, R. E. (2016). Co-offending among adolescents in violent victimizations, 2004–13 (NCJ 249756). Retrieved from https://www.hsdl.org/?view&-

did=794128

Oudekerk, B.A. & Truman, J. L. (2017). Repeat violent victimization, 2005-14 (NCES 2016-079NCJ 250567). Bureau of Justice Statistics, Office of Justice Programs, U.S.

Department of Justice. Washington, DC.

Reaves, B. (2017). Police response to domestic violence, 2006-2015 (NCJ 250231). Bureau of Justice Statistics, Office of Justice Programs, U.S. Department of Justice.

Washington, DC.

Roach, M. A. & Schanzenbach, M. M. (2015). The effect of prison sentence length on recidivism: Evidence from random judicial assignment. Northwestern Law & Econ

Research Paper, 16(08).

Roberts, S., Zhang, J., & Truman, J. (2011). Indicators of school crime and safety. (NCES 2012-002/NCJ 236021). National Center for Education Statistics, U.S. Department

of Education, and Bureau of Justice Statistics, Office of Justice Programs, U.S. Department of Justice. Washington, DC.

Snyder, H. N. (2013). NCS-X: Building a system of national crime statistics for the 21st century. The Criminologist, 38(6).

Steadman, H. J., Deane, M. W., Morrissey, J. P., Westcott, M. L., Salasin S. & Shapiro S. (1990). A SAMHSA research initiative assessing the effectiveness of jail diversion

programs for mentally ill persons. Psychiatric Services, 50(12):1620-3.

Taxy, S., Samuels, J. & Adams, W. (2015). Drug offenders in federal prison: Estimates of characteristics based on linked data (NCJ 248648). Bureau of Justice Statistics,

Office of Justice Programs, U.S. Department of Justice. Washington, DC.

References