unconscious_bias_psychiatry.pdf

Upload: trancelucence

Post on 04-Jun-2018

213 views

Category:

Documents


0 download

TRANSCRIPT

  • 8/14/2019 unconscious_bias_psychiatry.pdf

    1/7

    Minimizing the Influence ofUnconscious Bias in Evaluations:

    A Practical GuideAdam J. Goldyne, MD

    The forensic psychiatrists efforts to strive for objectivity may be impaired by unrecognized unconscious biases.The author presents a framework for understanding such biases. He then offers a practical approach for individualforensic psychiatrists who want to identify and minimize the influence of previously unrecognized biases on theirevaluations.

    J Am Acad Psychiatry Law 35:60 6, 2007

    Our literature has long recognized that psychiatricexpert witness work is as subject as any other humanendeavor is to the influence of biases.1 Such biases,especially when unconscious, may constitute a directchallenge to an experts conscious goal of objectivity(Ref. 2, p 82). In this article, I offer the expert apractical approach to identifying unconscious biasesand minimizing their effects on objectivity. To sup-port these efforts, I propose a conceptual frameworkfor understanding and categorizing the origins of un-conscious bias. This framework complements the

    taxonomy of biasing factors recently offered byGutheil and Simon,3 but categories are structureddifferently to support the specific recommendationsfor minimizing bias presented in the second half ofthe article.

    Origins of Bias

    Figure 1 diagrams a conceptual framework for un-derstanding the origins of bias, which are dividedinto two types: (1) emotionally driven motivationsthat conflict with the experts motivation to be ob-

    jective, and (2) nonemotional factors, including theexperts information-processing style or fund ofknowledge, that may impair objectivity. Emotions,and resultant motivations, may stem from the ex-perts past or personality, from the present situation,

    or from provocation by others. Nonemotional fac-tors may originate in the experts biology, profes-sional background, or nonprofessional background.

    Emotion and Unconscious Motivation

    Emotions such as anger, pity, guilt, affection, re-sentment, disdain, humiliation, and others may giverise to unconscious motivations that conflict with themotivation to be objective. Sattar and colleagues4

    have defined forensic countertransference as

    . . .all feelings, whether conscious, subconscious, or uncon-scious, that are evoked in forensic examiners during evaluationor testimony, in response to examinee and nonexaminee vari-ables that have the potential to have an impact on the objectivityof their forensic opinions [Ref. 4, p 152].

    Though the ensuing discussion of the examinersemotions and motivations does not use the termcountertransference, this definition captures theideas that will be discussed. The focus of the frame-

    work presented herein will be to categorize the ori-gins of the experts emotional motivations into inter-nal factors (stemming from the experts personality

    or past) and external factors (stemming from the cur-rent situation and from provocation by others).Table 1 is a partial list of emotionally driven mo-

    tivations that may conflict with the motivation to beobjective, biasing the experts work.

    Consider the following examples of experts biasedby unconscious motivations:

    An expert is motivated to appear extremely com-petent in the eyes of the court, prompting her to

    Dr. Goldyne is Assistant Clinical Professor of Psychiatry, University ofCalifornia at San Francisco, San Francisco, CA. Address for correspon-dence: Adam J. Goldyne, MD, 3701 Sacramento St., #131, San Fran-cisco, CA 94118. E-mail: [email protected]

    60 The Journal of the American Academy of Psychiatry and the Law

    R E G U L A R A R T I C L E

  • 8/14/2019 unconscious_bias_psychiatry.pdf

    2/7

    opine unequivocally about an issue debated in

    the psychiatric literature. An experts perpetual fear of harming others mo-

    tivates him to avoid harming a defendant he hasbeen hired to evaluate. The defendant meets cri-teria for antisocial personality disorder, but theexpert does not include this in his diagnoses,telling himself, Everyone will realize that any-

    way . . . I dont need to convict the defendantmyself.

    An expert is motivated to humiliate and punishan evaluee whose crime she reviles. In interview-ing the evaluee and collateral sources, the expert

    assiduously explores reports consistent with astigmatizing personality disorder, but makes lit-tle effort to explore details indicative of posttrau-matic stress disorder.

    Origins of Emotion and Unconscious Motivation

    The Experts Past. Motivations may arise as a re-sult of resonance between the present situation andthe experts past. For example, an expert hired by anattorney whose imperious demeanor resembles thatof her father may experience an unrecognized moti-vation to please him. Alternately, an expert may beinfuriated by an attorney who is well liked, but whoreminds her of her contentious sister, and may un-thinkingly opine in a manner unfavorable to the at-torneys client. Similarly, an expert whose spousedied during a routine operation and who is now eval-

    uating a surgeon accused of malpractice may be mo-tivated to punish the surgeon with an opinion dam-aging to him.

    The Experts Personality. Certain types of motiva-tions may be typical of the experts personality, ratherthan unique to a given situation. For example, oneexperts characteristic motivation to protect the weakmay cause him to favor personal injury plaintiffs,

    whereas another experts motivation to enforce per-sonal responsibility may cause her to evaluate thesame plaintiffs more skeptically. An expert character-istically motivated to avoid doing harm may selec-

    tively discount information unfavorable to her eval-uee. An expert characteristically motivated by the

    wish for financial gain to the exclusion of otherwishes may be more likely than others to allow thismotivation to overwhelm the motivation to be ob-

    jective. It should be noted that, because an individ-uals past experience often influences personality,motivations that stem from the experts personalitytypically also stem from the experts past.

    Figure 1. A framework for conceptualizing the origins of bias.

    Table 1 Emotionally Driven Motivations That May Bias the Expert

    Avoid harming others

    Avoid being disliked

    Avoid being controlled

    Avoid being harmed

    Avoid being humiliated

    Help or protect

    Humiliate or punish

    Compete

    Gain materially

    Be liked

    Please authority figures

    Control

    Take advantage of others

    Defy authority figures

    Appear or be more adequate, superior, or competent

    Goldyne

    61Volume 35, Number 1, 2007

  • 8/14/2019 unconscious_bias_psychiatry.pdf

    3/7

    Many authors have addressed bias that arises whenthe expert deviates from the role of forensic scientistinto the role of zealot or crusader, whose efforts con-stitute a personal or political agenda (Ref. 1, p 221).Indeed, sociopolitical beliefs, when they are strongenough to influence the outcome of expert work,

    may be seen as sources of bias stemming from theexperts personality. For example, consider an expertstrongly opposed to the death penalty. When askedto evaluate a defendant facing potential execution,she accepts the case rather than recognize that herbeliefs might impair her objectivity. Her evaluationis ultimately biased to favor the defendant. This ex-ample parallels recent attention to the notion thatethics-related beliefs are likely to influence psychia-trists evaluating the competence to consent to as-sisted suicide.5 In addition to conscious aspects of hersociopolitical beliefs, the strength of the bias may

    reflect unconscious, personality-based motivations,such as the motivation to protect the defendant or todefy the authority of an unjust government.

    Current Situation. Certain situations, by their na-ture, may give rise to biasing motivations. This tru-ism is reflected in several areas of concern to forensicpsychiatrists. Examples include universal tensionssuch as that between the experts duty to objectivityand the attorneys advocacy role, as well as biases thatarise from specific factors such as the experts finan-cial desperation or inexperience. An understanding

    of situational bias also underlies admonitions againstevaluating ones patient (because one is motivated tohelp the patient) and against contingency fees (be-cause one is motivated to help the retaining attorneyfor financial gain).

    At times, situations merely enhance a motivationthat already exists because of the experts personalityor past. For example, an expert who has a competitivepersonality may be particularly vulnerable to the sit-uation-induced motivation to advocate for the partyretaining her.

    Provocation by Others. It is possible for the expert

    to experience motivations that stem primarily fromprovocation by another individual. The distinguish-ing feature of such situations is that the individual inquestion provokes similar responses in people otherthan the expert. For example, a particularly attractiveevaluee might motivate many experts to testify on hisbehalf, a particularly infuriating or off-putting eval-uee might provoke many experts to want to discredithim, and a highly controlling attorney might pro-

    voke many experts to want to defy him through opin-ions unfavorable to his client.

    Information-Processing Style and Fundof Knowledge

    Information-Processing Style

    The experts information-processing style may im-pair objectivity. This topic has been explored by theheuristics and biases literature, which emphasizesthat judgments are often biased because individualsinterpret complex situations based on inaccurate butsimplifying assumptions known as heuristics. Onesuch heuristic is the availability heuristic, a ten-dency to base ones judgments more on prominentmemories than on normative data. An expert operat-ing under this heuristic might overvalue the violencerisk of a psychotic evaluee based on her memory of

    one psychotic patient from her training. She woulddiscount research showing that most psychotic indi-viduals are not at increased risk for violence. Recently,attention has been focused on the biasing effect of heu-ristics on psychiatric disability evaluations.6 For an ap-proach to minimizing the effects of heuristics and biaseson forensic evaluations, the reader is referred to an ex-cellent article on the subject (see Ref. 7).

    Theoretical perspective also may inform the ex-perts information-processing style. For example, ex-perts trained predominantly in the diagnosis of men-tal disorders with presumed biological origins, such

    as schizophrenia or bipolar disorder, may overesti-mate the likelihood of such disorders in evaluees.Conversely, experts trained in psychodynamic, cog-nitive-behavioral, or other psychological modes ofunderstanding symptoms may downplay the role ofbiological etiologies in their forensic evaluations.

    Fund of Knowledge

    The experts fund of knowledge that is relevant toan evaluation may affect objectivity. Differences infund of knowledge may stem from the experts pro-fessional background, including training, clinical ex-perience, or awareness of the most current literature.For example, as Gold has noted, the forensic psychi-atrist who does not know that women frequently failto report unwanted sexual advances in the workplacemay, in evaluating a plaintiff alleging sexual harass-ment, interpret an evaluees lack of reporting as evi-dence that she was not distressed.8

    Bias also may reflect the effects on fund of knowl-edge of personal factors, including the experts race,

    Minimizing Unconscious Bias

    62 The Journal of the American Academy of Psychiatry and the Law

  • 8/14/2019 unconscious_bias_psychiatry.pdf

    4/7

    sex, religion, culture, ethnicity, sexual orientation, orearly-life exposure. For example, an expert evaluatinga litigant from a different culture may mistakenlyinterpret a history of teenage stealing as evidence ofincipient antisocial features, oblivious to the fact thatsuch behavior is a typical rite of passage in the eval-

    uees culture.Example

    The following example synthesizes concepts dis-cussed herein. It may be helpful to refer to Figure 1

    while reading it:

    Ms. Z. is suing for emotional damages from the owner of aparking lot where she tripped and fell with minimal physicalinjury. She alleges that she has been very depressed since theincident. In fact, Ms. Z. is malingering her depression, which isno worse than her baseline dysthymia. The fact that she is ma-lingering could be detected by noting inconsistencies in heraccount, by exploring these discrepancies in an interview, andby interviewing her coworkers.

    The plaintiffs expert, Dr. A., misses these indications ofmalingering and opines that Ms. Z. has depression triggered byher fall. This erroneous conclusionwhich Dr. A. defends sin-cerelyis based on a series of decisions made under the influ-ence of unconscious bias favoring Ms. Z. Usually diligent, Dr.

    A. inadvertently overlooks several inconsistencies in Ms. Z.saccount of her symptoms. During the interview, Dr. A. is im-pressed by Ms. Z.s tears and accepts her statements that shecant concentrate and that she is not interested in work assigns of depression without carefully assessing her baseline levelsof concentration or interest in work. Finally, Dr. A. asks theattorney for copies of depositions of Ms. Z.s coworkers, but

    does not follow up when the attorney fails to respond to theserequests.Dr. A.s bias stems from at least two factors. First, her mem-

    ory of a patient who became depressed around the time of a fallleads her to overvalue the link between falls and depression (aneffect of information processing). Second, she feels affinity andcompassion for Ms. Z. and is motivated to favor her. Thismotivation has to do with the fact that Ms. Z. has a likabledemeanor and inspires many to want to help her (the influenceof provocation), that Ms. Z. reminds Dr. A. of a favorite grand-mother (the influence of the past), that Dr. A. is generally altru-istic (the influence of personality), that Dr. A. has been anxiousto do more civil forensic work and wishes to please the attorney(the influence of the situation), and that Dr. A. wishes to be

    helpful to counteract guilty feelings connected to her husbandsrecent criticism of forensic work as heartless (the influence ofprovocation).

    This example illustrates three important points.First, bias may be the product of numerous under-lying factors. Second, motivations are almost al-

    ways directed at other individuals, some of whommay be connected to the case (e.g., the plaintiffand attorney) and some of whom may be uncon-

    nected individuals from the experts past (e.g., Dr.A.s grandmother) or present (e.g., Dr. A.s hus-band). Third, experts may not recognize their bi-asing emotional motivations (which may be toodifficult to acknowledge) or their nonemotionalbiases (which may be so ingrained that they are

    transparent).

    Proactively Detecting and Minimizing Bias

    Why Detect and Minimize Bias Proactively?

    Consider an expert who, during a case, noticesherself feeling negative and wonders if she may bebiased. She begins to consider her motivations anddecides to consult a colleague about potential sourcesof bias. Such a response to an inkling of bias is prob-ably the primary mode of bias detection among ex-perts, but it is problematic, because most experts will

    fail to experience such an inkling in response to un-conscious biases and thus will fail to engage in theneeded introspection.

    Simon and Wettstein9 have advised that the fo-rensic psychiatrist should endeavor to be aware of hisor her personal biases while, at the same time, mak-ing the appropriate correction for these biases. Ipropose that a proactive approachin which the ex-pert actively attempts to discern potential sources ofbias, rather than passively awaiting an inkling ofthemwould greatly improve bias detection and

    minimization. This suggestion is based on the hy-pothesis that deliberate cueing may alert the expert tobiasing motivations or to nonemotional factors thatotherwise might remain unrecognized. To expressthe idea another way, since a subjective sense of biasis an insensitive measure of unconscious bias, proac-tive bias detection is indicated to maintain forensicobjectivity.

    An Approach to Proactive Bias-Detection and Prevention

    The following set of introspective tasks is of-fered as an approach to proactive detection and

    prevention of bias. The tasks are designed to cuethe experts recognition of motivations and non-emotional factors that previously have been trans-parent or difficult to acknowledge. Each task asksthe expert to examine potential sources of biasfrom a slightly different perspective. The expertshould complete each task deliberately and ac-tively, probably in writing. The case of Dr. A. andMs. Z. is used to illustrate each step.

    Goldyne

    63Volume 35, Number 1, 2007

  • 8/14/2019 unconscious_bias_psychiatry.pdf

    5/7

    1. Consider each question in Table 2. Are thereclues that I may be biased?

    Example: Consider how Dr. A. might completethis task. She might note that she has been thinkingabout the case inadvertently, that she likes Ms. Z.,

    that she has felt uneasy with her husbands criticalview of forensic work, that she has neglected to insiston review of depositions of Ms. Z.s coworkers, andthat she forgot to follow up on discrepancies thatarose during Ms. Z.s interview.

    2. Who are the significant individuals connectedto this case? Who are significant individuals in mypersonal life, past or present, who motivate me insome way?

    Example: Dr. A. might list the attorney, the plain-tiff and others connected with the case. She also

    would list people from her personal life, including

    her grandmother and husband.3. Consider each individual on the list, asking: do

    I feel positive emotions (admiration, attraction, af-finity, desire, love, pride, tenderness, compassion, orpity) or negative emotions (fear, anger, humiliation,tension, anxiety, apathy, ambivalence, shame, orguilt) in connection with this person?

    Example: Dr. A. might note affinity and compas-sion for Ms. Z., anxiety about the attorneys hiring

    her in the future, and guilt about her husbands sug-gestion that forensic work is heartless.

    4. Consider each individual on the list, asking: havemy emotions toward this person given rise to motiva-tions? Am I motivated to help, protect, humiliate, pun-ish, compete with, gain materially from, be liked by,

    please, control, take advantage of, defy, or appear supe-rior to this person? Am I motivated to avoid harming,being disliked by, being controlled by, being harmedby, or being humiliated by this person?

    Example: This task might cue Dr. A. to recognizethat affinity and guilt about being heartless motivateher to help Ms. Z. and that anxiety about being hiredagain motivates her to want to please the attorney.

    5. For the emotions and motivations identifiedthus far, what are the relative influences of situa-tion, of provocation, of my past, and of my

    personality?Example: This task might cause Dr. A. to examinethe sources of her affinity for and desire to help Ms.Z. The cue to consider the situation may alert her toher theretofore unconscious desire to please the at-torney. In considering the role of provocation, shemight imagine that Ms. Z. would be likable to manypeople. In considering the past, she might recognizesimilarities between Ms. Z. and her grandmother.Initially, she might be unable to recognize any per-sonality factors relevant to her motivation to helpMs. Z.

    6. Do emotions, motivations, or nonemotionalfactors that I have experienced in previous cases playa role in this case?

    Example: This task might cause Dr. A. to notethat, in the past, others have chided her about the factthat her altruism causes her to see only the good inher evaluees. After thinking about it, she realizes thatthis is an aspect of her personality that may haveenhanced her motivation to help Ms. Z.

    7. Is my professional background limited with re-gard to this case?

    Example: Dr. A. initially might be unable to thinkof any limitations in her professional backgroundthat would affect the case.

    8. Does my personal background limit my fund ofknowledge with regard to this case?

    Example: This question might cue Dr. A. to rec-ognize that she is unfamiliar with Ms. Z.s cultureand how it would affect the presentation ofdepression.

    Table 2 Questions That an Expert May Use to Detect His or HerOwn Unconscious Biases

    Emotions and Motivations

    Did I think about this case more or less that is typical?

    Did I think excessively about someone involved in this case?

    Have I been more or less diligent than is typical?

    Is my report or opinion narrower or broader than requested?

    Does my opinion resemble my opinions in other cases?Have I had interpersonal difficulty with other parties connected tothis case?

    Am I having difficulties outside the case?

    Do others suspect me of bias?

    Does this case resonate with my sociopolitical beliefs?

    Do I have preexisting emotions or motivations about an issue orperson related to this case?

    Have I failed to follow up on discrepancies or details in this case?

    Have I failed to consider the possibility that mental symptoms aremalingered or factitious?

    Fund of Knowledge

    Is my personal background appropriate for this case?

    Is my training and experience adequate for this case?

    Information-Processing StyleDoes my theoretical perspective leave aspects of the case

    unexplained?

    Does my reasoning involve unchecked heuristics and biases?

    Minimizing Unconscious Bias

    64 The Journal of the American Academy of Psychiatry and the Law

  • 8/14/2019 unconscious_bias_psychiatry.pdf

    6/7

    9. Which of my decisions could have been ap-proached in several acceptable ways? Included mightbe decisions regarding:

    The pursuit of collateral information; What to address during interviews; How to investigate discrepancies; Whether the evaluees mental condition meets

    given DSM criteria or diagnoses; Cause and effect; Whether the evaluees mental state meets spe-

    cific legal criteria; Disputed psychiatric issues; or The degree of probability to which opinions are

    held.

    10. Were any of these decisions influenced by thepotential motivations or nonemotional factors iden-tified in previous steps?

    Example: This task may cue Dr. A. to recognizethat her failure to confront discrepancies in Ms. Z.saccount of the fall, her uncritical acceptance of Ms.Z.s reports of depressive symptoms, and her failureto insist on depositions from Ms. Z.s coworkers mayall have been influenced by her motivation to helpMs. Z.

    11. How would an expert without my motivationsor nonemotional biasesor with opposite motiva-tions or nonemotional factorshave judged or rea-soned differently? Was my work biased by ignoring

    such reasoning?Example: Dr. A. might recognize that an expertwho is not motivated to help Ms. Z. might haveexplored all discrepant data, pursued the missingdepositions more assiduously, and focused more crit-ically on malingering before diagnosing depression.She might then recognize her failure to take thesemeasures as signs of bias.

    12. If work was biased, revise judgments and opin-ions to incorporate the reasoning identified in step10.

    Example: If Dr. A. recognizes her bias before shehas completed work on her report, she might reviseher approach accordingly. For instance, she mightobtain the missing depositions and learn that Ms.Z.s symptoms do not reflect a new depression. Shemight re-interview Ms. Z. (if possible) and find thatMs. Z. responds to probing questions by becomingincreasingly evasive and reporting more severe symp-toms that conflict with earlier reports. Taking thisadditional information into account, Dr. A. might

    opine that Ms. Z.s symptoms do not meet criteriafor major depression, might question the causal linkbetween her symptoms and her fall, and might raisethe question of malingering in her report.

    Pitfalls in Proactive Bias Detection

    Proactive bias detection is challenging. It requiresthe vigilance to suspect bias when it is not overt, thediscipline to question oneself without external com-pulsion, the strength to resist becoming defensive,and the courage to risk confronting painful motiva-tions in the service of forensic objectivity.

    Failure to consider each step fully may reflect theexperts belief that potential bias deserves attentiononly if overt, ignoring the fact that bias is most prob-lematic when it is unconscious. More difficult maybe the experts belief that he is too intelligent or toosophisticated to overlook bias. In fact, a desire to

    dismiss any of the steps outlined most likely reflectsthe fact that it can be difficult to confront biasingaspects of motivation, information-processing style,or fund of knowledge.

    The expert can overcome such difficulty by delib-erate adherence to the attitude that objectivity iscompromised unless proven otherwise. Diligencemay be facilitated by imagining a discerning peer

    who continually suspects bias and demands that theexpert prove him wrong. This approach resemblesthe diagnostic approach to a medical complaint: pos-

    sible diagnoses are enumerated systematically andnone is discounted without explicit considerationand reasoning. Equivalent diligence is appropriate tothe experts consideration of factors that may com-promise objectivity.

    The proactive attempts at bias detection discussedherein will inevitably fail to identify some aspects ofunconscious emotions, motivations, information-processing styles, or fund of knowledge. These fac-torswhich may be too difficult or too transparentto recognize, even after deliberate introspectionmay be identified through supervision and peer-

    review, forums useful not only for pointing out po-tential biases, but also for reassuring the expert thatbias is common, present in worthwhile individuals,and appropriate to explore. Thus, experts shouldhave a low threshold for soliciting colleagues input.

    It should be noted that the approaches to detect-ing bias that have been described herein do not ad-dress the topic of bias preventiona topic that hasbeen discussed elsewhere and bears more thorough

    Goldyne

    65Volume 35, Number 1, 2007

  • 8/14/2019 unconscious_bias_psychiatry.pdf

    7/7

    examination in the literature. Approaches to bias pre-vention may include further education in psychiatry,forensic psychiatry, and ethics;10 ongoing peer super-vision and consultation; psychotherapy targeting theemotional factors that may impair objectivity;11

    training and supervision from more experienced fo-

    rensic psychiatrists; testifying on both sides of sig-nificant issues; and sheer experience as a forensicpsychiatrist.12

    Conclusions

    The duty to strive for objectivity is one of theforensic psychiatrists chief mandates. Because of itsinvisibility, unconscious bias may be one of the great-est obstacles to discharging this duty. To this end, theapproach discussed herein is meant to give experts

    who realize that they must strive for objectivity aconsistent and targeted approach for doing so.

    References

    1. Diamond B: The fallacy of the impartial expert. Arch Crim Psy-chodynam 3:22130, 1959

    2. Gutheil TG, Simon RI: Issues in forensic countertransference, inMastering Forensic Psychiatric Practice: Advanced Strategies for

    the Expert Witness. Washington, DC: American Psychiatric Pub-lishing, 2002, pp 8190

    3. Gutheil TG, Simon RI: Avoiding bias in expert testimony. Psy-chiatr Ann 34:26070, 2004

    4. Sattar SP, Pinals DA, Gutheil TG: Countering countertransfer-ence, II: beyond evaluation to cross-examination. J Am Acad Psy-chiatry Law 32:14854, 2004

    5. Ganzini L, Leong GB, Fenn DS,et al: Evaluation of competence

    to consent to assisted suicide: views of forensic psychiatrists. Am JPsychiatry 157:595600, 2000

    6. Harding TP: Psychiatric disability and clinical decision making:the impact of judgment error and bias. Clin Psychol Rev 24:70729, 2004

    7. Borum R, Otto R, Golding SL: Improving clinical judgment anddecision making in forensic evaluations. Int J Law Psychiatry 21:3576, 1993

    8. Gold LH: Addressing bias in the forensic assessment of sexualharassment claims. J Am Acad Psychiatry Law 26:56378, 1998

    9. Simon RI, Wettstein RM: Toward the development of guidelinesfor the conduct of forensic psychiatric examinations. J Am AcadPsychiatry Law 25:1730, 1997

    10. SattarSP, PinalsDA, Gutheil T: Countering countertransference:

    a forensic trainees dilemma. J Am Acad Psychiatry Law 30:659;discussion 703, 200211. Schetky DH, Colbach EM: Countertransference on the witness

    stand: a flightfrom self. Bull Am Acad Psychiatry Law10:11521,1982

    12. Dietz PE: The quest for excellence in forensic psychiatry. Bull AmAcad Psychiatry Law 24:15363, 1996

    Minimizing Unconscious Bias

    66 The Journal of the American Academy of Psychiatry and the Law