“stop! in the name of civility”: testing the effectiveness

94
Masthead Logo University of Connecticut OpenCommons@UConn Master's eses University of Connecticut Graduate School 5-12-2019 “Stop! In the Name of Civility”: Testing the Effectiveness of an Intervention to Reduce Workplace Incivility Corey Grantham [email protected] is work is brought to you for free and open access by the University of Connecticut Graduate School at OpenCommons@UConn. It has been accepted for inclusion in Master's eses by an authorized administrator of OpenCommons@UConn. For more information, please contact [email protected]. Recommended Citation Grantham, Corey, "“Stop! In the Name of Civility”: Testing the Effectiveness of an Intervention to Reduce Workplace Incivility" (2019). Master's eses. 1362. hps://opencommons.uconn.edu/gs_theses/1362

Upload: others

Post on 28-Oct-2021

5 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: “Stop! In the Name of Civility”: Testing the Effectiveness

Masthead LogoUniversity of ConnecticutOpenCommons@UConn

Master's Theses University of Connecticut Graduate School

5-12-2019

“Stop! In the Name of Civility”: Testing theEffectiveness of an Intervention to ReduceWorkplace IncivilityCorey [email protected]

This work is brought to you for free and open access by the University of Connecticut Graduate School at OpenCommons@UConn. It has beenaccepted for inclusion in Master's Theses by an authorized administrator of OpenCommons@UConn. For more information, please [email protected].

Recommended CitationGrantham, Corey, "“Stop! In the Name of Civility”: Testing the Effectiveness of an Intervention to Reduce Workplace Incivility"(2019). Master's Theses. 1362.https://opencommons.uconn.edu/gs_theses/1362

Page 2: “Stop! In the Name of Civility”: Testing the Effectiveness

“Stop! In the Name of Civility”:

Testing the Effectiveness of an Intervention to Reduce Workplace Incivility

Corey L. Grantham

B. A., University of California, Berkeley, 2016

A Thesis

Submitted in Partial Fulfillment of the

Requirements for the Degree of

Master of Science

At the

University of Connecticut

2019

Page 3: “Stop! In the Name of Civility”: Testing the Effectiveness

ii

Copyright by Corey Grantham

2019

Page 4: “Stop! In the Name of Civility”: Testing the Effectiveness

iii

APPROVAL PAGE

Master of Science Thesis

“Stop! In the Name of Civility”:

Testing the Effectiveness of an Intervention to Reduce Workplace Incivility

Presented by

Corey L. Grantham, B.A.

Major Advisor________________________________________________________________

Vicki J. Magley

Associate Advisor_____________________________________________________________

Janet L. Barnes-Farrell

Associate Advisor_____________________________________________________________

Stephanie Milan

University of Connecticut

2019

Page 5: “Stop! In the Name of Civility”: Testing the Effectiveness

iv

Abstract

Workplace incivility is a common problem within organizations. Recent data estimates that 96%

of the total workforce population in the United States has experienced incivility at one time or

another. Individual targets of incivility face detrimental effects to their psychological and

professional well-being. Workplace incivility also leads to poor outcomes for workgroups and

for organizations as a whole. Results are mixed for the use of formal training programs to curb

incivility in organizations. A workshop designed to train employees on behaving in a civil

manner in the workplace, as well as how to respond to workplace incivility, was implemented

across multiple facilities of a healthcare organization. Pre- and post-training survey measures of

team civility experiences, team cohesion, team-level norms for civility, interpersonal citizenship

behaviors (OCB-I), and team performance served as dependent variables. Longitudinal data

analysis methods using quasi-simplex four-wave cross-lagged panel analysis were employed to

analyze the data. Results indicate that experiences of incivility may be reduced across time as a

result of the civility intervention and that civility norms may be enhanced by the civility training.

Positive trends in proximal and distal outcomes were also observed, though additional research is

needed to support the efficacy of civility interventions to positively impact these outcomes.

Practical implications for organizations wishing to curb workplace incivility through

implementation of an intervention are also discussed.

Page 6: “Stop! In the Name of Civility”: Testing the Effectiveness

Running Head: STOP! IN THE NAME OF CIVILITY: TESTING THE EFFECT

1

“Stop! In the Name of Civility”:

Testing the Effectiveness of an Intervention to Reduce Workplace Incivility

Incidents of workplace incivility are on the rise in the United States. In 2001, 70% of

working adults in the U. S. reported experiencing incivility in their workplace (Cortina, Magley,

Williams, & Langhout, 2001) and by 2010 that number had risen to 96% (Porath & Pearson,

2010). Incivility has been estimated to cost organizations approximately $14,000 per employee

per year through sharp declines in employee performance and effort, lost time, and increased

turnover (Porath & Pearson, 2010). Incivility is defined as a “low-intensity deviant behavior with

ambiguous intent to harm the target, in violation of workplace norms for mutual respect”

(Andersson & Pearson, 1999, p. 457). Incivility often includes such rude behaviors as

interrupting a speaker, using a condescending tone, making remarks that demean the target,

ignoring someone or giving them “the silent treatment,” and excluding the targeted individual

from meetings (Andersson & Pearson, 1999; Cortina & Magley, 2009; Gallus, Bunk, Matthews,

Barnes-Farrell, & Magley, 2014; Lim, Cortina, & Magley, 2008). Thus, incivility is a subtle

form of workplace mistreatment that is milder than aggression, bullying, or harassment and for

which the intention of the perpetrator is not always clear (Andersson & Pearson, 1999; Lim et

al., 2008).

Individuals who are the target of incivility face detrimental effects to their psychological

and professional well-being. These effects include job stress and psychological distress (Cortina

et al., 2001; Lim & Cortina, 2005), withdrawal from work (Pearson, Andersson, & Wegner,

2001), decreased job satisfaction (Penney & Spector, 2005), diminished co-worker and

supervisor satisfaction (Martin & Hine, 2005), lower afterwork psychological detachment and

next-day recovery (Nicholson & Griffin, 2015), declines in task performance, creativity, and

Page 7: “Stop! In the Name of Civility”: Testing the Effectiveness

STOP! IN THE NAME OF CIVILITY: TESTING THE EFFECT 2

helpfulness (Porath & Erez, 2007), higher turnover intentions (Wilson & Holmvall, 2013), lower

marital satisfaction (Ferguson, 2012), negative health outcomes (Lim et al., 2008), and

depression and higher conflict between work and family life (Lim & Lee, 2011). Incivility can

also interrupt cognitive processes, such as memory, and deplete mental, emotional, and social

resources that lead to a disruption of task performance (Porath & Erez, 2007). Kabat-Farr,

Cortina, and Marchiondo (2016) found that these consequences were worst for the most

committed employees.

In addition to adverse effects for the individual targets, incidents of workplace incivility

lead to poor outcomes for workgroups and for organizations as a whole (Andersson & Pearson,

1999; Cortina, Kabat-Farr, Magley, & Nelson, 2017). First, research has found that targets of

incivility may retaliate by engaging in incivility themselves, creating a spiral of workplace

mistreatment (Andersson & Pearson, 1999; Rosen, Koopman, Gabriel, & Johnson, 2016) that

may escalate into aggression, bullying, or workplace violence (Neuman & Baron, 1997; Pearson,

Anderson, & Porath, 2000; Pearson, Andersson, & Porath, 2005). Moreover, if incivility is left

unchecked, it can create a climate of incivility that affects the entire organization (Paulin &

Griffin, 2017; Torkelson, Holm, Bäckström, & Schad, 2016; Walsh et al., 2012). An uncivil

work climate can then serve as a frame of reference for employees and thus guide their

normative and expected work behaviors, potentially leading to a recurring cycle of incivility

(Probst, Brubaker, & Barsotti, 2008; Schneider, 1975).

To prevent the creation of an uncivil work climate, organizations must be aware of the

individual and group level antecedents of workplace incivility. Moreover, organizations should

accurately assess the uncivil behaviors that may already be occurring among their employees.

Understanding the prevalence of uncivil behaviors and how these behaviors spread will facilitate

Page 8: “Stop! In the Name of Civility”: Testing the Effectiveness

STOP! IN THE NAME OF CIVILITY: TESTING THE EFFECT 3

the creation of interventions to curb incivility within the organization. With that aim, this study

serves two primary purposes. First, I will describe the methods organizations can use to create

and implement training interventions to reduce incidents of workplace incivility. Second, I

describe the results of such an intervention and its proximal and distal effects on group and

organizational level outcomes. I begin the process of generating hypotheses by outlining the

effects of incivility on team emergent states (specifically, team cohesion). Next, I describe the

relationship between experiencing workplace incivility and its effect on overall job performance.

Finally, I describe the aggregated effects of uncivil teams on establishing an organizational

climate for civility, and I situate the study of incivility and its reduction within a multi-level

framework.

Incivility and Team Cohesion

Although some research has examined incivility at the team level of analysis (e.g.,

Griffin, 2010; Lim et al., 2008), most extant research has focused primarily on the occurrence of

incivility among dyads (Mao et al., 2017). The researchers who have begun to study incivility

beyond the dyad recognize that individuals work in contexts that may influence whether one is

the target, observer, or perpetrator of incivility and that certain contexts may facilitate the spread

of uncivil behaviors (Foulk, Woolum, & Erez, 2016; Rosen et al., 2016). Results are mixed,

however, as to if, when, and how incivility instigation spreads within and between teams and

throughout an organization in response to incidents of workplace mistreatment (Cortina et al.,

2017).

Teams are characterized by their interdependence, their shared goals, and the quality of

social interactions among team members (Kozlowski & Bell, 2003; Mathieu, Maynard, Rapp, &

Gilson, 2008). Overall team effectiveness is typically linked to a team’s success in managing

Page 9: “Stop! In the Name of Civility”: Testing the Effectiveness

STOP! IN THE NAME OF CIVILITY: TESTING THE EFFECT 4

such team processes as task execution, goal creation and progress monitoring, coordination of

team members and team resources, and managing interpersonal conflict and overall team affect

(Marks, Mathieu, & Zaccaro, 2001). Information is arguably the most valuable resource in team

settings, and successful exchange of this commodity is not only critical to organizational success

(Itzkovich & Heilbrunn, 2016), but it is also positively associated with team cohesion (Aubke,

Wöber, Scott, & Baggio, 2014). When information is not exchanged (such as when one is

behaving in an uncivil manner by giving a co-worker “the silent treatment”), cohesion is

diminished. Cohesion was originally proposed by Festinger (1950) and was defined as “the

resultant of all the forces acting on the members to remain in the group” (p. 274). Cohesion,

then, is the bond that exists among group members (Beal, Cohen, Burke, & McLendon, 2003).

The emergence of cohesion in teams is generally explained using social identity theory

(Tajfel, 1974; Tajfel & Turner, 1986) and social exchange theory (Blau, 1964; Homans, 1961;

Thibaut & Kelley, 1959). Social identity theory proposes that an individual’s membership in

social groups influence’s the individual’s sense of identity (Tajfel, 1974; Tajfel & Turner, 1986).

This is done when individuals compare the group they are in to other groups and then begin to

incorporate their group membership into their self-identity and to bond with the group to satisfy

their need to belong (Baumeister and Leary, 1995; Tajfel & Turner, 1979). The process of

identifying with a new team is enacted through a series of social exchanges with other team

members. These social exchanges then create norms within the team that influence the

emergence of team cohesion (Kozlowski & Chao, 2012). Early exchanges set the tone for later

exchanges within the group, and rewarding exchanges build team cohesion through the creation

of positive relationships. Additionally, negative exchanges (such as the display of uncivil

Page 10: “Stop! In the Name of Civility”: Testing the Effectiveness

STOP! IN THE NAME OF CIVILITY: TESTING THE EFFECT 5

behaviors) may deter future interactions, thereby precluding the development of team cohesion

(Allport, 1954; Homans, 1974).

In the absence of cohesion, teams experience divergence of cognitive and attitudinal

factors that may lead to declines in team performance (Mathieu, Kukenberger, D’Innocenzo, &

Reilly, 2015; Roberson & Colquitt, 2005). For example, if team members experience divergent

affective commitment regarding the accomplishment of team goals, then the team is less likely to

be effective at achieving those goals (Aubé & Rousseau, 2005; Klein & Kim, 1998; Pearce &

Ensley, 2004; Peralta, Lopes, Gilson, Lourenço, & Pais, 2015). From these divergent cognitive

or affective factors, cohesive subgroups (or faultlines) may appear, and members of each

subgroup may begin to use incivility to mark subgroup boundaries (Cortina et al., 2017). Such

uncivil behaviors between subgroups may then escalate to form a climate of incivility that

perpetuates the spread of these harmful behaviors (Foulk et al., 2016). Next, I shift the focus

from the effects of workplace incivility on team interpersonal processes to discuss the results of

incivility on team performance.

Team Performance and Incivility

The negative emotions and psychological states that result from experiencing incivility

can have deleterious effects on job performance and team effectiveness (Ellis, Moore, Varner, &

Ottaway, 1997; Ellis, Varner, Becker, & Ottaway, 1995; Judge, Thoresen, Bono, & Patton,

2001). First, following an incident of incivility, the target may replay the act over and over in his

or her mind to assess the legitimacy of the perpetrator’s actions and to review the potential

consequences had the target chosen an alternative response to the mistreatment (Porath,

Overbeck, & Pearson, 2008). As the employee engages in this mental exercise, cognitive

resources are depleted, thereby diminishing task performance. In addition, the employee may be

Page 11: “Stop! In the Name of Civility”: Testing the Effectiveness

STOP! IN THE NAME OF CIVILITY: TESTING THE EFFECT 6

exerting cognitive resources to plan a revenge scenario in retaliation for the perceived violation

of organizational fairness norms. Such retaliation may satisfy the target’s need to repair a

damaged identity, restore justice, or prevent future threats to his or her identity (e.g., Aquino,

Tripp, & Bies, 2001; Baumeister, Smart, & Boden, 1996; Felson, 1982; Gilligan, 1996; McLean

Parks, 1997; Tedeschi & Felson, 1994; Tripp & Bies, 1997; Tripp, Bies, & Aquino, 2002).

Furthermore, Weiss and Cropanzano’s (1996) affective events theory argues that events that

occur on the job influence behaviors through affective reactions. Of the possible work events that

could occur, negative work events are especially strong influencers of affective responses.

Additionally, affective events theory posits that “negative emotions affect performance because

they serve as signals that something in the environment is problematic” (Porath & Erez, 2007, p.

1182). Appraising the situation to identify the sources of the problem requires significant

cognitive resources and this disruption results in decreased job performance.

Experiencing incivility can negatively affect one’s mood immediately following the

incident (Barling, 1996; Cortina & Magley, 2009; Lazarus & Folkman, 1984). Research

examining the effects of mood on job performance found that overall, negative moods led to

poorer job performance than did neutral moods (Ellis et al., 1997). Individuals experiencing

negative moods also did not learn or recall knowledge as well as their neutral mood peers, and

they were not able to comprehend or use prior knowledge (Ellis et al., 1995, 1997). These effects

were more pronounced for people experiencing anger caused by provocation (Zillmann, 1979,

1983, 1988, 1993; Zillmann, Bryant, Cantor, & Day, 1975). Cognitive theories of attention state

that individuals possess finite amounts of attention and that they must selectively allocate this

supply of limited cognitive resources (Kahneman, 1973). When engaged in a task, employees

must decide whether to focus their attention on the task or off the task. Experiencing incivility

Page 12: “Stop! In the Name of Civility”: Testing the Effectiveness

STOP! IN THE NAME OF CIVILITY: TESTING THE EFFECT 7

may then pull attention off the task and direct it towards emotional processing of the event,

subsequently resulting in diminished task performance (Kanfer & Ackerman, 1989).

Not all components of job performance are compulsory. In fact, researchers hypothesize

that job performance is actually comprised of three facets: task performance, counterproductive

work behaviors, and organizational citizenship behaviors (Dalal, Lam, Weiss, Welch, & Hulin,

2009; Ng & Feldman, 2009; Rotundo & Sackett, 2002; Sackett & Lievens, 2008; Viswesvaran &

Ones, 2000). Counterproductive work behaviors (CWBs) consist of a wide range of volitional,

deviant behaviors perpetrated by an employee and directed towards either co-workers or the

organization with the intent to harm the target (Sackett, Berry, Wiemann, & Laczo, 2006;

Spector & Fox, 2002; Spector et al., 2006). Many of the antecedents and outcomes of CWBs are

similar to those of incivility (Bennett & Stamper, 2001; Dalal, 2005; Neuman & Baron, 1998;

Spector & Fox, 2005). Thus, CWBs have been theorized to belong to the same nomological

network as workplace incivility, though CWBs are a more severe form of deviant workplace

behavior which may be the result of long-term incivility occurrence (Andersson & Pearson,

1999; Aquino et al., 2001; Mao, Chang, Johnson, & Sun, 2017).

At the opposite end of the same spectrum as CWBs are organizational citizenship

behaviors (OCBs; see Dalal, 2005 for meta-analysis). OCBs are extra-role, volitional behaviors

enacted by employees that are meant to improve the functioning of the organization (Organ,

1988; Organ & Paine, 1999; Schnake, 1991). Smith, Organ, and Near (1983) reported a two

factor model of OCBs based on the target of the behaviors: an interpersonal dimension (OCB-I)

and an organizational dimension (OCB-O). Examples of an OCB-I include volunteering to help a

co-worker or sharing knowledge with a co-worker, whereas praising the organization to an

outsider is an example of an OCB-O. Antecedents of OCBs are similar to those of incivility and

Page 13: “Stop! In the Name of Civility”: Testing the Effectiveness

STOP! IN THE NAME OF CIVILITY: TESTING THE EFFECT 8

CWBs, but with positive relationships observed between job attitudes and OCBs (Dalal, 2005;

Hunter & Gerbing, 1982). Thus, an employee who is high in job satisfaction, organizational

commitment, and engagement is more likely to exhibit OCBs (Becker, 1992; Dekas, Bauer,

Welle, Kurkoski, & Sullivan, 2013; Hollinger, 1986; O’Reilly & Chatman, 1986; Organ, 1977).

Conversely, an employee who experiences incivility is less likely to display OCBs (Chen et al.,

2013; Cropanzano, Rupp, & Byrne, 2003; Pearson, Andersson, & Porath, 2000; Sliter, Sliter, &

Jex, 2012), while an employee who works in a positive work climate relatively free of incivility

is more likely to engage in OCB-I towards coworkers and members of one’s workgroup

(Mackey, Bishoff, Daniels, Hochwarter, & Ferris, 2017; Organ, Podsakoff, & Podsakoff, 2011).

Thus, OCB-I serve to strengthen interpersonal relationships among employees, and OCB-I

develop within teams when team members display behaviors that encourage OCB-I to persist

(Ehrhart & Naumann, 2004). The nature of teams is to be highly interdependent, so helping

behaviors such as OCB-I are critical determinants of team performance. In fact, organizational

citizenship behaviors have been empirically linked to both the quantity and quality of team

performance (Hu & Liden, 2015; Podsakoff, Ahearne, & MacKenzie, 1997). Additionally, team-

level OCBs predicted firm performance in longitudinal studies such that organizational profits in

year two were predicted by the presence of workgroup OCBs in year one (Koys, 2001). When

incivility occurs within a team, however, team performance plummets. For example, team

members will no longer share information critical to team success, nor will team members help

each other complete important tasks. Recent research has quantified these losses in team

effectiveness, finding that teams with uncivil team members experienced 14% fewer helping

behaviors and 9% less information sharing than other teams. These negative results of incivility

experiences were also found to hold when teams were exposed to uncivil behavior occurring

Page 14: “Stop! In the Name of Civility”: Testing the Effectiveness

STOP! IN THE NAME OF CIVILITY: TESTING THE EFFECT 9

from employees existing outside the team, with team members displaying a 15% decrease in

helping behaviors and a 10% decrease in information sharing (Porath & Erez, 2007; Porath,

Foulk, & Erez, 2015). Thus, the presence of OCB-I can strengthen team processes and improve

team performance, whereas exposure to incivility can result in detrimental effects to team

effectiveness. Once a team has become uncivil and unproductive, strong interventions will be

required to reduce incivility and return the norm to one of mutual respect (Walsh et al., 2012).

Incivility Interventions

Recent research has uncovered potential interventions for curbing workplace incivility,

many of which involve formal training interventions to enhance civil behaviors (Osatuke et al.,

2009) or reduce occurrences of workplace mistreatment (Keashly & Neuman, 2009; Kirk,

Schutte, & Hine, 2011). Work done by Kozlowski and Salas (1997), however, conclude that

formal training interventions will not be effective unless these interventions contain content that

support practices that are already in place within the organization. Thus, formal training

programs to improve workplace civility may only be effective if structural support for civility is

already in place.

Interventions designed to curb workplace incivility have focused on individuals dispersed

across multiple organizations (e.g., Kirk, Schutte, & Hine, 2011) or loosely interdependent intact

workgroups (e.g., Leiter, Day, Oore, & Spence Laschinger, 2012; Leiter, Laschinger, Day, &

Oore, 2011). Few studies to date have tested effects of civility interventions across time or across

multiple levels of an organization (Foulk et al., 2016). Coultas, Driskell, Burke, and Salas (2014)

recommend that research conducted on any team emergent state (such as team level incivility)

should include within-team changes across time and should ensure that relevant referents are

included in the measurement of the focal team emergent state.

Page 15: “Stop! In the Name of Civility”: Testing the Effectiveness

STOP! IN THE NAME OF CIVILITY: TESTING THE EFFECT 10

Leiter and colleagues (2011, 2012) tested a civility training intervention among 1,173

healthcare employees in three hospitals in Canada. This intervention was centered around

relationship strengthening activities, and these activities varied according to each hospital’s

specific needs around creating a civil workplace. Known as CREW (Civility, Respect, and

Engagement in the Workplace; Osatuke et al., 2009), this client-centered intervention

incorporated the following principles: (1) civility should be established through the use of direct

conversations on the work unit’s observed uncivil behaviors; (2) employees should be taught

new ways of interacting with one another through exercises meant to model civil behaviors; (3)

each hospital’s leadership team should provide employees with explicit support to use the

behaviors learned in the civility training workshops; and (4) each employee should be

encouraged to take ownership of her or his own civil behaviors. Underlying these principles is

the proposition that people benefit from membership in social groups that confirm each person’s

self-worth, security, and trust of others (Aquino & Thau, 2009; Baumeister & Leary, 1995;

Stevens & Fiske, 1995). Moreover, poor interpersonal relationships are theorized to persist when

employees lack the skills required to address the mistreatment with the perpetrator of the

behaviors or when they do not otherwise feel comfortable appealing to a supervisor to stop the

mistreatment (Olson-Buchanan & Boswell, 2008). Incorporating the principles from these

theoretical frameworks into a civility intervention, Leiter and colleagues (2012) found that

civility and job attitudes improved and were sustained one year following their initial

intervention. Thus, the use of an intervention to improve interpersonal relationships to reduce

incidents of workplace incivility shows tremendous empirical promise.

Summary and Hypotheses

Page 16: “Stop! In the Name of Civility”: Testing the Effectiveness

STOP! IN THE NAME OF CIVILITY: TESTING THE EFFECT 11

The intervention designed for this study, Civility Among Healthcare Professionals

(CAHP), integrates many components used in the design of the CREW intervention, including

context-specific features, which have been found to reduce workplace incivility within a

healthcare setting. Therefore, I make the following hypothesis about the efficacy of the civility

intervention used in this study:

Hypothesis 1: The CAHP workshop will be effective at increasing experiences of civility

within workgroups across time.

Besides using context-specific factors in designing the civility intervention for this study, the

CAHP intervention described interpersonal behaviors that improve social interactions among

employees, especially employees who work closely together in teams (Walsh et al., 2012).

Strong interpersonal relationships often result in greater team cohesion, and cohesion has been

meta-analytically linked to improvements in job performance (Mathieu et al., 2015). Therefore, I

predict the following relationships:

Hypothesis 2: The CAHP workshop will increase the display of team civility

experiences, which will result in an increase in team cohesion.

Hypothesis 3: The increased feelings of team cohesion will further result in more

displays of team civility experiences.

Hypothesis 4: Improvements in team cohesion that result from the CAHP intervention

will yield enhancements in team performance.

Organizational citizenship behaviors are critical components of effective organizational

functioning (see Podsakoff, Whiting, Podsakoff, & Blume, 2009 for meta-analysis). When

employees perceive that they have experienced incivility, they are less likely to engage in

organizational citizenship behaviors, especially towards co-workers (Mackey et al., in press).

Page 17: “Stop! In the Name of Civility”: Testing the Effectiveness

STOP! IN THE NAME OF CIVILITY: TESTING THE EFFECT 12

Conversely, employees who engage in organizational citizenship behaviors as a result of feeling

engaged, satisfied, and committed to their organization are more likely to exhibit civil behaviors

towards their co-workers (Dalal, 2005). Therefore, I predict the following relationships:

Hypothesis 5: The increase in team cohesion as a result of the CAHP workshop will

yield increased displays of employees’ OCB-I.

Hypothesis 6: Employees who complete the CAHP workshop will display more civil

behaviors, thereby increasing their display of OCB-I.

Workplace incivility is linked to poor work outcomes, such as declines in task performance,

creativity, and helpfulness. Incivility can also interrupt cognitive processes such as memory, and

deplete mental, emotional, and social resources that lead to a disruption of task performance

(Porath & Erez, 2007). Therefore, I predict the following about the CAHP intervention:

Hypothesis 7: The CAHP intervention will increase displays of workplace civility,

resulting in improvements in team performance.

Team contexts influence employees’ behaviors and outcomes (Ehrhart, Schneider, & Macey,

2014; Paulin & Griffin, 2017) by making salient the norms, attitudes, and expectations that are

rewarded or supported surrounding civil treatment of one’s team members (Paulin & Griffin,

2015). Recent research has found that civility interventions may be effective at changing group

norms by disrupting the norms surrounding dominant dysfunction within a workgroup and

replacing those norms with more constructive alternatives (Leiter et al., 2011). Therefore, I

propose the following relationship concerning the implementation of a civility intervention:

Hypothesis 8: The civility intervention will facilitate the creation of team civility norms

by increasing displays of civil behaviors among team members across time.

Page 18: “Stop! In the Name of Civility”: Testing the Effectiveness

STOP! IN THE NAME OF CIVILITY: TESTING THE EFFECT 13

Rewarding exchanges (including the types of behaviors learned in a civility intervention) can

build team cohesion and increase helping behaviors through the creation of positive

relationships. This team cohesion may then lead to the development of team civility norms as

civility within the team becomes predominant (Leiter et al., 2011; Paulin & Griffin, 2017) and

team civility norms may increase the displays of OCB-I. Thus, I propose the following:

Hypothesis 9: The civility intervention will be effective at increasing team cohesion for

workgroups who have completed the civility workshop, and this increase in cohesion

within the team will result in the establishment of team civility norms.

Hypothesis 10: The creation of team civility norms will result in an increase in OCB-I.

Please refer to Figure 1 for a model of these hypothesized relationships.

Method

Study Overview

Civility Among Healthcare Professionals (CAHP) was a project created to enhance

interpersonal relationships in a prison healthcare setting in a northeastern state in the United

States. Small team workshops were utilized to implement this training framed as an incivility

intervention. Employees who participated in the workshops represented 22 facilities within the

focal prison healthcare system, and they worked primarily in health, dental, or mental health

occupations. Prior to executing the civility intervention, baseline surveys were administered to

all employees from the organization to gauge the current civility climate within the system of

prison healthcare facilities. This information was then used to inform the content developed for

the CAHP workshops.

After the baseline surveys were administered, employees nominated themselves or others

to serve as workshop trainers (known as civility coaches) for each facility. Employees were

Page 19: “Stop! In the Name of Civility”: Testing the Effectiveness

STOP! IN THE NAME OF CIVILITY: TESTING THE EFFECT 14

asked to consider leadership styles and sensitivity to interpersonal treatment when making their

nominations for coaches. Each nominee was then screened to ensure that she or he had no

current or prior disciplinary action. Coaches from the organization were then trained by the

CAHP research team. During the training session, civility coaches were asked to participate in

the workshop just as if they were the regular workshop attendees. Sessions began with an

overview of the CAHP project, and coaches were provided with the materials they would need to

facilitate their own civility workshops. Coaches were then provided with time to practice

delivering the workshop. Once they had completed the train-the-trainer session, coaches began

scheduling and delivering the workshops in each of their respective facilities. Participation in the

civility workshops were made mandatory for each employee by organizational leadership,

though participation in either the pre- or post-training survey was voluntary.

CAHP Civility Workshop Data Collection

Civility Workshop Participants. Facilities were randomly assigned to complete the

civility training during one of two training waves, with 50% of employees completing training

during each wave of training. The final sample consisted of 123-288 participants measured

across four waves of data collection. Participants remained in the sample for hypothesis testing if

they completed all focal measures and were not identified as outliers. Participants were clustered

into facilities, work groups, disciplines, and shifts based on answers they provided on the pre-

training survey. Participants were predominantly female (74%), Caucasian (72%), 43-51 years of

age on average, worked primarily in medical/dental occupations (69%), worked first shift (72%),

and had an average organizational tenure of 7.69 years.

Civility Workshop Procedures. The workshops were presented in classrooms by trained

civility coaches, and they utilized multiple methods to deliver the training material (e.g., lecture,

Page 20: “Stop! In the Name of Civility”: Testing the Effectiveness

STOP! IN THE NAME OF CIVILITY: TESTING THE EFFECT 15

in-class discussions, and role playing). Each workshop was designed to last 90 minutes and

covered such topics as (1) differences between civility and incivility, (2) examples of civil and

uncivil behavior, with an emphasis on specific uncivil behaviors exhibited within the focal

organization, (3) general outcomes of uncivil work environments and specific effects of incivility

behaviors within the specific healthcare setting, (4) outline of a three-step process to respond to

uncivil treatment, and (5) information on organization-specific policies, including the

organization’s code of conduct and non-retaliation policy.

Following completion of the civility workshop, participants completed a survey assessing

team civility experiences, team civility norms, team cohesion, OCB-I, and team performance.

Additional follow-up surveys were administered such that by the end of the study, four waves of

data had been collected within the span of four years. Specifically, the baseline survey was

administered first and then 50% of the employees working for the organization participated in

the civility intervention. Then, the second survey was administered six months after the baseline

survey. Following the administration of this second survey, the remaining 50% of employees

were trained such that before the third wave of data collection, 100% of employees had received

the civility intervention. The third survey was administered six months after the second survey,

and the final survey was administered 14 months following the third survey (refer to Figure 2 for

a model depicting survey administration and the timing of the two training waves).

Measures. Upon consenting, participants were provided with questionnaires to assess

cohesion in their workgroups, job performance, and perceptions and experiences of workgroup

incivility (see the appendix for a list of specific items). Unless otherwise noted, participants

utilized a 7-point Likert-type scale to indicate their level of agreement with the item (1 =

Strongly disagree to 7 = Strongly agree).

Page 21: “Stop! In the Name of Civility”: Testing the Effectiveness

STOP! IN THE NAME OF CIVILITY: TESTING THE EFFECT 16

Workplace Incivility Scale (WIS). Cortina, Magley, Williams, and Langhout (2001)

developed an 11-item measure to assess individual experiences being the target of incivility. The

WIS was designed to capture the various forms of uncivil behavior, including those acts

perpetrated by co-workers or supervisors within the past year. Respondents used a frequency

scale ranging from “0” (Never) to “5” (Many times), with higher scores indicating higher

frequencies of incivility experiences. To aid in interpreting correlations and means, items from

this scale were reverse-coded so that higher values reflected experiences of civility at work.

Team/Work Group Cohesion. Four items were derived from the Defense Equal

Opportunity Organizational Climate Survey (DEOCS) to measure employees’ individual

perceptions of the bonds between them and the members of their work group. Sample items

included: “We work well together as a team” and “We pull together to get the job done.”

Job Performance. Employee job performance was measured before and after the civility

training workshop using two distinct scales. First, employees were asked to assume the

perspective of their supervisors and then indicated how their supervisors would rate them on

work quality, quality of interactions with co-workers, quality of interactions with patients, and

overall work performance. Utilizing this approach has been found to reduce social desirability in

self-reporting job performance, thereby increasing the accuracy and validity of employee ratings

of their own performance on the job (Conway, 2002; Schoorman & Mayer, 2008). Second,

individual employee job performance was measured using two items from a scale designed to

assess employee citizenship behaviors towards their co-workers (Williams & Anderson, 1991).

Citizenship behaviors fit into the tripartite model of job performance that includes task

performance, counterproductive work behaviors, and more organization-centered citizenship

behaviors (Dalal, Baysinger, Brummel, & LeBreton, 2012). The two items used in this study to

Page 22: “Stop! In the Name of Civility”: Testing the Effectiveness

STOP! IN THE NAME OF CIVILITY: TESTING THE EFFECT 17

assess interpersonal citizenship behaviors were: (1) “I take a personal interest in the well-being

of others (e.g., help new employees),” and (2) “I pass along work-related information to others.”

Civility Norms Questionnaire-Brief (CNQ-B). The CNQ-B was developed by Walsh and

colleagues (2008, 2012) as a four item measure meant to assess workgroup climate for civility.

Civility climate encompasses employee perceptions that the norms of the workgroup support

respectful treatment of one another. This measure was initially developed as a seven item

measure during the baseline survey administration in the current study, and the original seven

items were retained in subsequent waves of data collection to maintain survey consistency.

Sample items used to assess employee perceptions of civility norms include: (1) “Rude behavior

is not accepted by your coworkers,” (2) “Angry outbursts are not tolerated by anyone in your

unit/workgroup,” (3) “Respectful treatment is the norm in your unit/workgroup,” and (4) “Your

coworkers make sure everyone in your unit/workgroup is treated with respect.” CNQ-B items are

all worded positively, so higher scores on this measure indicate a more positive climate for

civility.

Results

Data Preparation and Aggregation

Missing data occurred at the item level such that respondents would skip particular

questions on each construct, but ultimately answered enough questions (more than 50%) to

compute a scale score. Thus, following the advice of Newman (2014), I calculated scale scores

for individuals with missing item responses, and substituted scale scores (means of the items for

each scale) for the missing values. This method of dealing with missing data is effective for

scales that have high values for Cronbach’s alpha (Graham, 2009; Newman, 2009), such as the

Page 23: “Stop! In the Name of Civility”: Testing the Effectiveness

STOP! IN THE NAME OF CIVILITY: TESTING THE EFFECT 18

scales used to measure the focal constructs of this study (refer to Table 2 for reliability estimates

and agreement indices for each scale at the individual and team level across time).

Data were aggregated to the workgroup level (workgroup n = 23-38) for each of the four

waves of data collected. A workgroup was defined as containing a minimum of two employees

who likely shared similar perceptions of the workplace. These shared perceptions were based on

the quality of their social interactions as typified by their shared focus on providing health care to

prisoners. Workgroups were further defined as containing a minimum of two employees since

dyads are sufficient for interpersonal phenomena to emerge (Kozlowski & Ilgen, 2006).

Following recommendations from Mathieu and Chen (2011), additional information beyond

structural factors was also collected to aid in the assignment of employees to workgroups. For

example, qualitative information was collected during employee focus group meetings which

provided insight into how employees interacted in a typical workday. Additionally, members of

the research team visited prison sites to observe employee interactions. During this process, the

research team found that employee interactions varied as a function of facility size, time of day

(since more arrests occurred during the evening than during the day), and the nature of the work

(i.e., patient care versus clerical work). Thus, employees were assigned to the same workgroup if

they: (1) were employed in the same primary facility, (2) worked the same shift, and (3) worked

in similar disciplines. Employees who worked in either medical or dental occupations were

grouped together as similar disciplines. Mental health occupations were grouped with medical

and dental occupations if there was only one employee in this role within the facility; otherwise,

mental health occupations were grouped into their own workgroups. Employees who identified

their discipline as “clerical” or “other” were split by shift (i.e., first, second, or third shift), rather

than by discipline, such as at smaller facilities, or were asked which healthcare discipline they

Page 24: “Stop! In the Name of Civility”: Testing the Effectiveness

STOP! IN THE NAME OF CIVILITY: TESTING THE EFFECT 19

most regularly interacted with so as to be assigned to an appropriate workgroup. This

aggregation to the workgroup level was necessary because individual employee responses to the

surveys could not be tracked across the four waves of data collection. The baseline survey asked

employees to include employee IDs to track participants across time, but response rates were

negatively impacted when respondents were asked to provide this information. Thus, the

research team felt that improved response rates for subsequent time points justified not being

able to track individuals across time. Furthermore, the constructs of interest (e.g., team cohesion,

team civility experiences, team civility norms, OCB-I, and team job performance) are

conceptualized at the workgroup level of analysis. Please refer to Table 1 for employee

composition by discipline and work shift across time by Training Wave.

Participants’ responses to each of the measures were thus aggregated using grand mean

and group-centered mean indices. Reliability indices (ICC1, ICC2) and within-group agreement

indices for multiple items (rWG(J)) were calculated to establish whether this aggregation was

statistically warranted.1 Use of these indices follows the suggestion of Coultas, Driskell, Burke,

and Salas (2014) to aggregate team emergent states unless studying unconnected groups of

people who do not engage in shared collective tasks (such as passengers on public transportation

or neighbors in a neighborhood). LeBreton and Senter (2008) also assert that before a construct

can be aggregated to a higher level construct, researchers must first demonstrate that individuals

at the lower level are in agreement with one another and that measures show consistency across

judges. Agreement and reliability indices were calculated using the tool for computing IRA and

IRR estimates (version 1.5) developed for Microsoft Excel by Biemann, Cole, and Voelpel

(2012), and intraclass correlations (ICC1 and ICC2) were calculated using SPSS (IBM Corp,

2017).

Page 25: “Stop! In the Name of Civility”: Testing the Effectiveness

STOP! IN THE NAME OF CIVILITY: TESTING THE EFFECT 20

The necessary first step in calculating within-group agreement (rWG(J)) is to calculate the

expected variance of a specified null distribution which shows a total lack of agreement among

raters. In the past, researchers have opted for uniform (rectangular) distributions that show an

equal likelihood of each response being selected for each item. Using this null distribution

implies that there is no expected response bias and that it is theoretically appropriate to use the

same value for the expected variance in the denominator of the equation for calculating within-

group agreement. Because the uniform distribution has been found to produce inflated values for

rWG(J) (as it results in larger estimates of error variance), it creates an upper-bound estimate of

rWG(J). Thus, researchers have recommended using “a small but inclusive set of null distributions

when computing rWG(J)-based indices” (Biemann et al., 2012, p. 72; James, Demaree, & Wolf,

1984; LeBreton & Senter, 2008). These null distributions should come from previous research,

or in the absence of previous data, should come from similar construct domains (James et al.,

1984). Information regarding the shape of the distribution of each construct in the current study

thus came from the papers which outline the creation of the instrument, as well as from

additional studies which used the instrument (where available). For example, Cortina et al.

(2001) described the distribution of the Workplace Incivility Scale (WIS) as being skewed for

both men and women (Women: Mean = 5.27, SD = 5.57, Men: Mean = 4.16, SD = 5.18), and

Walsh et al. (2008, 2012) described the distribution of the Civility Norms Questionnaire as being

negatively skewed (Mean = 4.77, SD = 1.25). Thus, within-group agreement was calculated

using a slightly skewed null distribution as a lower-bound estimate and with a uniform

(rectangular) null distribution as an upper-bound estimate. The true amount of within-group

agreement, then, can be found to reside somewhere within this range (Biemann et al., 2012).

Researchers then suggest considering within-group agreement in terms of: “lack of agreement” =

Page 26: “Stop! In the Name of Civility”: Testing the Effectiveness

STOP! IN THE NAME OF CIVILITY: TESTING THE EFFECT 21

.00 to .30, “weak agreement” = .31 to .50, “moderate agreement” = .51 to .70, “strong

agreement” = .71 to .90, and “very strong agreement” = .91 to 1.00 (Biemann et al., 2012;

LeBreton & Senter, 2008). Although team civility norms showed weak to moderate agreement at

Time 2 (rWG(7) = 0.49), the range of mean rWG(J) values for the remaining constructs demonstrated

moderate to strong agreement across the four time points for even the lower-bound mean

estimate when comparing it to the slightly skewed null distribution (range of rWG(J) = 0.54 -

0.90).

Along with calculating values for rWG(J) to determine consensus among team members, I

also calculated intraclass correlations (ICC) which provide information about both interrater

agreement and interrater reliability (LeBreton, Burgess, Kaiser, Atchley, & James, 2003;

LeBreton & Senter, 2008). Two measures of ICC exist for multilevel analysis based on one-way

random effects ANOVA (ICC1 and ICC2), and each of these are a measure of absolute

consensus that function technically as both absolute rater consensus and relative rater

consistency. Thus, ICCs may be interpreted as “the proportion of observed variance in ratings

that is due to systematic between-target differences compared to the total variance in ratings”

(LeBreton & Senter, 2008, p. 822). ICCs, then, provide further evidence for determining whether

aggregation from the individual level to the team level is warranted. Because ICC(1) is a

measure of effect size, typical conventions following interpretation of effect sizes is followed.

Thus, a value of ICC(1) < .10 would represent a small effect, an ICC(1) between .10 and .25

represent a medium effect, and an ICC(1) > .25 might be considered a moderate-to-large effect

(Murphy & Myors, 1998, p. 47). ICC(2) is a measure of team-level agreement and reliability and

so there will be a larger number of judges and targets factored into its computational equation

(LeBreton & Senter, 2008). This indicates that values of ICC(2) will typically be larger than

Page 27: “Stop! In the Name of Civility”: Testing the Effectiveness

STOP! IN THE NAME OF CIVILITY: TESTING THE EFFECT 22

those values of ICC(1). Although convention dictates using .70 as the cutoff for the minimum

acceptable level of reliability (Nunally, 1978), Lance, Butts, and Michels (2006) assert that many

researchers utilize this cutoff blindly and without considering the appropriateness of this value.

What is critical to keep in mind when interpreting these values is that a lower value for ICC(1)

provide the ability to detect Level 1 direct effects, whereas higher values for ICC(1) or ICC(2)

support the power to detect cross-level direct effects (Raudenbush & Liu, 2000). Using the

output from conducting one-way analyses of variance (ANOVA) in SPSS (IBM Corp. 2017), I

used the between- and within-subjects variance to calculate ICC(1) and ICC(2) values for each of

the study’s variables across all four time points (Bliese, 2000). Values for ICC(1) show a range

of -0.04-0.19 across all variables, and values for ICC(2) show a range of -0.12-0.55 across all

constructs. Together, these indices provide statistical support for aggregating the focal constructs

of this study (see Table 2 for values of rWG(J), ICC(1), and ICC(2) estimates by workgroup across

each time point).

Between-Profile Differences

Facilities were randomly assigned to complete training at one of two time points

(between Time 1 & Time 2 surveys, or between Time 2 & Time 3 surveys). Because of this,

comparison groups are available to compare effects of the training between groups when half of

the employees had received training and the other half had not (Time 2). A profile analysis to

compare the effects of receiving or not receiving the civility intervention on team civility

experiences, team cohesion, interpersonal citizenship behaviors (OCB-I), team job performance,

and team civility norms was conducted using SPSS Version 25.0 software (IBM Corp. 2017).

Profile analysis is a special type of multivariate approach to repeated measures analysis of

variance (ANOVA) in which the goal is to determine whether between-profile differences exist

Page 28: “Stop! In the Name of Civility”: Testing the Effectiveness

STOP! IN THE NAME OF CIVILITY: TESTING THE EFFECT 23

among multiple dependent variables collected at the same time (Schmit, Watson, & Schmit,

2018; Tabachnick & Fidell, 2013). A profile depicts performance on scales or other measures

and describes their shape and pattern. Profiles can be used to summarize means, variance, and

relationships among dependent variables for groups and to outline the strengths and weaknesses

of an intervention based on the constructs being measured (Watkins, Glutting, & Youngstrom,

2005). When conducting a profile analysis, a researcher is testing three distinct null hypotheses.

First, the researcher is testing parallelism, or whether the profile pattern and shape will be

similar and symmetrical between groups. Next, the researcher is testing level, or the degree of

similarity in grand means of scores across all the dependent variables across all groups. Third,

the researcher is testing the null hypothesis of flatness, in which scores in a specific profile will

be similar to one another (Tabachnick & Fidell, 2013). Profile plots are generated by SPSS to

allow the researcher to more explicitly view the profile pattern and shape.

First, to prepare the data for profile analysis, I assigned a dummy code to workgroups,

with “1” indicating those facilities which participated in the first wave of training, and “2” for

those facilities having completed the training during the second wave. Data were arranged such

that each of the five constructs (team civility experiences, team civility norms, team cohesion,

interpersonal citizenship behaviors, and team job performance) across each of the four time

points served as the within-subjects factor and Training Wave (dummy coded as “1” or “2”) was

entered as the between-subjects factor. Tables 3 and 4 show the descriptive statistics for each

within-subject factor by Training Wave. The results of the multivariate tests for within-subject

factors were statistically significant for each of the five constructs, F(15, 44) = 2.57, p < .05,

partial 2 = .47. These results indicate that the null hypothesis of profile flatness can be rejected

and that there is a within-group main effect such that scores within each profile are different and

Page 29: “Stop! In the Name of Civility”: Testing the Effectiveness

STOP! IN THE NAME OF CIVILITY: TESTING THE EFFECT 24

change across time. Additionally, the results of the tests of between-subject factors (Training

Wave) were statistically significant, F(5, 54) = 2.81, p < .05, partial 2 = .21. This finding points

to a rejection of the null hypothesis of level and that there is a between-subject main effect such

that the effect of the civility intervention across the four time points is based on whether

workgroups received the civility training at Training Wave 1 or Training Wave 2. Taken

together, the change in scores is likely due to the different timespans between completion of the

intervention and when the scores were subsequently assessed for each of the groups. This

indicates that there may be predictable patterns of within-group behaviors and attitudes at

specific time points for employees who participate in a civility intervention. The result of the

analysis of the between-subjects factor thereby provides support for the appropriateness of

modeling each Training Wave as a distinct sample using two different datasets (Williams &

Kibowski, 2016). Finally, a multivariate test of the interaction between the within-subject factors

(the five focal constructs) and the between-subjects factor (Training Wave) was not statistically

significant, thereby supporting the null hypothesis of parallelism which states that the profile

pattern and shape will be similar and symmetrical between groups, F(15, 44) = 1.72, p > .05,

partial 2 = .37. Thus, scores for each of the five focal constructs for each group changed in the

same direction across time and at the same relative magnitude. Figures 3-7 feature profile plots

for the results of each of the five focal constructs across time for each Training Wave.

Review of each profile plot shows general changes in each construct in predictable

directions demonstrating overall efficacy of the civility intervention. Surprisingly, employee

scores on team civility experiences (CIV), team civility norms (CNQ), team cohesion (COH),

and team job performance (PERF) demonstrated noticeable differences between each Training

Wave at Time 1 before the civility intervention had been delivered. There was evidence of

Page 30: “Stop! In the Name of Civility”: Testing the Effectiveness

STOP! IN THE NAME OF CIVILITY: TESTING THE EFFECT 25

within- and between-group agreement on these measures at Time 1, and reliability estimates

were high ( > .70) for each scale (refer to Table 2). Thus, it is likely that outliers affected mean

scores of these measures for one or both Training Waves.

The profile plots also show that decay was present for two of the five focal constructs and

that the other three constructs continued to show marked improvement across time. Experiences

of civility showed decay for Training Wave 1 at Time 2 of survey administration, which was the

time point immediately following delivery of the civility intervention for Training Wave 1. The

likely explanation for this decay is that employees were not aware that behaviors occurring in

their organization constituted incivility until after learning the characteristics of uncivil treatment

during the training workshop. This new knowledge of what constitutes uncivil behavior may

have then led employees to become more accurate at perceiving the incident rates of

mistreatment in their workgroups, resulting in a decline of employee ratings of team civility

experiences. Employees who received the civility training during Training Wave 2 also showed

slight declines in scores on CIV at Time 3, which immediately follows the point at which they

received the civility intervention. Both Training Waves demonstrated strong decay in scores on

CIV between Time 3 and Time 4. Employee scores on CNQ, however, continued to increase

across Times 2, 3, and 4, and this may indicate that experiences of civility might begin to show

signs of increase had the survey been administered to employees at time points beyond Time 4.

Team cohesion also showed decay across time, but this outcome was only observed for Training

Wave 1 and it occurred between Time 2 and Time 3, but scores on cohesion improved between

Time 1 and Time 4. Finally, each plot shows that each Training Wave had similar scores on most

measures at Time 4, and many of these scores were in the predicted direction which shows

potential for the efficacy of the civility intervention. One notable exception to this finding was in

Page 31: “Stop! In the Name of Civility”: Testing the Effectiveness

STOP! IN THE NAME OF CIVILITY: TESTING THE EFFECT 26

the differences in observed scores at Time 4 on team job performance, but teams in both

Training Waves ended with higher scores on this metric than when the study began. Because

workgroups varied in the amount of agreement for each construct, profile analysis of standard

deviations was also conducted, but results did not meaningfully differ from those results found

when conducting profile analyses using means.

Hypothesis Testing

I tested hypotheses with a series of autoregressive structural equation models (SEM)

using Mplus 8.0 software (Muthén & Muthén, 2017; the table of bivariate correlations used for

these analyses can be found in Tables 3 and 4). Each of the following described analyses were

conducted separately for each Training Wave (Training Wave 1 n = 156, Training Wave 2 n =

132). First, I set up a model to assess stability of the constructs over time. This model included

autoregressive paths of each variable at Time 1 regressed on themselves at Times 2-4 (Dicke,

Stebner, Linninger, Kunter, & Leutner, 2018; McCoach, 2018). In addition, all variables were

allowed to correlate with one another, and error variances for each construct were set to be equal

to one another. Constraining error variances to be equal to one another is crucial to making

autoregressive models identified so that the parameters can be uniquely estimated (Kenny &

Milan, 2012; McCoach, 2018). Disturbances in the model were constrained to be equal because

disturbances represent random shocks to the system that can have similar effects across the

model at all time points (Biesanz, 2012; McCoach, 2018). Numerous model fit indices are

reported for the baseline and subsequent autoregressive models, including the value for 2 , the

Comparative Fit Index (CFI; Bentler, 1990), the Tucker-Lewis Index (TLI), the Root Mean

Square Error of Approximation (RMSEA), and the Standardized Root Mean Square Residual

(SRMR). Many of these fit indices describe incremental fit of the model, and if certain fit

Page 32: “Stop! In the Name of Civility”: Testing the Effectiveness

Running Head: STOP! IN THE NAME OF CIVILITY: TESTING THE EFFECTIVENESS

27

thresholds are met, respecification of the structural model is not necessary. For CFI and TLI,

values of .90 or higher indicate satisfactory fit, whereas values greater than .95 represent

excellent model fit (Hu & Bentler, 1999; McDonald & Marsh, 1990). Values of RMSEA .05

signify good model fit, and RMSEA values between .05 and .08 show adequate fit (Browne &

Cudeck, 1993). Confidence intervals are typically reported for RMSEA values, and if the lower

bound value of the 95% confidence interval includes or is near zero and the upper bound value is

less than 0.10, the RMSEA value can be determined to appropriately represent model fit

(McCoach, 2018). The SRMR value is the standardized difference between the observed and

predicted covariance matrix, and this value is an absolute fit index in which perfect model fit

yields values of zero. SRMR < .08 implies adequate model fit (Browne & Cudeck, 1989;

McCoach, 2018). Reporting these multiple fit indices follows the advice of researchers (e.g., Hu

& Bentler, 1999; McCoach, 2018) to use combined cutoffs to better assess specification of

models under various conditions (i.e., when sample size is large, degrees of freedom are low, or

the model is estimating a large number of parameters).

Initial model fit for the baseline stability model for each Training Wave was poor,

Training Wave 1: 2 = 189.92, df = 140, p < .01, CFI = 0.87, TLI = 0.82 , RMSEA = 0.05, 90%

confidence interval = 0.029-0.064, p > .05, SRMR = 0.12, Training Wave 2: 2 = 196.14,

df = 140, p < .01, CFI = 0.85, TLI = 0.81, RMSEA = 0.06, 90% confidence interval = 0.035-

0.073, p > .05, SRMR = 0.14. These fit indices indicate a lack of stability of each construct and

point to measurement non-invariance across the four waves of data collection. Trimming the

paths that were not significant and conducting a chi-square goodness of fit test yielded a slightly

better fitting model, though stability was still poor: Training Wave 1: 2 = 214.13, df = 169,

p < .05, CFI = 0.88, TLI = 0.86, RMSEA = 0.04, 90% confidence interval = 0.021-0.057,

Page 33: “Stop! In the Name of Civility”: Testing the Effectiveness

STOP! IN THE NAME OF CIVILITY: TESTING THE EFFECTIVENESS 28

p > .05, SRMR = 0.13, Training Wave 2: 2 = 222.52, df = 167, p < .01, CFI = 0.86, TLI = 0.84,

RMSEA = 0.05, 90% confidence interval = 0.031-0.067, p > .05, SRMR = 0.14.

The source of measurement invariance and low values for CFI and TLI for the baseline

model and for the model with trimmed paths is likely due to the weak correlations among the

measures across the four waves. The pattern of the baseline model used to test measurement

invariance follows a simplex pattern such that repeated measures of each of the five variables are

expressed as a function of their preceding value plus random disturbance. Put differently, true

scores operate as a function of prior values, and true scores which are temporally adjacent to one

another are more similar to each other than they are to other, more remote true scores. Random

change within the true score is also introduced at each subsequent time point. This means that

autoregressive models will eventually yield correlations close to zero between the first and last

time point, if the construct is measured long enough (McCoach, 2018). For the current study, it

would make sense to find small correlations at later time points, but the measurement non-

invariance is most likely the result of small correlations occurring across all time points.

Regardless of whether each training wave was analyzed separately or together, correlations at

Time 1 should have been high, given that no employees had yet received the civility

intervention. What was found, instead, was that correlations remained low across all time points

even when employees were separated by Training Wave. Typically, results of measurement non-

invariance would indicate that subsequent tests of measurement invariance using nested models

cannot be completed and would require reevaluation of the factor structure, the indicators, or

how the theoretical constructs are being operationalized (Edwards & Wirth, 2009, 2012).

Reviewing the reliability estimates of each measure across time, however, pointed to highly

reliable measures that function the same across time and across groups and that the items on each

Page 34: “Stop! In the Name of Civility”: Testing the Effectiveness

STOP! IN THE NAME OF CIVILITY: TESTING THE EFFECTIVENESS 29

of the scales fit well together (Bliese, Maltarich, Hendricks, Hofmann, & Adler, 2018; Cortina,

1993; LeBreton & Senter, 2008). Thus, additional models analyzing direct effects of the

constructs can still be run despite the finding of measurement non-invariance (J. Mathieu,

personal communication, March 4, 2019).

To determine whether levels of team civility experiences (CIV) changed over time

(Hypothesis 1), I started with the trimmed paths baseline model of stability and then regressed

scores of CIV at Time 1 on Time 2. I then added cross-lagged paths from Time 2 to Time 3 and

then from Time 3 to Time 4. For Training Wave 1, the path from Time 1 to Time 2 was

statistically significant, but none of the other paths were statistically significant, Time 1 on Time

2: = -0.25, S. E. = 0.11, p < .05, Time 2 on Time 3: = 0.06, S. E. = 0.12, p > .05, and Time 3

on Time 4: = -0.01, S. E. = 0.15, p > .05. For Training Wave 2, none of the cross-lagged paths

of CIV were statistically significant, Time 1 on Time 2: = -0.12, S. E. = 0.12, p > .05, Time 2

on Time 3: = 0.004, S. E. = 0.13, p > .05, and Time 3 on Time 4: = -0.19, S. E. = 0.17,

p > .05 (see Table 5 for the results of hypothesis testing for Training Wave 1, and refer to Table

6 for the Training Wave 2 results). Overall, these results do not lend support for Hypothesis 1,

and the CAHP intervention did not lead to meaningful changes in the amount of civility

employees experienced over time.

Next, I tested the hypothesized reciprocal relationship between team cohesion (COH) and

CIV (Hypotheses 2 and 3) by regressing COH at Time 1 on CIV at Time 2, COH at Time 2 on

CIV at Time 3, and COH at Time 3 on CIV at Time 4. I then tested the reverse cross-lagged

paths of CIV on COH at each subsequent time point. For Training Wave 1, the only statistically

significant path was from COH at Time 3 on CIV at Time 4, = 0.28, S. E. = 0.11, p < .01. The

path from CIV at Time 3 to COH at Time 4 was statistically significant for Training Wave 2, =

Page 35: “Stop! In the Name of Civility”: Testing the Effectiveness

STOP! IN THE NAME OF CIVILITY: TESTING THE EFFECTIVENESS 30

-0.61, S. E. = 0.15, p < .01, but no additional paths were significant. These results, then, provide

partial support for Hypotheses 2 and 3 and indicate that the reciprocal relationship between CIV

and COH may take time to develop as employees become accustomed to observing and

experiencing civil behaviors and the positive social exchanges that result in feelings of cohesion.

I then added cross-lagged paths for testing Hypothesis 4 which predicted that improved COH as

a result of the civility intervention would positively impact team performance (PERF). None of

the cross-lagged paths between COH and PERF were statistically significant for either Training

Wave, so Hypothesis 4 was rejected. Hypothesis 5 predicted that improvements in COH would

result in a greater number of displays of interpersonal citizenship behaviors (OCB-I). None of

the paths from COH to OCB-I were statistically significant for Training Wave 1, but the cross-

lagged path from COH at Time 3 to OCB-I at Time 4 was significant for Training Wave 2,

= -0.37, S. E. = 0.14, p < .01. The significant relationship between COH at Time 3 and OCB-I

at Time 4 was not in the hypothesized positive direction, so Hypothesis 5 was rejected. The

magnitude of the relationship between COH and OCB-I was strengthened during the span of the

study, indicating a potential need to measure this relationship at more time points than was

included in this study.

I then tested Hypothesis 6, which predicted that an increase in CIV would result in an

increase in OCB-I. None of the cross-lagged paths were statistically significant for Training

Wave 1, but the path from CIV at Time 3 to OCB-I at Time 4 was significant for Training Wave

2, = 0.30, S. E. = 0.12, p < .05. Because this statistically significant path was in the

hypothesized direction, partial support was found for Hypothesis 6. Thus, there is some evidence

that a civility intervention can improve OCB-I across time. Next, I tested the cross-lagged paths

of earlier scores on CIV on later scores of PERF (Hypothesis 7), and there were mixed results for

Page 36: “Stop! In the Name of Civility”: Testing the Effectiveness

STOP! IN THE NAME OF CIVILITY: TESTING THE EFFECTIVENESS 31

each Training Wave such that for Training Wave 1, the path was significant from CIV at Time 2

to PERF at Time 3, = 0.35, S. E. = 0.10, p < .01, and for Training Wave 2 the cross-lagged

path was significant from CIV at Time 1 to PERF at Time 2, = -0.22, S. E. = 0.11, p < .05, and

from CIV at Time 2 to PERF at Time 3, = -0.22, S. E. = 0.11, p < .05. The hypothesized

relationship between CIV and PERF was both positive and negative, and thus partial support for

Hypothesis 7 was found. It appears that the declines in perceptions of employee civility that

accompanied increased awareness in the types of behaviors that constitute incivility may have

had a greater negative impact for teams in Training Wave 2. The positive effect of increased CIV

on PERF for teams in Training Wave 1 occurred later than the observed effects between these

variables for teams in Training Wave 2, which provides additional support for the need to

measure these constructs at times beyond the times used in this study. Finally, Hypotheses 8, 9,

and 10 predicted positive cross-lagged relationships between CIV and team civility norms

(CNQ), COH and CNQ, and CNQ and OCB-I respectively. None of these paths were statistically

significant for either Training Wave, thereby resulting in a rejection of Hypotheses 8, 9, and 10.

Supplemental Analyses

Incivility and other forms of workplace mistreatment have been empirically tied to

gender in healthcare settings such that women tend to be the targets and perpetrators of uncivil

behaviors at higher rates than their male colleagues (Bartholomew, 2006; Bray, 2001; Farrell,

2001; Kivimaki, Elovainio, & Vathera, 2000; Wilkins, 2014). For this reason, supplemental

analyses were conducted to examine the effects of gender in the present study. First, gender

composition in workgroups was assessed to determine the number of women in each workgroup

across all 22 facilities. Results of these analyses found that women were the simple majority in

most workgroups across all four time points (Time 1 = 76% of workgroups, Time 2 = 77% of

Page 37: “Stop! In the Name of Civility”: Testing the Effectiveness

STOP! IN THE NAME OF CIVILITY: TESTING THE EFFECTIVENESS 32

workgroups, Time 3 = 83% of workgroups, and Time 4 = 65% of workgroups). Next, I

conducted a profile analysis to test for between- and within-subject differences by gender across

the four waves of data collection. Results of the multivariate tests for within-subject factors were

not statistically significant by gender for each of the five constructs across the four time points,

F(15, 44) = 1.58, p > .05, partial 2 = .35. These results indicate that the null hypothesis of

profile flatness can be accepted and that there is not a within-groups main effect by gender.

Additionally, the results of the tests of between-subject factors (gender) were also not

statistically significant, F(5, 54) = 1.45, p > .05, partial 2 = .12. This finding points to an

acceptance of the null hypothesis of level and that there is no between-subject main effect of

gender. Next, a multivariate test of the interaction between the within-subject factors (the five

focal constructs) and the between-subject factor (gender) was not statistically significant, thereby

supporting the null hypothesis of parallelism which states that the profile pattern and shape will

be similar and symmetrical between groups, F(15, 44) = 1.55, p > .05, partial 2 = .35. Finally,

because significant main effects were observed within-subjects and between-subjects when

profile analysis was used to compare scores by Training Wave, additional analyses were

conducted for gender within Training Wave 1 and Training Wave 2. Of the employees who

received the civility intervention during Training Wave 1, the within-subject factors were not

statistically significant by gender for each of the five constructs across the four time points, F(15,

14) = 1.55, p > .05, partial 2 = .62. In addition, the results of the tests of between-subject factors

(gender) were also not statistically significant, F(5, 24) = 0.82, p > .05, partial 2 = .15, nor were

the tests of the interactions between the within-subject factor (focal constructs) and the between-

subject factor (gender), F(15, 14) = 1.41, p > .05, partial 2 = .60. Profile analysis could not be

run to compare gender profiles for Training Wave 2 because assumptions of normality and

Page 38: “Stop! In the Name of Civility”: Testing the Effectiveness

STOP! IN THE NAME OF CIVILITY: TESTING THE EFFECTIVENESS 33

assumptions of sphericity could not be met (O’Brien & Kaiser, 1985). Standard tests for

correction such as the Greenhouse-Geisser or Huynh-Feldt were conducted, but critical values

for these tests which would indicate continuing with further analyses could not be reached (Field,

2013; Howell, 2002). Refer to Figures 8-12 for profile plots depicting scores on each construct

by gender for Training Wave 1.

Discussion

The current study was conducted to determine the effectiveness of a training intervention

to reduce workplace incivility among workgroups in a prison healthcare system. By improving

civility among workgroups, the research team hoped to increase feelings of cohesion within

workgroups which would ultimately result in more frequent displays of OCB-I, create norms for

mutual respect, and result in overall improvements in team-level job performance. This study did

not find support for previous research examining the effectiveness of an intervention to reduce

workplace incivility (Leiter et al., 2011, 2012; Osatuke et al., 2009). Namely, results of this study

demonstrated that client-focused civility interventions may not be successful at improving

employee relationships across time in all contexts. Although there was observed improvement

between Time 1 and Time 2 in experiences of civility for those teams who received the civility

training during Training Wave 1, no additional improvements in experiences of civility were

found during the course of this study. There were noticeable effects on additional team outcomes

as a result of the civility training, however, and effects were present to support the relationship

between team civility experiences and team cohesion. Additionally, there was a moderate,

negative relationship between team cohesion and OCB-I and both positive and negative

relationships were observed between team civility experiences and team performance. Other

notable, yet non-significant, outcomes of the civility intervention were that norms for civility

Page 39: “Stop! In the Name of Civility”: Testing the Effectiveness

STOP! IN THE NAME OF CIVILITY: TESTING THE EFFECTIVENESS 34

were strengthened across time and the amount of OCB-I perceived by employees were increased

by the final time point of the study.

Results of the analyses of the intervention’s effects on proximal and distal outcomes were

thus mixed, and this study provides some evidence that the intervention increased team

members’ feelings of team cohesion and that this change may be the mechanism which accounts

for the enhanced norm for civility that emerged following the intervention. When employees

experience positive social exchanges with other members of their team (such as experiencing

civil behavior from their coworkers), team cohesion is built and enhanced through the creation of

positive relationships (Allport, 1954; Homans, 1974). Research on norm formation has proposed

that these early respectful relationships can then form the basis for expectations among team

members for future interactions. If left unchallenged, respect develops as the norm within the

group and subsequent intentions to challenge the norm, such as engaging in uncivil behavior,

will be ignored or sanctioned (Bettenhausen & Murnighan, 1991; Walsh et al., 2012). Numerous

studies point to the ability for affective states present within a team to spread through social or

emotional contagion processes and to have lasting effects on macro-level organizational

processes (Dasborough, Ashkanasy, Tee, & Tse, 2009; Harvey, Treadway, & Heames, 2007;

Tee, 2015). The findings of this body of research underscore the need for organizations to invest

resources to improve team affective states since these can ostensibly influence organizational

outcomes.

Although the team emergent states of cohesion and norms for civility were found to

improve as the result of the present study, team job performance and OCB-I were not impacted

by the civility intervention consistently across time. This is most likely due to a ceiling effect of

scores on these measures that allowed for only marginal improvements in these scores. A robust

Page 40: “Stop! In the Name of Civility”: Testing the Effectiveness

STOP! IN THE NAME OF CIVILITY: TESTING THE EFFECTIVENESS 35

body of organizational psychology literature points to the leniency bias inherent in self-report

measures of socially desirable traits, such as engaging in helping behaviors (OCB-I) or

performing well in one’s job (e.g., Farh & Dobbins, 1989; Kwan, John, Robins, & Kuang, 2008;

Robins & Paulhus, 2001; Wayne & Liden, 1995), and this tendency toward self-enhancement has

been found to be culturally universal (Ng, Koh, Ang, Kennedy, & Chan, 2011; Xie, Roy, &

Chen, 2006). This is especially true in work settings where negative consequences such as not

receiving a promotion or losing one’s job may occur for owning up to negative behaviors or poor

performance. As outlined in the next section, additional methods can be employed in future

research to alleviate the potential for participant self-enhancement bias.

Limitations and Future Research

Interpretation of the effectiveness of the intervention to improve workplace civility may

be affected by the study’s limitations. First, participant responses could not be tracked at the

individual level of analysis across the four waves of data collection. This resulted in an inability

to determine if the large amount of participant attrition evident in this study was due to random

or systematic influences. Determining the cause of attrition is crucial when deciding how to cope

with missing data as it dictates which missing data technique to employ (i.e., pairwise deletion,

single imputation, or maximum likelihood; Newman, 2014). For the present study, employees

may have left the organization between waves, new employees may have been hired, or

employees may have been moved to different workgroups to respond to changes in

organizational needs. Thus, it cannot be ruled out that a different sample of participants

completed the survey at each time point, and this fact may have contributed to the difficulty in

finding the predicted changes in the focal constructs across time. Future research will need to

ensure that individual employees can be tracked across multiple time points. One widely used

Page 41: “Stop! In the Name of Civility”: Testing the Effectiveness

STOP! IN THE NAME OF CIVILITY: TESTING THE EFFECTIVENESS 36

method for tracking individual survey responses is to assign identification codes to participants.

Self-generated identification codes have been found to be especially useful, albeit imperfect, at

securing respondent anonymity, reducing social desirability bias, and tracking respondents across

multi-wave studies (Schnell, Bachteler, & Reiher, 2010). Newman (2014), however, warns of

using participant identification keys to increase participant response rates as they may threaten

participant confidentiality, and participant identification codes have a relatively small impact on

improving survey response rates (r = .18). Therefore, future research can seek to ascertain more

effective means of tracking individual response rates across time. Furthermore, the ability to

track individuals across time would have allowed for individual-level variables associated with

civility (i.e., job satisfaction, engagement, burnout, commitment, additional demographic

characteristics, etc.) to be studied to determine whether the civility intervention impacted these

constructs as well.

Next, evaluating the effectiveness of interventions to improve civility among employees

may require more time than was used in this study. Many of the effects observed following the

intervention occurred more than one year following delivery of the civility training. Based on the

trajectory of these constructs, it may be that they continued to improve after this study

concluded. Indeed, research examining the efficacy of training interventions have noted the

importance of conceptualizing time appropriately for the constructs being measured (e.g., Bollen

& Curran, 2006; Ilies, Scott, & Judge, 2006; Ployhart & Vandenberg, 2010; Singer & Willett,

2003; Vancouver, Thompson, & Williams, 2001). Appropriate conceptualization includes using

prior theories of the nature of the change of the focal construct(s) to determine the number and

spacing of repeated measures (Ployhart & Vandenberg, 2010). Besides improving reliability,

statistical power, and explanatory power, repeated measures designs and models of trajectory

Page 42: “Stop! In the Name of Civility”: Testing the Effectiveness

STOP! IN THE NAME OF CIVILITY: TESTING THE EFFECTIVENESS 37

allow researchers to “differentiate between (a) relatively trivial events that have an immediate

but no lasting effects, (b) events that have a relatively small immediate effect but compound over

time to produce meaningful effects, or (c) impactful events that have both an immediate and

compounding effect over time” (Korsgaard, Kautz, Bliese, Samson, & Kostyszyn, 2018, p. 2).

Thus, future research can explore the dynamic nature of civility and its proximal and distal

outcomes by measuring these constructs across longer periods of time and at more measurement

occasions.

Finally, the measures used in this study demonstrated appropriate overall agreement and

reliability for aggregating the constructs to the team level of analysis. Interestingly, teams

differed greatly on their amount of within-group agreement for each construct, with some teams

showing complete lack of agreement while others demonstrated almost complete agreement.

Research on norms within groups has demonstrated that a team’s strongest norms are those for

which team members hold the highest level of consensus (Jackson, 1965; O’Reilly, 1989). For

the present study, then, it could be that norms other than civility could be more important for

those teams who expressed low consensus on measures of civility experiences. For example, it

could be that teams low in civility experiences placed greater value in achieving performance

outcomes than in maintaining interpersonal relationships. Thus, to get the job done, these teams

may compromise any commitment toward civility (see Kessler et al., 2008). Furthermore, sub-

group differences (faultlines) may exist within these groups such that the team members enacting

uncivil behaviors report few incivility experiences, whereas those who are the target of the

mistreatment are the team members reporting greater experiences of incivility. Additionally,

team members who report higher identification and commitment to their team are more likely to

embrace the norms that reside within the group (Christensen, Rothgerber, Wood, & Matz, 2004),

Page 43: “Stop! In the Name of Civility”: Testing the Effectiveness

STOP! IN THE NAME OF CIVILITY: TESTING THE EFFECTIVENESS 38

and this effect is greatest when the norms are centered around positive emotions (Wood,

Christensen, Hebl, & Rothgerber, 1997) and prosocial behaviors (Anderson & Dunning, 2014).

Thus, future research should focus on individual attitudes within teams to identify individual

drivers of team civility norms. Moreover, subsequent research can explore how norms spread

across teams and whether certain types of norms, especially the norm for civility, are more likely

to emerge and persist at the organizational level.

Practical Implications

Interventions designed to reduce workplace incivility have important implications for

organizations. Incivility continues to be a problem in many organizations, and uncivil

workplaces can result in high costs as employee productivity declines (Porath & Pearson, 2010),

employee absences increase (Leiter et al., 2011), and increases in employee burnout (Cortina et

al., 2001) and employee turnover (Chiaburu & Harrison, 2008; Lim et al., 2008) require

organizations to spend unbudgeted funds to hire and train new employees. Empirical support

exists for the efficacy of interventions to reduce workplace incivility (e.g., Leiter et al., 2011,

2012; Osatuke et al., 2009). Additionally, research has found that civility interventions also

impact proximal outcomes such as improving the quality of social relationships in organizations

(Leiter et al., 2011, 2012), reducing employee burnout (Leiter et al., 2011), increasing employee

trust towards coworkers and towards the organization (Holste & Fields, 2010), and enhancing

employee attitudes, including job satisfaction (Simon, Judge, & Halvorsen-Ganepola, 2010),

work engagement (Bakker, Albrecht, & Leiter, 2011), and organizational commitment

(Wanberg, Kammeyer-Mueller, & Marchese, 2006). Indeed, a recent report conducted by the

National Academy of Sciences, Engineering, and Medicine (NASEM; 2018) highlighted the

importance of creating civil climates as a means of reducing incidents of sexual harassment. This

Page 44: “Stop! In the Name of Civility”: Testing the Effectiveness

STOP! IN THE NAME OF CIVILITY: TESTING THE EFFECTIVENESS 39

is because organizational climates that place value on respect and civility are climates that can

“support policies and procedures to prevent and punish sexual harassment, while a culture that

does not [value respect and civility] will counteract efforts to address sexual harassment” (p.

163). This report, prepared in partnership with the Equal Employment Opportunity Council

(EEOC), concludes with a call for effective training interventions that are supported by scientific

evidence to raise the level of respect and interpersonal civility within teams and organizations.

Civility interventions may also improve organizational climate and culture by facilitating

the creation and maintenance of norms for mutual respect, leading to lasting workgroup- and

organizational-level change (Leiter et al., 2011, 2012; Osatuke et al., 2009). A civil climate

begins, however, with behavior from the top. A study completed in 2016 by Owens and Hekman

concluded that a leader who demonstrates prosocial behaviors, such as respect or humility, will

draw focus to others’ strengths, encourage others to share their perspectives, possess a

willingness to acknowledge his/her own limitations, and support others’ growth and

achievement. As a result, a prosocial leader will inspire follower loyalty and commitment

(Basford, Offermann, & Behrend, 2014), reinforce job satisfaction, work engagement, and

employee retention (Owens, Johnson, & Mitchell, 2013), leading to more positive follower

outcomes. These prosocial emotions are contagious, and members of the leader’s team will begin

imitating these behaviors through cooperative social exchanges and improved interpersonal

interactions (Owens, Wallace, & Waldman, 2015). These results, then, point to the possibility

that delivering civility interventions to leaders first may have a more positive impact on the

training’s effectiveness for the organization as a whole.

From the employee perspective, organizations must foster a civil climate by including

programs that facilitate employees’ reports of incidents of incivility without fear of retaliation, in

Page 45: “Stop! In the Name of Civility”: Testing the Effectiveness

STOP! IN THE NAME OF CIVILITY: TESTING THE EFFECTIVENESS 40

addition to sponsoring workplace interventions to reduce incidents of incivility. Furthermore,

organizations may need to adopt selection practices that result in the hiring of more respectful

leaders and employees. Reducing workplace incivility will require system-wide changes in

practices within organizations. This study hopes to demonstrate that those changes can begin

with a little kindness and respect.

Page 46: “Stop! In the Name of Civility”: Testing the Effectiveness

STOP! IN THE NAME OF CIVILITY: TESTING THE EFFECTIVENESS 41

References

Allport, F. H. (1954). The structuring of events: outline of a general theory with applications to

psychology. Psychological Review, 61, 281–303.

Anderson, J. E., & Dunning, D. (2014). Behavioral norms: Variants and their identification.

Social and Personality Psychology Compass, 8(12), 721–738. https://doi-

org.ezproxy.lib.uconn.edu/10.1111/spc3.12146

Andersson, L. M., & Pearson, C. M. (1999). Tit for tat? The spiraling effect of incivility in the

workplace. Academy of Management Review, 24, 452-471.

Aquino, K., & Thau, S. (2009). Workplace victimization: Aggression from the target’s

perspective. Annual Review of Psychology, 60, 717–741.

doi:10.1146/annurev.psych.60.110707.163703

Aquino, K., Tripp, T. M., & Bies, R. J. (2001). How employees respond to personal offense: The

effects of blame attribution, victim status, and offender status on revenge and

reconciliation in the workplace. Journal of Applied Psychology, 86, 52–59.

Argyris, C., Putnam, R., & Smith, D. (1985). Action science: Concepts, methods and skills for

research and intervention. San Francisco, CA: Jossey-Bass.

Aubé, C., & Rousseau, V. (2005). Team goal commitment and team effectiveness: The role of

task interdependence and supportive behaviors. Group Dynamics: Theory, Research, And

Practice, 9(3), 189-204. doi:10.1037/1089-2699.9.3.189

Aubke, F., Wöber, K., Scott, N., & Baggio, R. (2014). Knowledge sharing in revenue

management teams: Antecedents and consequences of group cohesion. International

Journal of Hospitality Management, 41, 149-157. doi:10.1016/j.ijhm.2014.05.010

Page 47: “Stop! In the Name of Civility”: Testing the Effectiveness

STOP! IN THE NAME OF CIVILITY: TESTING THE EFFECTIVENESS 42

Bakker, A. B., Albrecht, S. L., & Leiter, M. P. (2011). Key questions regarding work

engagement. European Journal of Work and Organizational Psychology, 20, 4–28.

doi:10.1080/1359432X.2010.485352

Barling, J. (1996). Prediction, experience, and consequences of violence. In G. R. VandenBos &

E. Q. Bulatao (Eds.), Violence on the job: Identifying risks and developing solutions (pp.

29-49). Washington, DC: American Psychological Association.

Bartholomew, K. (2006). Ending nurse-to-nurse hostility: Why nurses eat their young and each

other. Danvers, MA, USA: HCPro, Inc.

Basford, T. E., Offermann, L. R., & Behrend, T. S. (2014). Please accept my sincerest apologies:

Examining follower reactions to leader apology. Journal of Business Ethics, 119, 99–117.

Baumeister, R. F., & Leary, M. R. (1995). The need to belong: Desire for interpersonal

attachments as a fundamental human motivation. Psychological Bulletin, 117, 497–529.

Baumeister, R. F., Smart, L., & Boden, J. M. (1996). Relation of threatened egotism to violence

and aggression: The dark side of high self-esteem. Psychological Review, 103, 5–33.

Beal, D. J., Cohen, R. R., Burke, M. J., & McLendon, C. L. (2003). Cohesion and performance

in groups: A meta-analytic clarification of construct relations. Journal of Applied

Psychology, 88(6), 989-1004. doi:10.1037/0021-9010.88.6.989

Becker, T. E. (1992). Foci and bases of commitment: Are they distinctions worth making?

Academy of Management Journal, 35, 232–244.

Beehr, T. A. (1991). Stress in the workplace: An overview. In J. W. Jones, B. D. Steffy, & D. W.

Bray (Eds.), Applying psychology in business: The handbook for managers and human

resource professionals (pp. 709-714). Lexington, MA: Lexington Books.

Page 48: “Stop! In the Name of Civility”: Testing the Effectiveness

STOP! IN THE NAME OF CIVILITY: TESTING THE EFFECTIVENESS 43

Bennett, R., & Robinson, S. (2000). Development of a measure of workplace deviance. Journal

of Applied Psychology, 85, 349–360.

Bennett, R. J., & Stamper, C. L. (2001). Corporate citizenship and deviancy: A study of work

behavior. In C. Galbraith & M. Ryan (Eds.), International research in the business

disciplines: Strategies and organizations in transition (pp. 265–284). Amsterdam:

Elsevier Science.

Bentler, P. M. (1990). Comparative fit indexes in structural models. Psychological Bulletin, 107,

238–246.

Bettenhausen, K. L., & Murnighan, J. K. (1991). The development of an intragroup norm and the

effects of interpersonal and structural challenges. Administrative Science Quarterly,

36(1), 20-35.

Biemann, T., Cole, M. S., & Voelpel, S. (2012). Within-group agreement: On the use (and

misuse) of rWG and rWG(J) in leadership research and some best practice guidelines.

The Leadership Quarterly, 23, 66-80.

Biesanz, J. C. (2012). Autoregressive longitudinal models. In R. H. Hoyle (Ed.), Handbook of

structural equation modeling (pp. 459-471). New York: The Guilford Press.

Blau, P. M. (1964). Exchange and power in social life. New York: Wiley.

Blau, G., & Andersson, L. (2005). Testing a measure of instigated workplace incivility. Journal

of Occupational & Organizational Psychology, 78(4), 595-614.

Bliese, P. D. (2000). Within-group agreement, non-independence, and reliability: Implications

for data aggregation and analysis. In K. J. Klein & S. W. J. Kozlowski (Eds.), Multilevel

theory, research and methods in organizations: Foundations, extensions, and new

directions (pp. 349-381). San Francisco, CA: Jossey-Bass.

Page 49: “Stop! In the Name of Civility”: Testing the Effectiveness

STOP! IN THE NAME OF CIVILITY: TESTING THE EFFECTIVENESS 44

Bliese, P. D., Maltarich, M. A., Hendricks, J. L., Hofmann, D. A., & Adler, A. B. (2018).

Improving the measurement of group-level constructs by optimizing between-group

differentiation. Journal of Applied Psychology. Advance online publication.

http://dx.doi.org/10.1037/apl0000349

Bollen, K. A., & Curran, P. J. (2006). Latent curve models: A structural equation perspective.

Hoboken, NJ: John Wiley.

Bontempo, D. E., Grouzet, F. M. E., & Hofer, S. M. (2012). Measurement issues in the analysis

of within-person change. In J. T. Newsom, R. N. Jones, & S. M. Hofer (Eds.),

Longitudinal data analysis: A practical guide for researchers in aging, health, and social

sciences. New York: Routledge.

Bray, C. (2001). Bullying nurses at work: Theorising a gendered experience. Contemporary

Nurse, 10, 21-29.

Brown, R. D., & Hauenstein, N. (2005). Interrater agreement reconsidered: An alternative to the

rWG indices. Organizational Research Methods, 8, 165–184.

Browne, M. W., & Cudeck, R. (1989). Single sample cross-validation indices for covariance

structures. Multivariate Behavioral Research, 24, 445–455.

Browne, M. W., & Cudeck, R. (1993). Alternative ways of assessing model fit. In K. A. Bollen

& J. S. Long (Eds.), Testing structural equation models (pp. 136–162). Beverly Hills,

CA: SAGE.

Byrne, B. M., Shavelson, R. J., & Muthen, B. (1989). Testing for the equivalence of factor

covariance and mean structures: The issue of partial measurement invariance.

Psychological Bulletin, 105, 456–466.

Page 50: “Stop! In the Name of Civility”: Testing the Effectiveness

STOP! IN THE NAME OF CIVILITY: TESTING THE EFFECTIVENESS 45

Cammann, C., Fichman, M., Jenkins, G., & Klesh, J. (1983). Assessing the attitudes and

perceptions of organizational members. In S. E. Seashore, E. E. Lawler, III., P. H. Mirvis,

& C. Cammann (Eds.), Assessing organizational change: A guide to methods, measures,

and practices (pp. 71-119). New York: Wiley.

Campion, M. A., Medsker, G. J., & Higgs, A. C. (1993). Relations between work group

characteristics and effectiveness: Implications for designing effective work groups.

Personnel Psychology, 46(4), 823–850.

Chen, Y., Ferris, D.L., Kwan, H.K., Yan, M., Zhou, M. & Hong, Y. (2013). Self-love’s lost

labor: A self-enhancement model of workplace incivility. Academy of Management

Journal, 56, 1199-1219.

Chiaburu, D. S., & Harrison, D. A. (2008). Do peers make the place? Conceptual synthesis and

meta-analysis of co-worker effects on perceptions, attitudes, OCBs and performance.

Journal of Applied Psychology, 93, 1082–1103. doi:10.1037/0021-9010.93.5.1082

Christensen, P. N., Rothgerber, H., Wood, W., & Matz, D. C. (2004). Social norms and identity

relevance: A motivational approach to normative behavior. Personality and Social

Psychology Bulletin, 30(10), 1295–1309.

https://doiorg.ezproxy.lib.uconn.edu/10.1177/0146167204264480

Cohen, J. (1992). A power primer. Psychological Bulletin, 112, 155–159.

Conway, J. M. (2002). Method variance and method bias in industrial and organizational

psychology. In S. G. Rogelberg (Ed.), Handbook of research methods in industrial and

organizational psychology (pp. 344-365). Malden, MA: Blackwell Publishing.

Cortina, J. M. (1993). What is coefficient alpha? An examination of theory and applications.

Journal of Applied Psychology, 78(1), 98-104.

Page 51: “Stop! In the Name of Civility”: Testing the Effectiveness

STOP! IN THE NAME OF CIVILITY: TESTING THE EFFECTIVENESS 46

Cortina, L. M., Kabat-Farr, D., Magley, V. J., & Nelson, K. (2017). Researching rudeness: The

past, present, and future of the science of incivility. Journal of Occupational Health

Psychology, 22(3), 299-313. doi:10.1037/ocp0000089

Cortina, L. M., & Magley, V. J. (2009). Patterns and profiles of response to incivility in the

workplace. Journal of Occupational Health Psychology, 14(3), 272-288.

doi:10.1037/a0014934

Cortina, L. M., Magley, V. J., Williams, J. H., & Langhout, R. D. (2001). Incivility in the

workplace: Incidence and impact. Journal of Occupational Health Psychology, 6(1), 64-

80. doi:10.1037/1076-8998.6.1.64

Coultas, C. W., Driskell, T., Burke, C. S., & Salas, E. (2014). A conceptual review of emergent

state measurement: Current problems, future solutions. Small Group Research, 45(6),

671-703. doi:10.1177/1046496414552285

Cronbach, L. J. (1964). A word on 16 PF and reliability: Comment. American Psychologist,

19(6), 417. doi:10.1037/h0038475

Cropanzano, R., & Mitchel, S. M. (2005). Social exchange theory: An interdisciplinary review.

Journal of Management, 31(6), 874–900.

Cropanzano, R., Rupp, D. E., & Byrne, Z. S. (2003). The relationship of emotional exhaustion to

work attitudes, job performance, and organizational citizenship behaviors. Journal of

Applied Psychology, 88, 160– 169. http://dx.doi.org/10.1037/0021-9010.88.1.160

Dalal, R. S. (2005). A meta-analysis of the relationship between organizational citizenship

behavior and counterproductive work behavior. Journal of Applied Psychology, 90(6),

1241-1255. doi:10.1037/0021-9010.90.6.1241

Page 52: “Stop! In the Name of Civility”: Testing the Effectiveness

STOP! IN THE NAME OF CIVILITY: TESTING THE EFFECTIVENESS 47

Dalal, R. S., Baysinger, M., Brummel, B. J., & LeBreton, J. M. (2012). The relative importance

of employee engagement, other job attitudes, and trait affect as predictors of job

performance. Journal of Applied Social Psychology, 42(Suppl. 1), E295-E325.

doi:10.1111/j.1559-1816.2012.01017.x

Dalal, R. S., Lam, H., Weiss, H. M., Welch, E. R., & Hulin, C. L. (2009). A within-person

approach to work behavior and performance: Concurrent and lagged citizenship-

counterproductivity associations, and dynamic relationships with affect and overall job

performance. Academy of Management Journal, 52, 1051–1066.

Dasborough, M. T., Ashkanasy, N. M., Tee, E. Y. J., & Tse, H. H. M. (2009). What goes around

comes around: How meso-level negative emotional contagion can ultimately determine

organizational attitudes toward leaders. The Leadership Quarterly, 20(4), 571–585.

https://doi-org.ezproxy.lib.uconn.edu/10.1016/j.leaqua.2009.04.009

Dekas, K. H., Bauer, T. N., Welle, B., Kurkoski, J., & Sullivan, S. (2013). Organizational

citizenship behavior, version 2.0: A review and qualitative investigation of OCBs for

knowledge workers at Google and beyond. Academy of Management Perspectives,

27(3), 219-237. doi:10.5465/amp.2011.0097

Dewe, P., & Trenberth, L. (2004). Work stress and coping: Drawing together research and

practice. British Journal of Guidance & Counselling, 32, 143–156.

http://dx.doi.org/10.1080/03069880410001693138

Dicke, T., Stebner, F., Linninger, C., Kunter, M., & Leutner, D. (2018). A longitudinal study of

teachers’ occupational well-being: Applying the job demands-resources model. Journal

of Occupational Health Psychology, 23(2), 262–277. https://doi-

org.ezproxy.lib.uconn.edu/10.1037/ocp0000070.supp (Supplemental)

Page 53: “Stop! In the Name of Civility”: Testing the Effectiveness

STOP! IN THE NAME OF CIVILITY: TESTING THE EFFECTIVENESS 48

Edwards, M. C., & Wirth, R. J. (2009). Measurement and the study of change. Research in

Human Development, 6, 74–96.

Edwards, M. C., & Wirth, R. J. (2012). Valid measurement without factorial invariance: A

longitudinal example. In J. R. Harring & G. R. Hancock (Eds.), Advances in longitudinal

methods in the social and behavioral sciences (pp. 289–311). Thousand Oaks, CA: Sage.

Ehrhart, M. G., & Naumann, S. E. (2004). Organizational citizenship behavior in work groups: A

group norms approach. Journal of Applied Psychology, 89(6), 960–974. https://doi-

org.ezproxy.lib.uconn.edu/10.1037/0021-9010.89.6.960

Ehrhart, M. G., Schneider, B., & Macey, W. H. (2014). Organizational climate and culture: An

introduction to theory, research and practice. New York, NY: Routledge.

Ellis, H. C., Moore, B. A., Varner, L. J., & Ottaway, S. A. (1997). Depressed mood, task

organization, cognitive interference, and memory: Irrelevant thoughts predict recall

performance. Journal of Social Behavior and Personality, 12, 453–470.

Ellis, H. C., Varner, L. J., Becker, A. S., & Ottaway, S. A. (1995). Emotion and prior knowledge

in memory and judged comprehension of ambiguous stories. Cognition and Emotion, 9,

363–382.

Farh, J. L., & Dobbins, G. H. (1989). Effects of self-esteem on leniency bias in self- reports of

performance: A structural equation model analysis. Personnel Psychology, 42, 835–850.

doi:10.1111/j.1744-6570.1989.tb00677.x

Farh, J., Dobbins, G. H., & Cheng, B. (1991). Cultural relativity in action: A comparison of self-

rating made by Chinese and U.S. workers. Personnel Psychology, 44(1), 129-147.

doi:10.1111/j.1744-6570.1991.tb00693.x

Page 54: “Stop! In the Name of Civility”: Testing the Effectiveness

STOP! IN THE NAME OF CIVILITY: TESTING THE EFFECTIVENESS 49

Farrell, G. A. (2001). From tall poppies to squashed weeds: Why don’t nurses pull together

more? Journal of Advanced Nursing, 35, 26-33.

Felson, R. B. (1982). Impression management and the escalation of aggression and violence.

Social Psychology Quarterly, 45, 245–254.

Ferguson, M. (2012). You cannot leave it at the office: Spillover and crossover of coworker

incivility. Journal of Organizational Behavior, 33, 571–588.

http://dx.doi.org/10.1002/job.774

Festinger L. (1950). Informal social communication. Psychological Review, 57, 271–282.

Field, A. (2013). Discovering statistics with IBM SPSS. Newbury Park, CA: Sage.

Fisher, G. G., Matthews, R. A., & Gibbons, A. M. (2016). Developing and investigating the use

of single-item measures in organizational research. Journal of Occupational Health

Psychology, 21(1), 3-23. doi:10.1037/a0039139

Fitzgerald, L. F., Shullman, S., Bailey, N., Richards, M., Swecker, J., Gold, A., . . .Weitzman, L.

(1988). The incidence and dimensions of sexual harassment in academia and the

workplace. Journal of Vocational Behavior, 32, 152-175.

Fix, E., Hodges, J. L., & Lehmann, E. L. (1959). The restricted chi-square test. In U. Grenander

(Ed.), Probability and statistics: The Harald Cramer Volume Edition (pp. 92–97). New

York: Wiley.

Foulk, T., Woolum, A., & Erez, A. (2016). Catching rudeness is like catching a cold: The

contagion effects of low-intensity negative behaviors. Journal of Applied Psychology,

101, 50–67. http://dx.doi.org/10 .1037/apl0000037

Gallus, J. A., Bunk, J. A., Matthews, R. A., Barnes-Farrell, J. L., & Magley, V. J. (2014). An eye

for an eye? Exploring the relationship between workplace incivility experiences and

Page 55: “Stop! In the Name of Civility”: Testing the Effectiveness

STOP! IN THE NAME OF CIVILITY: TESTING THE EFFECTIVENESS 50

perpetration. Journal of Occupational Health Psychology, 19(2), 143-154.

doi:10.1037/a0035931

George, D., & Mallery, M. (2010). SPSS for Windows Step by Step: A Simple Guide and

Reference, 17.0 update (10a ed.) Boston: Pearson.

Gilligan, J. (1996). Violence: Our deadly epidemic and its causes. New York: Putman.

Gollob, H. F., & Reichardt, C. S. (1987). Taking account of time lags in causal models. Child

Development, 58, 80–92.

Gonzalez-Mulé, E., DeGeest, D. S., McCormick, B. W., Seong, J. Y., & Brown, K. G. (2014).

Can we get some cooperation around here? The mediating role of group norms on the

relationship between team personality and individual helping behaviors. Journal of

Applied Psychology, 99(5), 988–999.

https://doiorg.ezproxy.lib.uconn.edu/10.1037/a0037278

Graham, J. W. (2009). Missing data analysis: Making it work in the real world. Annual Review of

Psychology, 60 , 549-576.

Griffin, B. (2010). Multilevel relationships between organizational-level incivility, justice and

intention to stay. Work and Stress, 24, 309–323.

http://dx.doi.org/10.1080/02678373.2010.531186

Harvey, M., Treadway, D. C., & Heames, J. T. (2007). The occurrence of bullying in global

organizations: A model and issues associated with social/emotional contagion. Journal of

Applied Social Psychology, 37(11), 2576–2599. https://doi-

org.ezproxy.lib.uconn.edu/10.1111/j.1559-1816.2007.00271.x

Hollinger, R. C. (1986). Acts against the workplace: Social bonding and employee deviance.

Deviant Behavior, 7, 53–75.

Page 56: “Stop! In the Name of Civility”: Testing the Effectiveness

STOP! IN THE NAME OF CIVILITY: TESTING THE EFFECTIVENESS 51

Holste, J. S., & Fields, D. (2010). Trust and tacit knowledge sharing and use. Journal of

Knowledge Management, 14, 128–140. doi:10.1108/ 13673271011015615

Homans, G. C. (1961). Social behavior: Its elementary forms. New York: Harcourt, Brace, &

World.

Homans, G. C. (1974). Social Behavior: Its Elementary Forms. New York: Harcourt, Brace,

Jovanovich.

Horn, J. L., McArdle, J. J., & Mason, R. (1983). When is invariance not invariant: A practical

scientist’s look at the ethereal concept of factor invariance. The Southern Psychologist, 1,

179–188.

Howard, G. (1994). Why do people say nasty things about self-reports? Journal of

Organizational Behavior, 15, 399–404. http://dx.doi.org/10 .1002/job.4030150505

Howell, D.C. (2002). Statistical Methods for Psychology (5th ed.). Pacific Grove CA: Duxbury.

Hu, L., & Bentler, P. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis:

Conventional criteria versus new alternatives. Structural Equation Modeling, 6, 1–55.

Hu, J., & Liden, R. C. (2015). Making a difference in the teamwork: Linking team prosocial

motivation to team processes and effectiveness. Academy of Management Journal, 58(4),

1102–1127. https://doi-org.ezproxy.lib.uconn.edu/10.5465/amj.2012.1142

Hunter, J. E., & Gerbing, D. W. (1982). Unidimensional measurement, second-order factor

analysis, and causal models. In B. M. Staw & L. L. Cummings (Eds.), Research in

organizational behavior (Vol. 4, pp. 267– 320). Greenwich, CT: JAI Press.

IBM Corp. (2017). Statistical Package for the Social Sciences (SPSS) for Macintosh, Version

25.0 [computer software]. Armonk, NY: IBM Corp.

Page 57: “Stop! In the Name of Civility”: Testing the Effectiveness

STOP! IN THE NAME OF CIVILITY: TESTING THE EFFECTIVENESS 52

Ilies, R., Scott, B. A., & Judge, T. A. (2006). The interactive effects of personal traits and

experienced states on intra-individual patterns of citizenship behavior. Academy of

Management Journal, 49, 561-575.

Itzkovich, Y., & Heilbrunn, S. (2016). The role of co-workers’ solidarity as an antecedent of

incivility and deviant behavior in organizations. Deviant Behavior, 37(8), 861-876.

doi:10.1080/01639625.2016.1152865

Jackson, J. (1965). Structural characteristics of norms. In I.D. Steiner & M. Fishbein

(Eds.), Current studies in social psychology (pp. 301–309). New York: Holt,

Rinehart, & Winston.

James, D. L., Demaree, R. G., & Wolf, G. (1984). Estimating within-group interrater reliability

with and without response bias. Journal of Applied Psychology, 69, 85–98.

Jex, S. M., & Bliese, P. D. (1999). Efficacy beliefs as a moderator of the impact of work-related

stressors: A multilevel study. Journal of Applied Psychology, 84, 349–361.

doi:10.1037/0021- 9010.84.3.349

Joreskog, K. G. (1970). Estimation and testing of simplex models. British Journal of

Mathematical and Statistical Psychology, 23, 121–145.

Joreskog, K. G. (1971). Simultaneous factor analysis in several populations. Psychometrika, 36,

409–426.

Judge, T. A., Thoresen, C. J., Bono, J. E., & Patton, G. K. (2001). The job satisfaction-job

performance relation- ship: A qualitative and quantitative review. Psychological Bulletin,

127, 376–407.

Page 58: “Stop! In the Name of Civility”: Testing the Effectiveness

STOP! IN THE NAME OF CIVILITY: TESTING THE EFFECTIVENESS 53

Kabat-Farr, D., Cortina, L. M., & Marchiondo, L. A. (2016). The emotional aftermath of

incivility: Anger, guilt, and the role of organizational commitment. International Journal

of Stress Management. Advance online publication. http://dx.doi.org/10.1037/str0000045

Kahneman, D. (1973). Attention and effort. Englewood Cliffs, NJ: Prentice Hall.

Kanfer, R., & Ackerman, P. L. (1989). Motivation and cognitive abilities: An integrative

aptitude-treatment interaction approach to skill acquisition. Journal of Applied

Psychology, 74, 657–690.

Keashly, L., & Neuman, J. H. (2009). Building a constructive communication climate: The

workplace stress and aggression project. In. P. Lutgen-Sandvik & B. D. Sypher (Eds.),

Destructive organizational communication: Processes, consequences, and constructive

ways of organizing (pp. 339-362). New York, NY: Routledge.

Kenny, D. A., & Milan, S. (2012). Identification: A nontechnical discussion of a technical issue.

In R. H. Hoyle (Ed.), Handbook of structural equation modeling (pp. 145-163). New

York: The Guilford Press.

Kessler, S. R., Spector, P. E., Chang, C., & Parr, A. D. (2008). Organizational violence and

aggression: Development of the three-factor Violence Climate Survey. Work & Stress,

22, 108-124.

Kirk, B. A., Schutte, N. S., & Hine, D. W. (2011). The effect of an expressive-writing

intervention for employees on emotional self-efficacy, emotional intelligence, affect, and

workplace incivility. Journal of Applied Social Psychology, 41, 179- 195.

Kivimaki, K., Elovainio, M., & Vathera, J. (2000). Workplace bullying and sickness absence in

hospital staff. Occupational and Environmental Medicine, 57, 656–660.

Page 59: “Stop! In the Name of Civility”: Testing the Effectiveness

STOP! IN THE NAME OF CIVILITY: TESTING THE EFFECTIVENESS 54

Klein, H. J., & Kim, J. S. (1998). A field study of the influence of situational constraints, leader–

member exchange, and goal commitment on performance. Academy of Management

Journal, 41, 88–95.

Korsgaard, A. M., Kautz, J., Bliese, P., Samson, K., & Kostyszyn, P. (2018). Conceptualising

time as a level of analysis: New directions in the analysis of trust dynamics. Journal of

Trust Research, 8(2), 142-165.

Koys, D. J. (2001). The effects of employee satisfaction, organizational citizenship behavior, and

turnover on organizational effectiveness: A unit-level, longitudinal study. Personnel

Psychology, 54, 101–114.

Kozlowski, S. W. J., & Bell, B. S. (2003). Work groups and teams in organizations. In W. C.

Borman, D. R. Ilgen, & R. J. Klimoski (Eds.), Handbook of psychology: Industrial and

organizational psychology, Vol. 12 (pp. 333-375). London: Wiley.

Kozlowski, S. W. J., & Chao, G. T. (2012). The dynamics of emergence: Cognition and cohesion

in work teams. Managerial & Decision Economics, 33(5-6), 335-354.

doi:10.1002/mde.2552

Kozlowski, S. W. J., & Ilgen, D. R. (2006). Enhancing the effectiveness of work groups and

teams. Psychological Science in the Public Interest, 7, 77-124.

Kozlowski, S. W. J., & Salas, E. (1997). An organizational systems approach for the

implementation and transfer of training. In J. K. Ford, S. W. J. Kozlowski, K. Kraiger, E.

Salas, & M. Teachout (Eds.), Improving training effectiveness in work organizations (pp.

247-287). Mahwah, NJ: Lawrence Erlbaum Associates.

Kwan, V. S., John, O. P., Robins, R. W., & Kuang, L. L. (2008). Conceptualizing and assessing

self-enhancement bias: A componential approach. Journal of Personality and Social

Page 60: “Stop! In the Name of Civility”: Testing the Effectiveness

STOP! IN THE NAME OF CIVILITY: TESTING THE EFFECTIVENESS 55

Psychology, 94, 1062. doi: 10.1037/0022-3514.94.6.1062

Lance, C. E., Butts, M. M., & Michels, L. C. (2006). The sources of four commonly reported

cutoff criteria: What did they really say? Organizational Research Methods, 9(2), 202-

220.

Lazarus, R. S. (2000). Toward better research on stress and coping. American Psychologist, 55,

665– 673. http://dx.doi.org/10.1037/0003- 066X.55.6.665

Lazarus, R. S., & Folkman, S. (1984). Stress, appraisal and coping. New York, NY: Springer.

LeBreton, J. M., Burgess, J.R.D., Kaiser, R. B., Atchley, E.K.P., & James, L. R. (2003). The

restriction of variance hypothesis and interrater reliability and agreement: Are ratings

from multiple sources really dissimilar? Organizational Research Methods, 6(1), 80-128.

LeBreton, J. M. & Senter, J. L. (2008). Answers to 20 questions about interrater reliability and

interrater agreement. Organizational Research Methods, 11, 815-852.

Leiter, M. P., Day, A., Oore, D. G., & Spence Laschinger, H. K. (2012). Getting better and

staying better: Assessing civility, incivility, distress, and job attitudes one year after a

civility intervention. Journal of Occupational Health Psychology, 17(4), 425-434.

doi:10.1037/a0029540

Leiter, M. P., Laschinger, H. S., Day, A., & Oore, D. G. (2011). The impact of civility

interventions on employee social behavior, distress, and attitudes. Journal of Applied

Psychology, 96(6), 1258-1274. doi:10.1037/a0024442

Lim, S., & Cortina, L. M. (2005). Interpersonal mistreatment in the workplace: The interface and

impact of general incivility and sexual harassment. Journal of Applied Psychology, 90,

483–496. http://dx.doi .org/10.1037/0021-9010.90.3.483

Page 61: “Stop! In the Name of Civility”: Testing the Effectiveness

STOP! IN THE NAME OF CIVILITY: TESTING THE EFFECTIVENESS 56

Lim, S., Cortina, L. M., & Magley, V. J. (2008). Personal and workgroup incivility: Impact on

work and health outcomes. Journal of Applied Psychology, 93, 95–107.

http://dx.doi.org/10.1037/0021-9010.93.1.95

Lim, S., & Lee, A. (2011). Work and nonwork outcomes of workplace incivility: Does family

support help? Journal of Occupational Health Psychology, 16, 95–111.

http://dx.doi.org/10.1037/a0021726

Little, T. D., Slegers, D. W., & Card, N. A. (2006). A non-arbitrary method of identifying and

scaling latent variables in SEM and MACS models. Structural Equation Modeling, 13,

59–72.

Liu, W., Chi, S. S., Friedman, R., & Tsai, M. (2009). Explaining incivility in the workplace: The

effects of personality and culture. Negotiation and Conflict Management Research, 2(2),

164-184. doi:10.1111/j.1750-4716.2009.00035.x

Lorenz, F. O., Conger, R. D., Simons, R. L., & Whitbeck, L. B. (1995). The effects of unequal

variances and covariances in simultaneous inference: The case of hostility and marital

quality. Journal of Marriage and the Family, 574, 1049–1064.

Mackey, J. D., Bishoff, J. D., Daniels, S. R., Hochwarter, W. A., & Ferris, G. R. (2017).

Incivility’s relationship with workplace outcomes: Enactment as a boundary condition in

two samples. Journal of Business Ethics, doi:10.1007/s10551-017-3492-8

Mackey, J. D., Brees, J. R., McAllister, C. P., Zorn, M. L., Martinko, M. J., & Harvey, P. (in

press). Victim and culprit? The effects of entitlement and felt accountability on

perceptions of abusive supervision and perpetration of workplace bullying. Journal of

Business Ethics. doi: 10.1007/s10551-016-3348-7

Page 62: “Stop! In the Name of Civility”: Testing the Effectiveness

STOP! IN THE NAME OF CIVILITY: TESTING THE EFFECTIVENESS 57

Mao, C., Chang, C., Johnson, R. E., & Sun, J. (2017). Incivility and employee performance,

citizenship, and counterproductive behaviors: Implications of the social context. Journal

of Occupational Health Psychology, Advanced online publication.

doi:10.1037/ocp0000108

Marks, M. A., Mathieu, J. E., & Zaccaro, S. J. (2001). A temporally based framework and

taxonomy of team processes. Academy of Management Review, 26(3), 356-376.

Martin, R. J., & Hine, D. W. (2005). Development and validation of the Uncivil Workplace

Behavior Questionnaire. Journal of Occupational Health Psychology, 10, 477–490.

doi:10.1037/1076-8998 .10.4.477

Mathieu, J. E., & Chen, G. (2011). The etiology of the multilevel paradigm in management

research. Journal of Management, 37, 610-641.

Mathieu, J. E., & Taylor, S. R. (2006). Clarifying conditions and decision points for mediational

type inferences in Organizational Behavior. Journal of Organizational Behavior, 27(8),

1031–1056. https://doi-org.ezproxy.lib.uconn.edu/10.1002/job.406

Mathieu, J. E., Kukenberger, M. R., D'Innocenzo, L., & Reilly, G. (2015). Modeling reciprocal

team cohesion–performance relationships, as impacted by shared leadership and

members’ competence. Journal of Applied Psychology, 100(3), 713-734.

doi:10.1037/a0038898

Mathieu, J. E., Maynard, M. T., Rapp, T., & Gilson, L. (2008). Team effectiveness 1997-2007: A

review of recent advancements and a glimpse into the future. Journal of Management,

34(3), 410-476. doi:10.1177/0149206308316061

McCoach, D. B. (2018). Longitudinal modeling: Autoregressive models [PowerPoint slides].

Retrieved from https://huskyct.uconn.edu/webapps/portal/execute/tabs/

Page 63: “Stop! In the Name of Civility”: Testing the Effectiveness

STOP! IN THE NAME OF CIVILITY: TESTING THE EFFECTIVENESS 58

McDonald, R. P., & Marsh, H. W. (1990). Choosing a multivariate model: Noncentrality and

goodness-of-fit. Psychological Bulletin, 107, 247– 255. http://dx.doi.org/10.1037/0033-

2909.107.2.247

McLean Parks, J. (1997). The fourth arm of justice: The art of science and revenge. In R. J.

Lewicki, R. J. Bies, & B. H. Sheppard (Eds.), Research on negotiation in organizations,

Vol. 6 (pp. 113–144). Greenwich, CT: JAI Press.

McMahon, S., Peterson, N. A., Winter, S. C., Palmer, J. E., Postmus, J. L., & Koenick, R. A.

(2015). Predicting bystander behavior to prevent sexual assault on college campuses: The

role of self-efficacy and intent. American Journal of Community Psychology, 56(1–2),

46–56. https://doi-org.ezproxy.lib.uconn.edu/10.1007/s10464-015-9740-0

Meredith, W. (1993). Measurement invariance, factor analysis, and factorial invariance.

Pyschometrika, 58, 525–543.

Meyer, J. P., & Allen, N. J. (1991). A three-component conceptualization of organizational

commitment. Human Resource Management Review, 1, 61-98.

Meyer, J. P., & Allen, N. J. (1997). Commitment in the workplace. Thousand Oaks, CA:

Sage.

Meyer, J., Allen, N., & Smith, C. (1993). Commitment to organizations and occupations:

Extension and test of a three-component conceptualization. Journal of Applied

Psychology, 78(4), 538-551.

Millsap, R. E., & Cham, H. (2011). Investigating factorial invariance in longitudinal data. In B.

Laursen, T. D. Little, and N. A. Card (Eds.), Handbook of developmental research

methods. New York: Guilford.

Page 64: “Stop! In the Name of Civility”: Testing the Effectiveness

STOP! IN THE NAME OF CIVILITY: TESTING THE EFFECTIVENESS 59

Millsap, R. E., & Hartog, S. B. (1988). Alpha, beta, and gamma change in evaluation research: A

structural equation approach. Journal of Applied Psychology, 73, 574–584.

doi:10.1037/0021-9010.73.3.574

Miner-Rubino, K., & Reed, W. D. (2010). Testing a moderated mediational model of workgroup

incivility: The roles of organizational trust and group regard. Journal of Applied Social

Psychology, 40, 3148–3168. http://dx.doi.org/10.1111/j.1559-1816.2010.00695.x

Murphy, K. R., & Myors, B. (1998). Statistical power analysis: A simple and general model for

traditional and modern hypothesis tests. Mahwah, NJ: Lawrence Erlbaum.

Muthen, L. K., & Muthen, B. O. (2017a). Mplus [computer software]. Los Angeles, CA:

Muthen & Muthen.

Muthen, L. K., & Muthen, B. O. (2017b). Mplus User’s Guide. Eighth Edition. Los Angeles,

CA: Muthen & Muthen.

National Academies of Sciences, Engineering, and Medicine. (2018). Sexual harassment of

women: Climate, culture, and consequences in academic sciences, engineering, and

medicine. Washington, DC: The National Academies Press. doi: https://

doi.org/10.17226/24994.

Neuman, J. H., & Baron, R. A. (1997). Aggression in the workplace. In R. Giacalone & J. Green-

berg (Eds.), Antisocial behavior in organizations (pp. 37–67). Thousand Oaks, CA: Sage.

Neuman, J. H., & Baron, R. A. (1998). Workplace violence and workplace aggression: Evidence

concerning specific forms, potential causes, and preferred targets. Journal of

Management, 24, 391–419. http://dx.doi .org/10.1177/014920639802400305

Newman, D. A. (2009). Missing data techniques and low response rates: The role of systematic

nonresponse parameters. In C. E. Lance & R. J. Vandenberg (Eds.), Statistical and

Page 65: “Stop! In the Name of Civility”: Testing the Effectiveness

STOP! IN THE NAME OF CIVILITY: TESTING THE EFFECTIVENESS 60

methodological myths and urban legends: Doctrine, verity, and fable in the

organizational and social sciences (pp. 7-36). New York, NY: Routledge.

Newman, D. A. (2014). Missing data: Five practical guidelines. Organizational Research

Methods, 17(4), 372-411.

Newsom, J. T. (2015). Longitudinal structural equation modeling: A comprehensive

introduction. New York: Routledge.

Ng, T. W. H., & Feldman, D. C. (2009). How broadly does education contribute to job

performance? Personnel Psychology, 62, 89–134.

Ng, K. Y., Koh, C., Ang, S., Kennedy, J. C., & Chan, K. Y. (2011). Rating leniency and halo in

multisource feedback ratings: Testing cultural assumptions of power distance and

individualism-collectivism. Journal of Applied Psychology, 96, 1033.

doi:10.1037/a0023368

Nicholson, T., & Griffin, B. (2015). Here today but not gone tomorrow: Incivility affects after-

work and next-day recovery. Journal of Occupational Health Psychology, 20, 218 –225.

http://dx.doi.org/10.1037/ a0038376

Nunnally, J. C. (1978). Psychometric theory (2nd ed.). New York: McGraw-Hill.

O’Brien, R. G., & Kaiser, M. K. (1985). MANOVA method for analyzing repeated measures

designs: An extensive primer. Psychological Bulletin, 97(2), 316–333. https://doi-

org.ezproxy.lib.uconn.edu/10.1037/0033-2909.97.2.316

Olson-Buchanan, J. B., & Boswell, W. R. (2008). An integrative model of experiencing and

responding to mistreatment at work. Academy of Management Review, 33, 76–96.

doi:10.5465/AMR.2008.27745325

Page 66: “Stop! In the Name of Civility”: Testing the Effectiveness

STOP! IN THE NAME OF CIVILITY: TESTING THE EFFECTIVENESS 61

O’Reilly, C. A. (1989). Corporations, culture, and commitment: Motivation and social control in

organizations. California Management Review, 31, 9–25.

O’Reilly, C. A., & Chatman, J. (1986). Organizational commitment and psychological

attachment: The effects of compliance, identification, and internalization on prosocial

behavior. Journal of Applied Psychology, 71(3), 492-499.

Organ, D. W. (1977). A reappraisal and reinterpretation of the satisfaction- causes-performance

hypothesis. Academy of Management Review, 2, 46 –53.

Organ, D. W. (1988). Organizational citizenship behavior: The good soldier syndrome.

Lexington, MA: Lexington Books.

Organ, D. W., & Paine, J. B. (1999). A new kind of performance for industrial and

organizational psychology: Recent contributions to the study of organizational citizenship

behavior. International Review of Industrial and Organizational Psychology, 14, 337–

368.

Organ, D., Podsakoff, P., & Podsakoff, N. (2011). Expanding the criterion domain to include

organizational citizenship behavior: Implications for employee selection. In S. Zedeck

(Ed.), Handbook of industrial and organizational psychology (pp. 281–323). Washington,

DC: APA Press.

Osatuke, K., Mohr, D., Ward, C., Moore, S. C., Dyrenforth, S., & Belton, L. (2009). Civility,

Respect, Engagement in the Workforce (CREW): Nationwide organization development

intervention at Veterans Health Administration. Journal of Applied Behavioral Science,

45, 384–410. doi:10.1177/0021886309335067

Page 67: “Stop! In the Name of Civility”: Testing the Effectiveness

STOP! IN THE NAME OF CIVILITY: TESTING THE EFFECTIVENESS 62

Owens, B. P., & Hekman, D. R. (2016). How does leader humility influence team performance?

Exploring the mechanisms of contagion and collective promotion focus. Academy of

Management Journal, 59(3), 1088-1111. doi:10.5465/amj.2013.0660

Owens, B. P., Johnson, M. J., & Mitchell, T. R. (2013). Expressed humility in organizations:

Implications for performance, teams, and leadership. Organization Science, 24, 1517–

1538.

Owens, B. P., Wallace, A., & Waldman, D. A. (2015). Leader narcissism and follower outcomes:

The counter- balancing effect of leader humility. Journal of Applied Psychology, 100,

1203–1213.

Paulin, D., & Griffin, B. (2016). The relationships between incivility, team climate for incivility,

and job-related employee well-being: A multilevel analysis. Work & Stress, 30(2), 132-

151. doi:10.1080/02678373.2016.1173124

Paulin, D., & Griffin, B. (2017). Team Incivility Climate Scale: Development and validation of

the team-level incivility climate construct. Group & Organization Management, 42(3),

315-345. doi: 10.1177/1059601115622100

Pearce, C. L., & Ensley, M. D. (2004). A reciprocal and longitudinal investigation of the

innovation process: The central role of shared vision in product and process innovation

teams (PPITs). Journal of Organizational Behavior, 25, 259–278. doi:10.1002/job.235

Pearson, C. M., Anderson, L. M., & Porath, C. I. (2000). Assessing and attacking workplace

incivility. Organizational Dynamics, 29, 123–137.

Pearson, C. M., Andersson, L. M., & Porath, C. L. (2005). Workplace incivility. In S. Fox & P.

E. Spector (Eds.), Counterproductive work behaviour: Investigations of actors and

targets (pp. 177–200). Washington, DC: American Psychological Association.

Page 68: “Stop! In the Name of Civility”: Testing the Effectiveness

STOP! IN THE NAME OF CIVILITY: TESTING THE EFFECTIVENESS 63

Pearson, C. M., Andersson, L. M., & Wegner, J. W. (2001). When workers flout convention: A

study of workplace incivility. Human Relations, 54, 1387–1419.

http://dx.doi.org/10.1177/00187267015411001

Penney, L. M., & Spector, P. E. (2005). Job stress, incivility, and counterproductive work

behavior (CWB): The moderating role of negative affectivity. Journal of Organizational

Behavior, 26, 777–796. http://dx .doi.org/10.1002/job.336

Peralta, C. F., Lopes, P. N., Gilson, L. L., Lourenço, P. R., & Pais, L. (2015). Innovation

processes and team effectiveness: The role of goal clarity and commitment, and team

affective tone. Journal of Occupational and Organizational Psychology, 88(1), 80-107.

doi:10.1111/joop.12079

Ployhart, R. E., & Vandenberg, R. J. (2010). Longitudinal research: The theory, design, and

analysis of change. Journal of Management, 36(1), 94-120.

Podsakoff, P. M., Ahearne, M., & MacKenzie, S. B. (1997). Organizational citizenship behavior

and the quantity and quality of work group performance. Journal of Applied Psychology,

82, 262–270.

Podsakoff, N., Whiting, S., Podsakoff, P., & Blume, B. (2009). Individual- and organizational-

level consequences of organizational citizenship behaviors: A meta-analysis. Journal of

Applied Psychology, 94, 122–141.

Porath, C. L., & Erez, A. (2007). Does rudeness really matter? The effects of rudeness on task

performance and helpfulness. Academy of Management Journal, 50, 1181–1197.

http://dx.doi.org/10.2307/20159919

Page 69: “Stop! In the Name of Civility”: Testing the Effectiveness

STOP! IN THE NAME OF CIVILITY: TESTING THE EFFECTIVENESS 64

Porath, C. L., Foulk, T., & Erez, A. (2015). How incivility hijacks performance: It robs cognitive

resources, increases dysfunctional behavior, and infects team dynamics and functioning.

Organizational Dynamics, 44(4), 258–265.

https://doiorg.ezproxy.lib.uconn.edu/10.1016/j.orgdyn.2015.09.002

Porath, C. L., Overbeck, J. R., & Pearson, C. M. (2008). Picking up the gauntlet: How

individuals respond to status challenges. Journal of Applied Social Psychology, 38(7),

1945-1980. doi:10.1111/j.1559-1816.2008.00375.x

Porath, C. L., & Pearson, C. M. (2010). The cost of bad behavior. Organizational Dynamics, 39,

64–71. doi:10.1016/j.orgdyn.2009.10.006

Probst, T. M., Brubaker, T. L., & Barsotti, A. (2008). Organizational injury rate underreporting:

The moderating effect of organizational safety climate. Journal of Applied Psychology,

93, 1147-1154. doi:10.1037/0021-9010.93.5.1147

Rahim, A., & Cosby, D. M. (2016). A model of workplace incivility, job burnout, turnover

intentions, and job performance. Journal of Management Development, 35(10), 1255-

1265. doi:10.1108/JMD-09-2015-0138

Raudenbush, S. W., & Liu, X. (2000). Statistical power and optimal design for multisite

randomized trials. Psychological Methods, 5, 199–213. doi:10.1037/1082-989X.5.2.199

Roberson, Q. M., & Colquitt, J. A. (2005). Shared and configural justice: A social network

model of justice in teams. Academy of Management Review, 30, 595-607.

doi:10.5465/AMR.2005.17293715

Robins, R. W., & Paulhus, D. L. (2001). The character of self-enhancers: Implications for

organizations. In B. W. Roberts and R. Hogan (Eds.), Personality Psychology in the

Workplace (193–222). Washington, DC: American Psychological Association.

Page 70: “Stop! In the Name of Civility”: Testing the Effectiveness

STOP! IN THE NAME OF CIVILITY: TESTING THE EFFECTIVENESS 65

Rosen, C. C., Koopman, J., Gabriel, A. S., & Johnson, R. E. (2016). Who strikes back? A daily

investigation of when and why incivility begets incivility. Journal of Applied

Psychology, 101(11), 1620–1634. https://doi-

org.ezproxy.lib.uconn.edu/10.1037/apl0000140

Rotundo, M., & Sackett, P. R. (2002). The relative importance of task, citizenship, and

counterproductive performance to global ratings of job performance: A policy-capturing

approach. Journal of Applied Psychology, 87, 66–80.

Sackett, P. R., Berry, C. M., Wiemann, S. A., & Laczo, R. M. (2006). Citizenship and

counterproductive behavior: Clarifying relations between the two domains. Human

Performance, 19, 441–464.

Sackett, P. R., & Lievens, F. (2008). Personnel selection. Annual Review of Psychology, 59,

419–450.

Sakurai, K., & Jex, S. M. (2012). Coworker incivility and incivility targets’ work effort and

counterproductive work behaviors: The moderating role of supervisor social support.

Journal of Occupational Health Psychology, 17, 150–161.

http://dx.doi.org/10.1037/a0027350

Schat, A. H. (2005). In praise of intolerance: Investigating the effects of organizational tolerance

on the incidence and consequences of workplace aggression. Dissertation Abstracts

International, 65, 5448.

Schmit, M. K., Watson, J. C., & Schmit, E. L. (2018). Using profile analysis in counseling

outcome research. Counseling Outcome Research and Evaluation. https://doi-

org.ezproxy.lib.uconn.edu/10.1080/21501378.2018.1443006

Page 71: “Stop! In the Name of Civility”: Testing the Effectiveness

STOP! IN THE NAME OF CIVILITY: TESTING THE EFFECTIVENESS 66

Schmitt, N. (1994). Method bias: The importance of theory and measurement. Journal of

Organizational Behavior, 15, 393–398. http://dx.doi .org/10.1002/job.4030150504

Schmitt, N., & Kuljanin, G. (2008). Measurement invariance: Review of practice and

implications. Human Resource Management Review, 18, 210–222.

Schnake, M. (1991). Organizational citizenship: A review, proposed model, and research agenda.

Human Relations, 44, 735–759.

Schneider, B. (1975). Organizational climate: An essay. Personnel Psychology, 28, 447–479.

Schnell, R., Bachteler, T., & Reiher, J. (2010). Improving the use of self-generated identification

codes. Evaluation Review, 34, 391–418.

Schoorman, F. D., & Mayer, R. C. (2008). The value of common perspectives in self-reported

appraisals: You get what you ask for. Organizational Research Methods, 11(1), 148-159.

doi:10.1177/1094428107307168

Simon, L. S., Judge, T. A., & Halvorsen-Ganepola, M. D. K. (2010). In good company? A multi-

study, multi-level investigation of the effects of co-worker relationships on employee

well-being. Journal of Vocational Behavior, 76, 534–546. doi:10.1016/j.jvb.2010.01.006

Singer, J. D., & Willett, J. B. (2003). Applied longitudinal data analysis. New York: Oxford

University Press.

Sliter, M., Sliter, K., & Jex, S. (2012). The employee as a punching bag: The effect of multiple

sources of incivility on employee withdrawal behavior and sales performance. Journal of

Organizational Behavior, 33, 121–139. http://dx.doi.org/10.1002/job.767

Smith, C. A., Organ, D., & Near, J. P. (1983). Organizational citizenship behavior: Its nature and

antecedents. Journal of Applied Psychology, 68, 653– 663.

Page 72: “Stop! In the Name of Civility”: Testing the Effectiveness

STOP! IN THE NAME OF CIVILITY: TESTING THE EFFECTIVENESS 67

Spector, P. E., & Fox, S. (2002). An emotion-centered model of voluntary work behavior: Some

parallels between counterproductive work behavior and organizational citizenship

behavior. Human Resource Management Review, 12, 269–292.

Spector, P. E., & Fox, S. (2005). The stressor-emotion model of counterproductive work

behavior. In S. Fox & P. E. Spector (Eds.), Counterproductive work behavior:

Investigations of actors and targets (pp. 151-174). Washington, DC: American

Psychological Association.

Spector, P. E., Fox, S., Penney, L. M., Bruursema, K., Goh, A., & Kessler, S. (2006). The

dimensionality of counterproductivity: Are all counterproductive behaviors created

equal? Journal of Vocational Behavior, 68, 446–460.

http://dx.doi.org/10.1016/j.jvb.2005.10.005

Stevens, L. E., & Fiske, S. T. (1995). Motivation and cognition in social life: A social survival

perspective. Social Cognition, 13, 189–214. doi:10.1521/soco.1995.13.3.189

Tabachnick, B. G., & Fidell, L. S. (2013). Using multivariate statistics (6th ed.). Boston, MA:

Pearson.

Tajfel, H. (1974). Social identity and intergroup behaviour. Social Science Information, 13,

65-93.1975-11594-00110.1177/053901847401300204.

Tajfel, H., & Turner, J. C. (1979). An integrative theory of intergroup conflict. In W. G. Austin

& S. Worchel (Eds.), The social psychology of intergroup relations (pp. 33–47).

Monterey, CA: Brooks/Cole.

Tajfel, H., & Turner, J. C. (1986). The social identity theory of intergroup behavior. In S.

Worchel & W. G. Austin (Eds.), Psychology of intergroup relations (2nd ed., pp. 7–

24). Chicago: Nelson-Hall.

Page 73: “Stop! In the Name of Civility”: Testing the Effectiveness

STOP! IN THE NAME OF CIVILITY: TESTING THE EFFECTIVENESS 68

Taris, T. W., Bok, I. A., & Meijer, Z. Y. (1998). Assessing stability and change of psychometric

properties of multi-item concepts across different situations: A general approach. Journal

of Psychology, 132, 301–316.

Tedeshi, J. T., & Felson, R. B. (1994). Violence, aggression and coercive actions. Washington,

DC: American Psychological Association.

Tee, E. Y. J. (2015). The emotional link: Leadership and the role of implicit and explicit

emotional contagion processes across multiple organizational levels. The Leadership

Quarterly, 26(4), 654–670.

https://doiorg.ezproxy.lib.uconn.edu/10.1016/j.leaqua.2015.05.009

Thibaut, J. W., & Kelley, H. H. (1959). The social psychology of groups. New York: Wiley.

Torkelson, E., Holm, K., Bäckström, M., & Schad, E. (2016). Factors contributing to the

perpetration of workplace incivility: The importance of organizational aspects and

experiencing incivility from others. Work & Stress, 30(2), 115-131.

doi:10.1080/02678373.2016.1175524

Tripp, T. M., & Bies, R. J. (1997). What’s good about revenge? The avenger’s perspective. In R.

J. Lewicki, R. J. Bies, & B. H. Sheppard (Eds.), Research on negotiation in

organizations, Vol. 6 (pp. 145–160). Greenwich, CT: JAI Press.

Tripp, T. M., Bies, R. J., & Aquino, K. (2002). Poetic justice or petty jealousy? The aesthetics of

revenge. Organizational Behavior and Human Decision Processes, 89, 966–984.

Vancouver, J. B., Thompson, C. M., & Williams, A. A. (2001). The changing signs in the

relationships between self-efficacy, personal goals, and performance. Journal of Applied

Psychology, 86, 605-620.

Page 74: “Stop! In the Name of Civility”: Testing the Effectiveness

STOP! IN THE NAME OF CIVILITY: TESTING THE EFFECTIVENESS 69

Vandenberg, R. J., & Lance, C. E. (2000). A review and synthesis of the measurement invariance

literature: Suggestions, practices, and recommendations for organizational research.

Organizational Research Methods, 3, 4–70.

Viswesvaran, C., & Ones, D. S. (2000). Perspectives on models of job performance.

International Journal of Selection and Assessment, 8, 216–226.

Voelkle, M. C., & Oud, J. H. L. (2013). Continuous time modelling with individually varying

time intervals for oscillating and non-oscillating processes. British Journal of

Mathematical and Statistical Psychology, 66, 103–126.

Walsh, B. M. (2012). Workplace incivility training: A model of training effectiveness.

Dissertation Abstracts International, 73, 1302.

Walsh, B. M., Magley, V. J., Davies-Schrils, K. A., Marmet, M. D., Reeves, D. W., & Gallus, J.

A. (2008). Developing and validating a brief measure of workplace civility norms. In

J.A. Bunk (Chair), How Rude! Investigating the Complexity of Disrespectful Behaviors at

Work. Symposium presented at the annual meeting of the Society for Industrial and

Organizational Psychology, San Francisco, CA.

Walsh, B. M., Magley, V. J., Reeves, D. W., Davies-Schrils, K. A., Marmet, M. D., & Gallus, J.

A. (2012). Assessing workgroup norms for civility: The development of the civility

norms questionnaire-brief. Journal of Business and Psychology, 27, 407–420.

http://dx.doi.org/10 .1007/s10869-011-9251-4

Wanberg, C., Kammeyer-Mueller, J., & Marchese, M. (2006). Mentor and protégé predictors and

outcomes of mentoring in a formal mentoring program. Journal of Vocational Behavior,

69, 410–423. doi:10.1016/j.jvb.2006.05.010

Page 75: “Stop! In the Name of Civility”: Testing the Effectiveness

STOP! IN THE NAME OF CIVILITY: TESTING THE EFFECTIVENESS 70

Watkins, M. W., Glutting, J. J., & Youngstrom, E. A. (2005). Issues in subtest profile analysis.

In D. P. Flanagan & P. L. Harrison (Eds.), Contemporary intellectual assessment:

Theories, tests, and issues (2nd ed., pp. 251–268). New York, NY: Guilford.

Wayne, S. J., & Liden, R. C. (1995). Effects of impression management on performance ratings:

A longitudinal study. Academy of Management Journal, 38, 232–260.

doi:10.2307/256734

Weiss, H. M., & Cropanzano, R. (1996). Affective events theory: A theoretical discussion of the

structure, causes and consequences of affective experiences at work. In B. M. Staw & L.

L. Cummings (Eds.), Research in organizational behavior, Vol. 18, 1–74. Greenwich,

CT: JAI Press.

Widaman, K. F., Ferrer, E., & Conger, R. D. (2010). Factorial invariance within longitudinal

structural equation models: Measuring the same construct across time. Child

Development Perspectives, 4, 10–18.

Widaman, K. F., & Reise, S. P. (1997). Exploring the measurement invariance of psychological

instruments: Applications in the substance use domain. In K. J. Bryant, M. Windle, & S.

G. West (Eds.), The science of prevention: Methodological advances from alcohol and

substance abuse research (pp. 281–324). Washington, DC: American Psychological

Association.

Wilkins, J. (2014). The use of cognitive reappraisal and humour as coping strategies for bullied

nurses. International Journal of Nursing Practice, 20, 282-292. doi:10.1111/ijn.12146

Williams, L., & Anderson, S. (1991). Job satisfaction and organizational commitment as

predictors of organizational citizenship and in-role behaviors. Journal of Management,

17, 601-617.

Page 76: “Stop! In the Name of Civility”: Testing the Effectiveness

STOP! IN THE NAME OF CIVILITY: TESTING THE EFFECTIVENESS 71

Williams, G. A., & Kibowski, F. (2016). Latent class analysis and latent profile analysis. In L. A.

Jason & D. S. Glenwick (Eds.), Handbook of methodological approaches to community-

based research: Qualitative, quantitative, and mixed methods (pp. 143-151). New York:

Oxford University Press.

Wilson, N. L., & Holmvall, C. M. (2013). The development and validation of the Incivility From

Customers Scale. Journal of Occupational Health Psychology, 18, 310–326.

http://dx.doi.org/10.1037/a0032753

Wood, W., Christensen, P. N., Hebl, M. R., & Rothgerber, H. (1997). Conformity to sex-typed

norms, affect, and the self-concept. Journal of Personality and Social Psychology, 73,

523-535.

Xie, J. L., Roy, J., & Chen, Z. (2006). Cultural and individual differences in self-rating

behavior: An extension and refinement of the cultural relativity hypothesis. Journal of

Organizational Behavior, 27, 341–364. doi: 10.1002/job.375

Yip, J. A., Schweitzer, M. E., & Nurmohamed, S. (2018). Trash-talking: Competitive incivility

motivates rivalry, performance, and unethical behavior. Organizational Behavior and

Human Decision Processes, 144, 125-144. doi:10.1016/j.obhdp.2017.06.002

Zillmann, D. (1979). Hostility and aggression. Hillsdale, NJ: Erlbaum.

Zillmann, D. (1983). Arousal and aggression. In R. G. Geen & E. Donnerstein (Eds.),

Aggression: Theoretical and empirical reviews, Vol.1 (pp. 75–102). New York:

Academic Press.

Zillmann, D. (1988). Cognition-excitation interdependencies in aggressive behavior. Aggressive

Behavior, 14, 51–64.

Page 77: “Stop! In the Name of Civility”: Testing the Effectiveness

STOP! IN THE NAME OF CIVILITY: TESTING THE EFFECTIVENESS 72

Zillmann, D. (1993). Mental control of anger aggression. In D. M. Wegner & J. W. Pennebaker

(Eds.), Handbook of mental control (pp. 370–392). Englewood Cliffs, NJ: Prentice Hall.

Zillmann, D., Bryant, J., Cantor, J. R., & Day, K. D. (1975). Irrelevance of mitigating

circumstances in retaliatory behavior at high levels of excitation. Journal of Research in

Personality, 9, 282–293.

Page 78: “Stop! In the Name of Civility”: Testing the Effectiveness

STOP! IN THE NAME OF CIVILITY: TESTING THE EFFECTIVENESS 73

Footnote

1 Tables of descriptive statistics, reliability estimates, and agreement indices by

workgroup for each construct at each wave of data collection are available from the author upon

request.

Page 79: “Stop! In the Name of Civility”: Testing the Effectiveness

STOP! IN THE NAME OF CIVILITY: TESTING THE EFFECTIVENESS 74

Table 1

Discipline Composition By Shift Across Time By Training Wave

Training Wave 1 Training Wave 2

Time 1 Time 2 Time 3 Time 4 Time 1 Time 2 Time 3 Time 4

Employee

n

106 155 118 69 106 133 99 54

Workgroup

n

18 14 14 13 20 18 15 10

Medical/Dental-

1st shift

28 65 43 28 37 50 25 23

Mental Health-

1st shift

19 29 25 18 21 30 25 11

Clerical-1st shift 18 15 7 6 6 4 12 5

Discipline/Other-

1st shift

12 3 2 0 3 8 10 5

Medical/Dental-

2nd shift

11 19 19 10 19 21 16 5

Mental Health-

2nd shift

7 11 7 3 11 9 6 3

Clerical-2nd

shift

1 0 0 0 1 1 0 0

Discipline/Other-

2nd shift

0 0 1 0 0 0 0 0

Medical/Dental-

3rd shift

5 10 10 4 6 8 4 2

Mental Health-

3rd shift

0 0 1 0 0 0 0 0

Clerical-3rd shift 0 1 1 0 0 0 0 0

Discipline/Other-

3rd shift

0

0 1 0 0 0 0 0

Page 80: “Stop! In the Name of Civility”: Testing the Effectiveness

STOP! IN THE NAME OF CIVILITY: TESTING THE EFFECTIVENESS 75

Page 81: “Stop! In the Name of Civility”: Testing the Effectiveness

STOP! IN THE NAME OF CIVILITY: TESTING THE EFFECTIVENESS 76

Page 82: “Stop! In the Name of Civility”: Testing the Effectiveness

STOP! IN THE NAME OF CIVILITY: TESTING THE EFFECTIVENESS 77

Page 83: “Stop! In the Name of Civility”: Testing the Effectiveness

STOP! IN THE NAME OF CIVILITY: TESTING THE EFFECTIVENESS 78

Table 5

Results From Hypothesis Testing: Training Wave 1

Paths Tested S. E. Hypothesis

CIV T1 on CIV T2

CIV T2 on CIV T3

CIV T3 on CIV T4

-0.25* 0.11 1

0.06 0.12 1

-0.01 0.15 1

CIV T1 on COH T2

CIV T2 on COH T3

CIV T3 on COH T4

-0.02

-0.12

-0.21

0.17

0.15

0.17

2

2

2

COH T1 on CIV T2

COH T2 on CIV T3

COH T3 on CIV T4

-0.12

0.11

0.28**

0.12

0.11

0.11

3

3

3

COH T1 on PERF T2

COH T2 on PERF T3

COH T3 on PERF T4

-0.02

0.01

0.06

0.11

0.08

0.11

4

4

4

COH T1 on OCBI T2

COH T2 on OCBI T3

COH T3 on OCBI T4

0.04

-0.14

0.11

0.13

0.12

0.12

5

5

5

CIV T1 on OCBI T2

CIV T2 on OCBI T3

CIV T3 on OCBI T4

0.08

-0.02

-0.13

0.12

0.11

0.14

6

6

6

CIV T1 on PERF T2

CIV T2 on PERF T3

CIV T3 on PERF T4

-0.11

0.35***

0.01

0.13

0.10

0.16

7

7

7

CIV T1 on CNQ T2

CIV T2 on CNQ T3

CIV T3 on CNQ T4

0.15

0.18

0.23

0.16

0.17

0.19

8

8

8

COH T1 on CNQ T2

COH T2 on CNQ T3

COH T3 on CNQ T4

0.02

-0.19

0.03

0.13

0.10

0.12

9

9

9

CNQ T1 on OCBI T2

CNQ T2 on OCBI T3

CNQ T3 on OCBI T4

-0.12

-0.02

0.05

0.11

0.11

0.13

10

10

10 Note: CIV = Team Civility Experiences, CNQ = Team Civility Norms, COH = Team Cohesion, OCB-I = Team

Interpersonal Citizenship Behaviors, PERF = Team Job Performance, and T = Time *p < .05, **p < .01, ***p < .001

Page 84: “Stop! In the Name of Civility”: Testing the Effectiveness

STOP! IN THE NAME OF CIVILITY: TESTING THE EFFECTIVENESS 79

Table 6

Results From Hypothesis Testing: Training Wave 2

Paths Tested S. E. Hypothesis

CIV T1 on CIV T2

CIV T2 on CIV T3

CIV T3 on CIV T4

-0.12 0.12 1

0.004 0.13 1

-0.19 0.17 1

CIV T1 on COH T2

CIV T2 on COH T3

CIV T3 on COH T4

0.07

-0.20

-0.61***

0.17

0.17

0.15

2

2

2

COH T1 on CIV T2

COH T2 on CIV T3

COH T3 on CIV T4

0.04

-0.02

0.26

0.10

0.10

0.15

3

3

3

COH T1 on PERF T2

COH T2 on PERF T3

COH T3 on PERF T4

-0.08

0.12

0.06

0.10

0.11

0.11

4

4

4

COH T1 on OCBI T2

COH T2 on OCBI T3

COH T3 on OCBI T4

0.001

-0.08

-0.37**

0.12

0.12

0.14

5

5

5

CIV T1 on OCBI T2

CIV T2 on OCBI T3

CIV T3 on OCBI T4

-0.19

-0.07

0.30*

0.11

0.12

0.12

6

6

6

CIV T1 on PERF T2

CIV T2 on PERF T3

CIV T3 on PERF T4

-0.22*

-0.22*

-0.19

0.11

0.11

0.12

7

7

7

CIV T1 on CNQ T2

CIV T2 on CNQ T3

CIV T3 on CNQ T4

0.19

0.30

0.44

0.16

0.17

0.23

8

8

8

COH T1 on CNQ T2

COH T2 on CNQ T3

COH T3 on CNQ T4

-0.04

0.03

-0.06

0.11

0.10

0.18

9

9

9

CNQ T1 on OCBI T2

CNQ T2 on OCBI T3

CNQ T3 on OCBI T4

0.03

-0.04

-0.20

0.11

0.11

0.16

10

10

10 Note: CIV = Team Civility Experiences, CNQ = Team Civility Norms, COH = Team Cohesion, OCB-I = Team

Interpersonal Citizenship Behaviors, PERF = Team Job Performance, and T = Time *p < .05, **p < .01, ***p < .001

Page 85: “Stop! In the Name of Civility”: Testing the Effectiveness

STOP! IN THE NAME OF CIVILITY: TESTING THE EFFECTIVENESS 80

Figure 1. Model of Hypothesized Relationships

Figure 2. Timing of Civility Training Workshop and Survey Administration

Page 86: “Stop! In the Name of Civility”: Testing the Effectiveness

STOP! IN THE NAME OF CIVILITY: TESTING THE EFFECTIVENESS 81

Figure 3.

Figure 4.

Page 87: “Stop! In the Name of Civility”: Testing the Effectiveness

STOP! IN THE NAME OF CIVILITY: TESTING THE EFFECTIVENESS 82

Figure 5.

Figure 6.

Page 88: “Stop! In the Name of Civility”: Testing the Effectiveness

STOP! IN THE NAME OF CIVILITY: TESTING THE EFFECTIVENESS 83

Figure 7.

Figure 8.

Page 89: “Stop! In the Name of Civility”: Testing the Effectiveness

STOP! IN THE NAME OF CIVILITY: TESTING THE EFFECTIVENESS 84

Figure 9.

Figure 10.

Page 90: “Stop! In the Name of Civility”: Testing the Effectiveness

STOP! IN THE NAME OF CIVILITY: TESTING THE EFFECTIVENESS 85

Figure 11.

Figure 12.

Page 91: “Stop! In the Name of Civility”: Testing the Effectiveness

STOP! IN THE NAME OF CIVILITY: TESTING THE EFFECTIVENESS 86

Appendix

Survey Items

Climate For Civility Items

Civility Norms Questionnaire

Instructions: Please rate the extent to which you agree or disagree with each of the following

statements about your WORK GROUP.

1. We would be taken seriously if we complained about disrespectful treatment.

2. Rude behavior is not accepted in our work group.

3. We would have career problems if we were rude to others.

4. Angry outbursts are not tolerated by anyone in our work group.

5. Respectful treatment is the norm in our work group.

6. We make sure everyone in our work group is treated with respect.

7. People treat one another with respect in our work group.

Items are evaluated on a scale ranging from “1” (Strongly disagree) to “7” (Strongly agree).

Page 92: “Stop! In the Name of Civility”: Testing the Effectiveness

STOP! IN THE NAME OF CIVILITY: TESTING THE EFFECTIVENESS 87

Workplace Incivility Experiences Items

Instructions: During the PAST YEAR [PAST THREE MONTHS for Waves 2-4], were you ever

in a situation in which any of your supervisors or coworkers...

1. Gave you hostile looks, stares, or sneers.

2. Addressed you inappropriately or unprofessionally.

3. Interrupted or “spoke over” you.

4. Yelled, shouted, or swore at you.

5. Made insulting or disrespectful remarks to you.

6. Ignored you or failed to speak to you (for example, “the silent treatment”).

7. Stared at or leered at you in a way that made you feel uncomfortable.

8. Accused you of stupidity or incompetence.

9. Made jokes at your expense.

10. Physically threatened or intimated you.

11. Put you down or were condescending to you.

Items are evaluated on a scale ranging from “0” (Never) to “5” (Many times).

Page 93: “Stop! In the Name of Civility”: Testing the Effectiveness

STOP! IN THE NAME OF CIVILITY: TESTING THE EFFECTIVENESS 88

Workgroup Cohesion Items

Instructions: The following statements refer to the people you work with that you identified on

the previous page. In the items, “WE” and/or “WORK GROUP” refer to those individuals.

Please rate the extent to which you agree or disagree with each of the following statements.

1. We work well together as a team.

2. We pull together to get the job done.

3. We really care about each other.

4. We trust each other.

Items are evaluated on a scale ranging from “1” (Strongly disagree) to “7” (Strongly agree).

Page 94: “Stop! In the Name of Civility”: Testing the Effectiveness

STOP! IN THE NAME OF CIVILITY: TESTING THE EFFECTIVENESS 89

Job Performance Items

Self-Reported Job Performance Items

Instructions: How do you feel your performance is viewed by the SUPERVISOR who covers

your functional unit and has some input or influence over your evaluation? What does your

clinical supervisor (i.e., not you) think of …

1. … the quality of your work?

2. … the quality of your interactions with coworkers?

3. … the quality of your interactions with patients?

4. … your overall work performance?

Items are evaluated on a scale ranging from “1” (Poor) to “5” (Excellent)

Organizational Citizenship Behavior (Toward Co-Workers) Items

Instructions: The following statements refer to YOU AND YOUR WORK EXPERIENCES.

Please rate the extent to which you agree or disagree with each of the following statements.

1. I take a personal interest in the well-being of others (e.g., help new employees).

2. I pass along work-related information to others.

Items are evaluated on a scale ranging from “1” (Strongly disagree) to “7” (Strongly agree).