competency model design and assessment: findings · pdf filejpae 19 journal of public affairs...

31
Journal of Public Affairs Education 141 Competency Model Design and Assessment: Findings and Future Directions Heather Getha-Taylor, Raymond Hummert, John Nalbandian, and Chris Silvia University of Kansas ABSTRACT Competency models offer potential for defining effective and/or superior performance and then aligning curriculum and other learning opportunities with individual development goals. However, barriers exist that prevent optimal use of competency models, including difficulty identifying competencies and assessing development appropriately. This paper presents insights based on the design and implementation of a competency model for MPA students at the University of Kansas. Goals of this multiyear effort include (a) helping students assess their development as they progress through the MPA program, (b) linking competencies to curriculum and experiential learning opportunities, and (c) assessing progress using multiple evalua- tions over time. This paper considers associated challenges, including competency identification, assessment, and the need to capture emerging competencies. Today’s MPA students will face a host of challenges when practicing public management after graduation. To prepare them for that reality, NASPAA-accredited programs seek to “develop the skills and techniques used by leaders and managers to implement policies, projects, and programs that resolve important societal problems while addressing organizational, human resource, and budgetary challenges” (NASPAA, 2012). Of course, programs accomplish these tasks in various ways. Regardless of the approach taken, it is incumbent upon the faculty to assess how well students develop the skills, aptitudes, and perspectives they will need to operate successfully in their chosen profession and to develop habits of reflective self-assessment. One way to address this challenge is to use competency models that define the characteris- tics that result in effective and/or superior performance on the job (Boyatzis, 1982) and then align those competencies with curriculum and other learning opportunities. Keywords : competency models, student self-assessment, outcomes evaluation JPAE 19 (1), 141–171

Upload: dangngoc

Post on 06-Mar-2018

235 views

Category:

Documents


1 download

TRANSCRIPT

Page 1: Competency Model Design and Assessment: Findings · PDF fileJPAE 19 Journal of Public Affairs Education 141 Competency Model Design and Assessment: Findings and Future Directions Heather

Journal of Public Affairs Education 141

Competency Model Design and Assessment: Findings

and Future Directions

Heather Getha-Taylor, Raymond Hummert, John Nalbandian, and Chris Silvia

University of Kansas

abstract

Competency models offer potential for defining effective and/or superior performance and then aligning curriculum and other learning opportunities with individual development goals. However, barriers exist that prevent optimal use of competency models, including difficulty identifying competencies and assessing development appropriately. This paper presents insights based on the design and implementation of a competency model for MPA students at the University of Kansas. Goals of this multiyear effort include (a) helping students assess their development as they progress through the MPA program, (b) linking competencies to curriculum and experiential learning opportunities, and (c) assessing progress using multiple evalua-tions over time. This paper considers associated challenges, including competency identification, assessment, and the need to capture emerging competencies.

Today’s MPA students will face a host of challenges when practicing public management after graduation. To prepare them for that reality, NASPAA-accredited programs seek to “develop the skills and techniques used by leaders and managers to implement policies, projects, and programs that resolve important societal problems while addressing organizational, human resource, and budgetary challenges” (NASPAA, 2012). Of course, programs accomplish these tasks in various ways. Regardless of the approach taken, it is incumbent upon the faculty to assess how well students develop the skills, aptitudes, and perspectives they will need to operate successfully in their chosen profession and to develop habits of reflective self-assessment. One way to address this challenge is to use competency models that define the characteris-tics that result in effective and/or superior performance on the job (Boyatzis, 1982) and then align those competencies with curriculum and other learning opportunities.

Keywords: competency models, student self-assessment, outcomes evaluation

JPAE 19 (1), 141–171

Page 2: Competency Model Design and Assessment: Findings · PDF fileJPAE 19 Journal of Public Affairs Education 141 Competency Model Design and Assessment: Findings and Future Directions Heather

142 Journal of Public Affairs Education

Competency modeling offers a number of benefits, including a focus on both current and future individual development (Sanchez & Levine, 2009), but many barriers prevent its optimal use, including difficulty identifying competencies and assessing development appropriately (Op de Beeck & Hondeghem, 2010). Further, in teaching MPA students, we face the challenge of developing a competency-based assessment that acknowledges the differences in experiences and accomplishments of mid-career and pre-service students. This paper provides insights on these challenges based on the design and implementation of a competency model for MPA students at the University of Kansas. The goals of this multiyear effort include (a) helping students track their competency development as they progress through the MPA program, (b) linking competencies to curriculum and experiential learning oppor-tunities, and (c) assessing progress using multiyear data collection.

Scholarly literature indicates varied applications for competency models in the context of graduate education. Competency models can be used to respond to changing needs of the profession (Batalden, Leach, Swing, H. Dreyfus, & S. Dreyfus, 2002), help students prepare for leadership roles (Kleinman, 2003), and help faculty members and administrators respond to curriculum gaps (Johnson & Rivera, 2007; Rice, 2007). Further, such models can be used to design holistic educational approaches (Robotham & Jubb, 1996; Talbot, 2004; Tomkins, Laslo vich, & Greene, 1996) and contribute to lifelong professional development and learning (Rodolfa et al., 2005). Finally, we believe that engaging students with a compe-tencies model can promote the kind of self-reflection that adds value to the goal of lifelong learning. The challenge, of course, is identifying, defining, and assessing the competencies of interest for successful performance and aligning such competen-cies with educational components (McEvoy et al., 2005).

In this article, we examine the experience of the University of Kansas in applying its MPA competency model to pre-service students. Topics presented include (a) an overview of competency modeling and applications to an MPA curriculum; (b) the history, development, and purpose of the MPA competency model used by the University of Kansas; (c) a multiyear competency assessment data; and (d) consider ations for future directions and broader applications.

comPetency modeling and aPPlications to mPa curriculum

Describing the concept of “competencies” is the starting point. Competencies are those underlying characteristics, says Boyatzis (1982), that are “causally related to effective or superior performance in a job” (p. 21). Competencies move beyond traditional knowledge, skills, and abilities (KSAs) to capture job-related motives, traits, and self-concepts (Daley, 2002). Further, competencies are distinguishable from KSAs in that they focus on future development and potential for performance. To this end, competencies can help answer the question, “How do we know good performance when we see it?” Ideally, competencies can guide a number of critical

H. Getha-Taylor et al.

Page 3: Competency Model Design and Assessment: Findings · PDF fileJPAE 19 Journal of Public Affairs Education 141 Competency Model Design and Assessment: Findings and Future Directions Heather

Journal of Public Affairs Education 143

workforce functions, including hiring, development, and even evaluation. In the context of MPA education, competency models can help connect curriculum to desired outcomes and guide students in their professional development efforts.

Identifying and validating core competencies for MPA education rests on a process that includes competency identification and modeling, validation, and assessment. Beginning with identification and modeling, varied methods are available. Programs may adopt an existing model or may choose to develop an original model that draws on first-person accounts or expert panel data (L. Spencer & S. Spencer, 1993) to determine those characteristics related to effective or superior performance in the selected context. Next steps, regardless of the selection process, involve apply-ing the model and determining the validity of the selected competencies. A final and often forgotten step is continuous evaluation of the competency model. Just as workforce demands change with time, so too should competency models keep pace with emerging developmental needs (Getha-Taylor, 2008).

The contemporary emphasis on competencies reflects rapidly changing environ-ments that require skills extending beyond the boundaries of any one job and that indicate an individual’s ability to adapt and learn (Rodriguez, Patel, Bright, Gregory, & Growing, 2002). Further, a focus on technical, ethical, and leader-ship competencies helps ensure that public servants do things right and also do the right things (Bowman, West, Berman, & Van Wart, 2004). The rate of rapid change that affects public service also affects the continued validity of public service competency models. Ideally, such models should reflect current demands and help emerging public service professionals meet the challenges of the future.

Despite the promise of competency management, a number of difficulties for utilizing competency models in MPA programs are notable. First, real or perceived resource constraints (including financial resources, time, and in-house expertise) can stall competency efforts. Second, determining how best to select and/or develop original competency models for use in MPA programs presents a challenge. In addition, the utilization of these models and the reassessment to reflect contemporary development needs requires long-term commitment and continued attention. However, it is not the aim of this paper to focus exclusively on the challenges. Rather, our goal is to highlight both the need and opportunity for such initiatives.

Competency models speak to the related and critical instructional concepts of mastery and transference. To develop mastery, Ambrose and colleagues (2010) note that “students must acquire component skills, practice integrating them, and know when to apply what they have learned” (p. 95). Competency models can help students identify what they’ve learned and reflect on applications. Mastery, though, is a multiphase developmental process that includes two key dimensions: competence and consciousness (Sprague & Stuart, 2000). This process and its appli -cations to MPA competency models are presented in Table 1.

Competency Model Design and Assessment

Page 4: Competency Model Design and Assessment: Findings · PDF fileJPAE 19 Journal of Public Affairs Education 141 Competency Model Design and Assessment: Findings and Future Directions Heather

144 Journal of Public Affairs Education

Table 1.Developmental Stages and MPA Competency Applications

Level Stage Description MPA Competency Application

1 Unconscious incompetence

Students do not know what they don’t know

Consider initial assessment inflation

2 Conscious incompetence

Students are aware of what they need to learn

Interpretation of subsequent assessments

3 Conscious competence

Students have competence but must act deliberately

Consider development timeline

4 Unconscious competence

Students exercise skills auto-matically or instinctively

Integrate focus on long-term development

Source. Adapted from Ambrose et al. (2010) and Sprague and Stuart (2000).

It should be stressed that the mastery developmental process begins in a state where students not only lack competence but also are generally unaware of what they do not know. This situation may result in inflated initial self-assessments. As students progress in their education, it is expected that both their consciousness and competence will develop to help them identify what they are learning and what they still have to learn. True mastery occurs only when the initial stage of unconscious incompetence progresses to the final stage of unconscious competence: We want our students to have competence that can be used automatically and instinctively.

To this end, MPA programs aim to provide students with foundational learning opportunities and resources that they can apply to the practical challenges of governance. Key to effectiveness in this regard is the ability of students to transfer what they are learning to practical contexts. This goal, educational transference, rests on similar learning and application contexts and the ability of students to know how to apply what they are learning in the classroom to practical challenges (Ambrose et al., 2010). One way to improve transference is to give pre-service students opportunities to apply skills or knowledge, through such activities as service learning and/or internship experiences. The University of Kansas MPA program incorporates these components and also provides opportunities for student growth and reflection on the development process.

In addition to academic coursework and the internship experience, pre-service students participate in a series of professional development seminars with faculty members during their second year—their full-time internship year—that allow for group discussion, individual processing, and debriefing experiences. These reflective activities help illustrate how students apply what they have learned in the classroom to practical challenges. This approach is aligned with Schon’s (1983) “reflection-in-action” perspective, which emphasizes managing through turbu-

H. Getha-Taylor et al.

Page 5: Competency Model Design and Assessment: Findings · PDF fileJPAE 19 Journal of Public Affairs Education 141 Competency Model Design and Assessment: Findings and Future Directions Heather

Journal of Public Affairs Education 145

lence and uncertainty using observation and reflective conversation as a supple ment to technical knowledge. Together, it is expected that academic coursework, the yearlong internship experience, and the series of professional development seminars provide a total student experience that addresses the connected needs of mastery, reflection, and application.

learning From Project history

This section reports the approach and lessons learned from the University of Kansas (KU) portfolio and competencies project.1 The competencies project, the results of which are reported in this paper, grew out of a larger focus on portfolio development following a National Association of Schools of Public Affairs and Administration (NASPAA) accreditation visit in the early 2000s. Portfolio develop-ment was discussed with the site visit team and then pursued in conversations at KU with a faculty member invited from West Virginia University, where a portfolio requirement had been implemented. Seeking more information, the department chair and another faculty member at KU visited the Dean of the KU School of Architecture, where portfolios are commonplace. Of singular importance to our project was the dean’s observation that although a portfolio contains evidence of an architect’s work, most important for readers and viewers are reflective statements conveying why a particular artifact is in the portfolio and what movement from one project or style of architecture to another means to the architect.

From those beginnings, the project took off with a gathering of first-year pre-service MPA students and local government practitioners in the summer of 2001 to discuss what elements should be included in student portfolios. The first group of portfolios consisted of paper documents in three-ring binders, loosely organized around the International City/County Management Association (ICMA) competencies. The portfolio project progressed very slowly, in part because the university lacked enabling software and also because the department was working its way through portfolio purpose and design issues, including faculty roles. A key point occurred with a decision to link the portfolio assignment to development of a competencies matrix. The thinking was that student focus on competencies could provide an anchor for portfolios and help standardize their presentation.

Work on a competencies rubric began as an assignment in an MPA class in Human Resources Management. In that initial class, students were asked to search for lists of managerial/leadership competencies in public sector organizations and associations. They were encouraged to engage in a worldwide electronic search so they could understand that the movement toward competencies-based human resources management was not isolated to the United States.

Following that assign ment, in spring 2005, the department convened a meeting in Lawrence of representatives from regional NASPAA schools to talk about outcome-based education. Also, at a NASPAA conference in fall 2006, KU faculty presented a paper documenting our interest in outcome-based education and our progress toward developing a list of competencies.

Competency Model Design and Assessment

Page 6: Competency Model Design and Assessment: Findings · PDF fileJPAE 19 Journal of Public Affairs Education 141 Competency Model Design and Assessment: Findings and Future Directions Heather

146 Journal of Public Affairs Education

A significant point in the development of a rubric occurred when the Canadian Public Service (CPS) competencies project was discovered in preparation for the NASPAA panel. On its face, the CPS definition of public service and its broad categorization of competencies into four sections made so much sense that the department simply adopted it as written. The CPS conceptualization has given the KU rubric intellectual coherence, providing an intellectual guide for future discussions of curriculum. It should be restated that at the time the Canadian Public Service Model was discovered, the rubric was still in the class project stage. In other words, no formal faculty adoption of a rubric or its content was required. This situation greatly simplified development of the rubric and its intellectual underpinnings.

In a subsequent class with the same instructor, a small group of students accepted an assignment to review the lists the previous class had gathered and develop a matrix consisting of common competencies. The resulting rubric was presented to faculty, and two faculty members not originally involved in the project volunteered to review the rubric the students developed with an eye toward creating symmetry. Symmetry was needed regarding degree of specificity of the competencies (rows on the rubric) and also consistency in levels of achievement (columns on the rubric). Also, the two faculty members looked for obvious areas of content omission given our curriculum and MPA program focus.

Faculty acceptance, with minor changes, of the rubric attests to its face validity. That validity is drawn from the sources of the lists the students drew from to identify common competencies. The list included competencies identified and used by a local government, a state government, the ICMA, and the International Public Management Association–Human Resources (IPMA–HR), suggesting a sound professional public administration grounding in practice. Faculty confidence in the rubric was further enhanced when we saw how easily the competencies fit into the Canadian Public Service template, since the CPS model captured the KU public administration curriculum so nicely.

Even though faculty were not involved in the original development of the competencies rubric, as key stakeholders, they had endorsed the idea of student portfolios, which pre-career students were then required to prepare and then present to a faculty advisor during an internship seminar—where they were discussed—immediately before their graduation. Because the project developed the way it did, other than for the internship faculty member, its purposes did not intrude on faculty prerogatives and time.

As described later, our initial goal was student self-assessment, and because of the way the rubric was developed—drawing from professional practices—it was a rubric of career-long learning rather than learning isolated to an MPA curriculum alone. Eventually, we hoped to extend our goal from student self-assessment to curriculum reform. But the self-assessment purpose, the career-long focus of the rubric, and questions that might be raised about validity of the rubric—developed from preexisting lists—postponed that discussion to the present. In addition, the

H. Getha-Taylor et al.

Page 7: Competency Model Design and Assessment: Findings · PDF fileJPAE 19 Journal of Public Affairs Education 141 Competency Model Design and Assessment: Findings and Future Directions Heather

Journal of Public Affairs Education 147

student cohort we required to use the rubric was focused and had a faculty advisor. This approach meant that general faculty involvement in reviewing student progress could be minimized until the department was confident it was on a solid path.

Over time, our goals for the competencies project became clear: • Help students track development as they progress through the MPA

program both in the classroom and their internships.• Link competencies to curriculum and experiential learning opportunities.• Assess progress using both quantitative and qualitative evaluation.

Regarding the first goal, two aspects of the project argued for student self-assessment rather than third-party (faculty) assessment. First, the project did not begin with an explicit connection to the MPA curriculum. The rubric was drawn from other sources, and it represented career-long learning by professional public administrators rather than from a curriculum itself. Thus, objective third-party assessment by faculty of student progress in their MPA program seemed inappro-priate. Second, and more important, in the HR class where the competencies project originated, the idea that students and/or professionals are responsible for their own professional development was emphasized. Although feedback on progress is important to inform reflection, faculty assessment of student progress reinforces hierarchical accountability—a concept deemed inappropriate to career-long professional development.

To achieve the first goal, students are required periodically to report on their movement along the matrix. They are asked to pick any three of the competencies where they can report movement, to produce the evidence they have of movement, and then to reflect in writing about their movement—why it is important to them. We have produced a guide with examples of “evidence” artifacts and reflective statements. Faculty involvement to this point has been isolated to individual advisors, the faculty member who was involved with the project from the begin-ning, and to the school’s academic advisor. Responses to the student’s work are purposefully nonevaluative but are intended to provoke honesty, accuracy, and reflection. Faculty comments are often phrased as questions: “You have produced evidence of progress based on your work in a jurisdiction of 30,000; are you confi-dent you could do the same in a jurisdiction of 500,000?” What we have learned from reviewing student statements of progress is that often students think they have accomplished more than an experienced observer might agree with. We also saw that while working in their full-time internships, students occasionally saw themselves as knowing less than originally thought.

We have addressed this issue by re-conceptualizing the rubric from a flat screen to a cube. In other words, each box in the rubric contains depth, and progress may be seen in terms of building depth rather than moving horizontally. This method has relieved some student self-imposed incentive to show “progress” as horizontal movement toward mastery, and we think it has enabled students to be more honest with themselves.

Competency Model Design and Assessment

Page 8: Competency Model Design and Assessment: Findings · PDF fileJPAE 19 Journal of Public Affairs Education 141 Competency Model Design and Assessment: Findings and Future Directions Heather

148 Journal of Public Affairs Education

A key moment in the entire portfolio/competencies project occurred during one of the seminars when students were discussing their progress constructing portfolios. The discussion began to focus on what faculty expected when one of the graduating students blurted out poignantly and in frustration, “Screw it: It is not theirs!” This simple expression reinforced the idea that we were not trying to create another grading tool; we were trying to assist our students and graduates to plan and chart their careers. It was their responsibility, and we were providing a tool with the portfolio and the competencies rubric.

Moving to a discussion of the second goal, the most important question we face in linking the competencies to curriculum and experiential learning oppor-tunities is how much overlap we want in the MPA curriculum and competencies. At KU, our pre-career students have a part-time internship in their first year, and their second year consists of a full-time internship with three professional develop- ment seminars led by KU faculty. The second goal forces a reexamination of the view that the curriculum is the sole contribution to the student’s education. Linking the competencies rubric to our students’ total educational experience both in the classroom and out—as they define their educational experience—has led us to focus on the concept of the “totality of the student experience” rather than looking solely at the contribution that faculty make in class to a student’s education.

Faculty have been asked to identify in their syllabi the competencies covered in their classes. Interestingly, this request was met with no resistance by faculty. This result suggests that faculty members are quite attuned to the concept of competencies, and including references to the rubric in their syllabi is not an intrusion on their prerogatives or approach to learning.

Our intent is to use the data we now have about student progress to review the curriculum—which at KU includes substantial experiential learning for pre-career students. With the student self-assessment data, we now are able to identify pre-career student progress in their academic year on campus and also in their internship year. Rather than working from a preconceived notion of what competencies are required and shaping the curriculum in a traditional approach, we now have data we can use to determine what students are learning in their on campus year and what they are learning in their internships. These data, coupled with a general survey of intern supervisors at the conclusion of the internships on the preparedness of students, provide additional knowledge about students’ learning.

Our goal is to bring this information to faculty to inform a discussion of curriculum. This effort is significant in terms of the sequence of curriculum development, which often has an unspoken purpose of legitimizing faculty interest areas. Now, we truly will be focused on what students have reported as their learning. We now can ask more comfortably, “Shouldn’t they be learning

H. Getha-Taylor et al.

Page 9: Competency Model Design and Assessment: Findings · PDF fileJPAE 19 Journal of Public Affairs Education 141 Competency Model Design and Assessment: Findings and Future Directions Heather

Journal of Public Affairs Education 149

about X on campus?” In other words, the curriculum discussion will have a base grounded in data rather than one solely based on faculty understanding of the academic discipline, the field of professional practice, and their own intellectual connections to that practice and the discipline.

Turning now to the third goal, assessing progress through evaluation, at each stage in development of the competencies matrix and its connection to a portfo-lio requirement, we asked students for feedback. Their input reinforced the idea of self-assessment, but it also provided ideas on how we could or should use the matrix, involve faculty, and conceive of the project. We are now at a point where we can assess the results from separate cohorts on the competencies rubric. The quantitative results are presented in the next section.

data Findings The effort to gather and analyze quantitative data from student competency

self-assessments began with the intern-option KU MPA Class of 2009. At that time, data were collected at two specific points: at the beginning and end of the program. It was later determined that a third data collection point would be necessary to separate the effects of classroom experiences in year one and the internship/professional development seminars in year two. Beginning with the Class of 2010, data were collected at three separate points: (a) at the start of their academic coursework (Time Point 1), (b) at the end of their academic coursework (Time Point 2), and (c) at the end of their internship experience (Time Point 3). At each point, the students were asked to self-evaluate their competency in each of 29 areas of interest using a 5-point Likert Scale, where higher scores indicate greater perceived competencies. Although early versions of the matrix included labels for each Likert Scale point such as novice, appren-tice, and so forth, the current version has omitted these in favor of providing only a competency-based description of what is meant by each Likert Scale point (see Appendix B). At the time of this writing, complete data sets exist for two cohorts (Class of 2010 [n = 12] and Class of 2011 [n = 14]). The resulting data are analyzed and presented here.

Student self-assessments at the start of their program (Time Point 1) indicate that overall, conflict resolution, resource allocation, financial management, group dynamics, and understanding policy trends are the competencies students rate lowest, and thus are most in need of development (Figure 1). Initial assessments also reveal that, overall, student self-assessments identify strengths in individual differences, diversity, verbal communication, public service, and written commu-nication. These data serve as a starting point for the students as they learn and grow over the two years in the program and beyond.

Competency Model Design and Assessment

Page 10: Competency Model Design and Assessment: Findings · PDF fileJPAE 19 Journal of Public Affairs Education 141 Competency Model Design and Assessment: Findings and Future Directions Heather

150 Journal of Public Affairs Education

Figure 1.Initial Competency Self-Assessment Score

Note. A 5-point Likert Scale was used, where higher scores indicate greater perceived competencies.

Figure 2 considers the development that takes place over the first year in the MPA program. Student self-assessments from Time Point 1 and Time Point 2 are analyzed to consider the change that occurs as a result of classroom experiences and traditional instructional techniques. During the year of intensive academic coursework, students illustrate greatest developmental change related to resource allocation, group dynamics, policy trends, policy impact, and written communication. These findings are particularly interesting in two ways. First, given the self-assessed initial strength in written communication, it seems that although students perceived strength in this area, graduate coursework developed this competency even further. Second, the classroom experience seems well suited to addressing the competencies that students perceive in need of development, including resource allocation, group dynamics, and policy trends. Perhaps even more intriguing is the finding related to the diversity competency: Students generally reverse their initial strong self- assessment to indicate perhaps an improved understanding of what diversity really means in the context of public management. This finding supports the conclusion that many students enter the program with unconscious incompetence: They do not yet know what they do not know.

H. Getha-Taylor et al.

Lik

ert

Scal

e Sc

ore

3.5

3

2.5

2

1.5

1

0.5

0

Indi

vidu

al D

iffer

ence

s

Div

ersi

ty

Ver

bal C

omm

unic

atio

n

Publ

ic S

ervi

ce

Wri

tten

Com

mun

icat

ion

Dec

isio

n A

naly

sis

Col

labo

rati

on (

grou

p dy

nam

ics)

Inte

grit

y &

Eth

ics

Cre

ativ

ity

& I

nnov

atio

n

Long

-Ter

m O

utlo

ok

Evid

ence

-Bas

ed P

ract

ice

Info

Sys

tem

Man

agem

ent

Cit

izen

Eng

agem

ent

Tim

elin

ess

Wor

k in

Pol

itic

al E

nvir

onm

ent

Con

tino

us T

ech

Impr

ovem

ent

Ext

erna

l Pol

icy

Impa

ct

Serv

ice

Stan

dard

s &

Del

iver

y

Prod

ucti

vity

/Effi

cien

cy

Em

ploy

men

t Law

Cap

acit

y B

uild

ing

Con

flict

Pre

vent

ion

Polic

y Fo

rmat

ion

Polic

y Im

plem

enta

tion

Polic

y Tr

ends

Inte

rper

sona

l (gr

oup

dyna

mic

s)

Fina

ncia

l Man

agem

ent

Res

ourc

e A

lloca

tion

Con

flict

Res

olut

ion

Page 11: Competency Model Design and Assessment: Findings · PDF fileJPAE 19 Journal of Public Affairs Education 141 Competency Model Design and Assessment: Findings and Future Directions Heather

Journal of Public Affairs Education 151

Figure 2.Examining Development in Year 1: Impact of Classroom Experiences

Note. Scores represent the average change in Likert Scale scores between the initial assessment (Time Point 1) and the assessment at the end of the first year in the program (Time Point 2).

Figure 3 considers the developmental change that occurs in year two of the program, which involves a full-time internship and also professional development seminars. Findings indicate significant competency growth on policy formation, policy implementation, information system management, verbal communication, and collaboration. Again, it is notable that one of these (verbal communication) was identified as one of the initial competency strengths. Further, Figure 3 demon-strates the complementary impact the internship experience and professional development seminars have on coursework: It appears that these experiences support growth in needed competency areas, including collaboration and infor-mation system management. Finally, this figure indicates the development of mastery as revealed by the employment law competency. The data indicate that students provide a lower self-assessment on this competency after completing their internship and professional development experiences. This result suggests that students are learning to apply what they covered in the classroom to practical situations. Students’ reverse movement on this competency suggests two potential explanations. First, the reality of applying employment law to practical manage-ment challenges may have revealed the complexity of mastering this competency.

Competency Model Design and Assessment

Res

ourc

e A

lloca

tion

Inte

rper

sona

l (gr

oup

dyna

mic

s)

Polic

y Tr

ends

Ext

erna

l Pol

icy

Impa

ct

Wri

tten

Com

mun

icat

ion

Polic

y Fo

rmat

ion

Fina

ncia

l Man

agem

ent

Tim

elin

ess

Cap

acit

y B

uild

ing

Polic

y Im

plem

enta

tion

Cit

izen

Eng

agem

ent

Em

ploy

men

t Law

Wor

k in

Pol

itic

al E

nvir

onm

ent

Cre

ativ

ity

& I

nnov

atio

n

Prod

ucti

vity

/Effi

cien

cy

Con

tino

us T

ech

Impr

ovem

ent

Publ

ic S

ervi

ce

Dec

isio

n A

naly

sis

Ver

bal C

omm

unic

atio

n

Serv

ice

Stan

dard

s &

Del

iver

y

Con

flict

Res

olut

ion

Info

Sys

tem

Man

agem

ent

Col

labo

rati

on (

grou

p dy

nam

ics)

Indi

vidu

al D

iffer

ence

s

Inte

grit

y &

Eth

ics

Con

flict

Pre

vent

ion

Evid

ence

-Bas

ed P

ract

ice

Long

-Ter

m O

utlo

ok

Div

ersi

ty

Ave

rage

Cha

nge

in L

iker

t Sc

ale

Scor

e

0.70

0.60

0.50

0.40

0.30

0.20

0.10

0.00

–0.10

Page 12: Competency Model Design and Assessment: Findings · PDF fileJPAE 19 Journal of Public Affairs Education 141 Competency Model Design and Assessment: Findings and Future Directions Heather

152 Journal of Public Affairs Education

Second, this finding may suggest that the curriculum needs updating to ensure students are receiving adequate training before beginning their internships.

Figure 3.Examining Development in Year 2: Impact of Internship and Professional Development Experiences

Note. Scores represent the average change in Likert Scale scores between the assessment at the end of Year 1 in the program (Time Point 2) and the assessment at the end of Year 2 in the program (Time Point 3).

To present a picture of the overall change in competency ratings over the course of the two-year program, Figure 4 combines the developmental changes that occurred during both the academic coursework (see Figure 2) and the internship/professional development experiences (see Figure 3). Unlike Figure 4, which depicts the change in competency self-assessment, Figure 5 focuses on the average Likert Scale score for each competency. It combines the data taken at each of the three time points to present a cumulative bar chart of the average competency self-assessment. Together, these figures provide an opportunity for discussion related to strengths and strategic adjustments for the future. For instance, they can help faculty members identify competency areas that are developed effectively in the classroom (e.g., group dynamics, resource allocation, policy impact, and written communication) and those that are effectively addressed through internship and other professional development activities (e.g., policy implementation, verbal communication, information system management, evidence-based practice, and long-term impact).

H. Getha-Taylor et al.

Ave

rage

Cha

nge

in L

iker

t Sc

ale

Scor

e

1.00

0.90

0.80

0.70

0.60

0.50

0.40

0.30

0.20

0.10

0.00

–0.10

Polic

y Fo

rmat

ion

Polic

y Im

plem

enta

tion

Info

Sys

tem

Man

agem

ent

Ver

bal C

omm

unic

atio

n

Col

labo

rati

on (

grou

p dy

nam

ics)

Inte

rper

sona

l (gr

oup

dyna

mic

s)

Prod

ucti

vity

/Effi

cien

cy

Con

tino

us T

ech

Impr

ovem

ent

Inte

grit

y &

Eth

ics

Evid

ence

-Bas

ed P

ract

ice

Long

-Ter

m O

utlo

ok

Wor

k in

Pol

itic

al E

nvir

onm

ent

Con

flict

Res

olut

ion

Polic

y Tr

ends

Wri

tten

Com

mun

icat

ion

Fina

ncia

l Man

agem

ent

Publ

ic S

ervi

ce

Serv

ice

Stan

dard

s &

Del

iver

y

Div

ersi

ty

Res

ourc

e A

lloca

tion

Dec

isio

n A

naly

sis

Cap

acit

y B

uild

ing

Cit

izen

Eng

agem

ent

Indi

vidu

al D

iffer

ence

s

Con

flict

Pre

vent

ion

Cre

ativ

ity

& I

nnov

atio

n

Ext

erna

l Pol

icy

Impa

ct

Tim

elin

ess

Em

ploy

men

t Law

Page 13: Competency Model Design and Assessment: Findings · PDF fileJPAE 19 Journal of Public Affairs Education 141 Competency Model Design and Assessment: Findings and Future Directions Heather

Journal of Public Affairs Education 153

Figure 4.Overall Program Impact on Competencies

Figure 5.Student Competency Self-Assessments Over Time

Competency Model Design and Assessment

Polic

y Fo

rmat

ion

Inte

rper

sona

l (gr

oup

dyna

mic

s)

Polic

y Im

plem

enta

tion

Polic

y Tr

ends

Res

ourc

e A

lloca

tion

Wri

tten

Com

mun

icat

ion

Fina

ncia

l Man

agem

ent

Ver

bal C

omm

unic

atio

n

Prod

ucti

vity

/Effi

cien

cy

Cap

acit

y B

uild

ing

Wor

k in

Pol

itic

al E

nvir

onm

ent

Info

Sys

tem

Man

agem

ent

Con

tino

us T

ech

Impr

ovem

ent

Col

labo

rati

on (

grou

p dy

nam

ics)

Ext

erna

l Pol

icy

Impa

ct

Publ

ic S

ervi

ce

Inte

grit

y &

Eth

ics

Con

flict

Res

olut

ion

Cit

izen

Eng

agem

ent

Evid

ence

-Bas

ed P

ract

ice

Dec

isio

n A

naly

sis

Serv

ice

Stan

dard

s &

Del

iver

y

Long

-Ter

m O

utlo

ok

Cre

ativ

ity

& I

nnov

atio

n

Tim

elin

ess

Indi

vidu

al D

iffer

ence

s

Con

flict

Pre

vent

ion

Div

ersi

ty

Em

ploy

men

t Law

Ave

rage

Cha

nge

in L

iker

t Sc

ale

Scor

e

Likert Scale Score

1.40

1.20

1.00

0.80

0.60

0.40

0.20

0.00

–0.20

Change Linked to Classroom Experience Change Linked to Classroom Experience Adjustment to After-Internship Experience

0.00 0.50 1.00 1.50 2.00 2.50 3.00 3.50 4.00

Conflict Resolution Resource Allocation

Financial Management Interpersonal (group dynamics)

Policy TrendsPolicy Implementation

Policy FormationConflict Prevention

Capacity BuildingEmployment Law

Productivity/Efficiency Service Standards & Delivery

External Policy ImpactContinuous Tech Improvement Work in Political Environment

Timeliness Citizen Engagement

Info System ManagementEvidence-Based Practice

Long-Term OutlookCreativity & Innovation

Integrity & Ethics Collaboration (group dynamics)

Decision AnalysisWritten Communication

Public ServiceVerbal Communication

DiversityIndividual Differences

Initial Measurement (Time Period 1)

Adjustment of Measurement at Time Period 2

Midpoint Measurement (Time Period 2)

Adjustment of Measurement at Time Period 2

Final Measurement (Time Period 3)

Page 14: Competency Model Design and Assessment: Findings · PDF fileJPAE 19 Journal of Public Affairs Education 141 Competency Model Design and Assessment: Findings and Future Directions Heather

154 Journal of Public Affairs Education

These figures also illustrate the impact of time and application for key concepts covered in the classroom. Notably, competency areas like integrity/ethics, collabo-ration, and diversity, which are addressed in curriculum, may not be fully under stood until students have opportunities to apply these concepts in practice. This speaks to the developmental principle of conscious competence, which emerges only over time. In addition, these figures reveal areas of opportunity for the future curriculum changes such as conflict resolution, conflict prevention, decision analysis, and service standards and delivery. Students did not feel that their competence in these areas grew as much relative to their reported growth in other areas. Overall, these figures illustrate the totality of the student experience, including both classroom and applied experiences, and the complementary impact these activities have on competency development overall.

discussion

The findings present an opportunity to extend this discussion beyond the university context in which these data were collected to consider three broad themes: (a) the totality of the MPA student experience, (b) the developmental stages of mastery, and (c) implications for program decisions, including curriculum choices.

Regarding the first broad theme, the data illustrate the distinctions between first- and second-year assessments. This finding speaks to the totality of the student experience, including both the classroom learning experiences and the second-year full-time internship experience facilitated by professional develop-ment seminars. These intern-option students illustrate different developmental gains through participating in these separate but related activities. This result speaks to the key educational goal of transference. Although the data illustrate distinct developmental differences, it is notable that the classroom experiences are supple- mented with opportunities to apply foundational lessons to practice. It is important to note that career-option students—who are not part of our project to date—may illustrate different developmental patterns, given their work experiences.

In addition, the data reveal changes that suggest reflection and reassessment. Interpreted on the average, some competency components reveal lower self-assessment following the completion of program components. This finding supports the work of Sprague and Stuart (2000) that describes mastery as a developmental process that involves the gradual recognition of competence (or incompetence). Initial assessments on some competency dimensions are inflated because students do not yet know what they do not know. As they gain classroom and internship experi-ence, they become more conscious of their developmental needs as academic themes are highlighted in practice.

The data speak to the final theme in several ways. First, competency assess-ments can help faculty members make data-based curriculum decisions by identify ing curricular strengths and needs. Second, the data can highlight the program components that are best developed through classroom instruction or internships. Third, competency assessments can become an important segment

H. Getha-Taylor et al.

Page 15: Competency Model Design and Assessment: Findings · PDF fileJPAE 19 Journal of Public Affairs Education 141 Competency Model Design and Assessment: Findings and Future Directions Heather

Journal of Public Affairs Education 155

of a “balanced scorecard” approach to MPA program evaluation when combined with student reviews upon graduation and assessments of students by intern supervisors. This approach helps determine the continued relevance of the model and its components.

Finally, competency models can help programs align their efforts with broad priorities that are shared by other public administration programs across the nation and even around the world. Especially when programs choose to adopt and apply existing models, these goals can be met more easily. Crafting an original competency model may prove a useful exercise for legitimizing the program and its curriculum, but it is not the position of this paper to advocate for either approach. Rather, its aim is to encourage programs to determine the approach best suited for their needs.

conclusion

Although this paper presents the University of Kansas MPA competency model and assessment experience, we expect that the findings and discussion may help other programs evaluate their current development and evaluation methods to balance continued focus areas and emerging needs. All NASPAA-accredited programs are expected to develop competencies in five domains: (a) leading and managing in public governance; (b) participating in and contribut-ing to the policy process; (c) analyzing, synthesizing, thinking critically, solving problems, and making decisions; (d) articulating and applying a public service perspective; and (e) communicating and interacting productively with a diverse and changing workforce and citizenry. The KU MPA program competency model captures these domains. Moving forward, it is expected that this program and others will further develop and refine competency models to meet these expectations and reflect program-specific content and concentrations (Powell, Piskulich, & Saint-Germain, 2011).

Based on our experience with the KU competency model, a number of issues should be considered when designing, implementing, and evaluating a competency model.

1. The competency model should attempt to align the broader priorities of the academic and practitioner communities. Although both groups have a similar goal in that they have a vested interest in the development of future public servants, faculty and practitioners can sometimes have different views on how that development should occur and what types of conceptual understandings and skills should be developed. Though different, these two perspectives are important and the voices representing both perspectives should be heard. This takes time and effort, but it is one way to help make sure that the model remains relevant. When engaging the practitioner community, it is important to seek out those who value the competency initiative and who can be expected to participate thoughtfully in the conversation.

Competency Model Design and Assessment

Page 16: Competency Model Design and Assessment: Findings · PDF fileJPAE 19 Journal of Public Affairs Education 141 Competency Model Design and Assessment: Findings and Future Directions Heather

156 Journal of Public Affairs Education

2. Another voice that should be heard is that of the students. As such, students and faculty should share the responsibility of developing, implementing, and revisiting the competency model. Because both groups will be closely working with the model, their individual and collective buy-in is paramount. In addition, if student self-assessment is to become part of the competency initiative, attention should be paid to rewards and/or punishments that will foster honesty.

3. The competency model should capture the totality of the student experience. It should be realized that student learning is not restricted to the classroom. Although the internship aspect of the KU MPA program is unique, the vast majority of MPA programs incorporate at least a summer internship experience. In addition, many MPA programs provide, support, and encourage service learning, volunteer-ism, and the like. The learning that occurs during these other types of experiential learning should be reflected in the model because it will affect student competency.

4. A significant output of the competency model project can be the collection of data. As mentioned earlier, the model should contain learning objectives and areas of competency that are seen as import-ant by the faculty in consultation with a thoughtful practitioner community. The data can and should be used to help the faculty understand how they and the program are helping to meet the learning goals established in the model. Faculty can see areas in which the program is succeeding and those in which it is not. The faculty can then engage in a data-based curriculum discussion to improve the program where needed.

5. Competency models also provide an opportunity to illustrate developmental gains over time. This is particularly the case with models that employ a self-assessment aspect, because they enable students to compare where they were in regards to a competency to where they are now. This knowledge can build awareness, confidence, and an appreciation of the value added by the program, and it can reinforce a commitment to continuing professional development after graduation as a responsibility of the student.

6. Developmental gains should not be seen solely as an increase in a competency. As was seen in the data presented earlier, the perceived competency of our students in a few cases actually decreased. This could be because the students inflated their previous competency and realized that on a subsequent self-assessment. However, this insight can be a good thing and demonstrate an increased awareness of the competency itself. It could occur as the students come to appreciate

H. Getha-Taylor et al.

Page 17: Competency Model Design and Assessment: Findings · PDF fileJPAE 19 Journal of Public Affairs Education 141 Competency Model Design and Assessment: Findings and Future Directions Heather

Journal of Public Affairs Education 157

the complexity of an area of public administration and realize that they are not as advanced in an area as they originally thought.

7. There is value in supplementing the competency assessment with reflective statements from the students. It is one thing for students to give themselves competency scores; it is another for students to reflect upon what that score means to them. Again, this is another method of building personal responsibility for future professional development and continuous professional learning.

8. Although competency models should be continuously revisited to ensure that the content is appropriate, too many changes can pose significant problems. Multiple competency model versions may introduce additional complexity in administration. If development of competencies is the goal, the model must remain constant so that repeat measures of the same competency can be taken. Therefore, it is recommended that models remain the same for a cohort during the entire course of their program.

9. Finally, links between the competency model and program components should be identified and evaluated. If the competency model is a true reflection of what the faculty sees as valuable, the courses offered should be explicitly tied to one or more expected competencies. The reverse should also be true. The faculty should ensure that the competencies are all linked to at least one program component.

Additional questions remain to be considered. First, this effort illustrates the importance of phased data collection but focuses primarily on self-assessment: How should faculty members balance student self-assessment data with external evaluations from instructors and/or internship supervisors? Connected to this issue, what are the implementation costs associated with analyzing multiple forms of assessment? Further, how should we interpret these forms of assessment and connect them to program outcomes? Consideration of these questions leads to an understanding of the integral relationship between classroom feedback and grades from faculty and the student self-assessment process. Without a founda-tion of faculty evaluation, an academic program would lack credibility. But a self-assessment element introduces a critical element of self-responsibility, and sharing those self-assessments in a seminar setting introduces the idea of mutual accountability as well.

Another question centers on whether competency models should differ for varied student groups: Should we develop customized competency models for part-time, pre-service, and in-career students? Or, should we reconsider the evaluation schedule for these groups? It is expected that the competency model can serve to focus the MPA student experience, but important questions remain on how best to design and evaluate progress on the model. In addition, programs

Competency Model Design and Assessment

Page 18: Competency Model Design and Assessment: Findings · PDF fileJPAE 19 Journal of Public Affairs Education 141 Competency Model Design and Assessment: Findings and Future Directions Heather

158 Journal of Public Affairs Education

should consider the issue of faculty buy-in. Effective integration of competency models depends on faculty investment, and it will be important to use the model as a way to enhance communication and address any concerns related to instruc-tional autonomy. Finally, continually validating over time presents a challenge: How should we integrate competency feedback from alumni, internship supervi-sors, and/or other stakeholders in the future?

Competency management for MPA educational purposes will require a long- term investment and continual reevaluation. Bowman and colleagues (2010) note that “public service has been greatly affected by the rapidly changing context within which it is organized”; there has been and will continue to be changes in the “(1) technical, (2) internal, (3) external, and (4) managerial environments that encompass the organization and delivery of public services” (p. 7). Competency assessment is an iterative process that involves faculty members as learners. To this end, faculty members must be sufficiently invested in the process to ensure that both methods and applications are revisited on an ongoing basis. In the case of the KU MPA program, efforts are under way to revisit the competency model to ensure its continued applicability. It is expected that faculty, students, alumni, and program stakeholders will be involved in these discussions.

The ever-changing context of public sector work requires that existing compe-tency models be revisited to identify congruence (or lack thereof ) between competency models and changing leadership needs. Although these investments may seem substantial, we hold that the collective investment in competency management can be regarded as an investment in public leadership development and one that contributes to the shared goal of preparing students to manage in a changing public sector landscape (Berry, 2010).

Footnote1 A chronology of the project appears as Appendix A to this paper.

reFerencesAmbrose, S. A., Bridges, M. W., DiPietro, M., Lovett, M. C., & Norman, M. K. (2010). How learning

works: 7 Research-based principles for smart teaching. Jossey-Bass.

Batalden, P., Leach, D., Swing, S., Dreyfus, H., & Dreyfus, S. (2002). General competencies and accreditation in graduate medical education. Health Affairs, 21(5), 103–111.

Berry. F. S. (2010). The changing climate for public affairs education. Journal of Public Affairs Education, 17(1), 1–6.

H. Getha-Taylor et al.

Page 19: Competency Model Design and Assessment: Findings · PDF fileJPAE 19 Journal of Public Affairs Education 141 Competency Model Design and Assessment: Findings and Future Directions Heather

Journal of Public Affairs Education 159

Bowman, J. S., West, J. P., & Beck, M. A. 2010. Achieving competencies in public service: The professional edge (2nd ed.). Armonk, NY: M. E. Sharpe.

Bowman, J. S., West, J. P., Berman, E. M., & Van Wart, M. (2004). Professional edge: Competencies in public service. Armonk, NY: M. E. Sharpe.

Boyatzis, A. R. (1982). The competent manager: A model for effective performance. New York: Wiley.

Daley, D. M. (2002). Strategic human resource management: People and performance management in the public sector. Upper Saddle River, NJ: Prentice Hall.

Getha-Taylor, H. (2008). Identifying collaborative competencies. Review of Public Personnel Administration, 28(2), 103–119.

Johnson, R. G., & Rivera, M. A. (2007). Refocusing graduate public affairs education: A need for diversity competencies in human resource management. Journal of Public Affairs Education, 13(1), 15–27.

Kleinman, C. S. (2003). Leadership roles, competencies, and education. Journal of Nursing Administration, 33(9), 451–455.

McEvoy, G. M., Hayton, J. C., Warnick, A. P., Mumford, T. V., Hanks, S. H., & Blahna, M. J. (2005). A competency-based model for developing human resource professionals. Journal of Management Education, 29(3), 383–402.

National Association of Schools of Public Affairs and Administration. (NASPAA). (2012). What is an MPA/MPP degree? Retrieved from http://www.naspaa.org

Op de Beeck, S., & Hondeghem, A. (2010). Managing competencies in government: State of the art practices and issues at stake for the future. Organization for Economic Cooperation and Development (OECD). Retrieved from http://soc.kuleuven.be/io/ned/project/pdf/hrm27_GOV_GC_PEM(2010).pdf

Powell, D., Piskulich, M., & Saint-Germain, M. (2011). NASPAA White paper: Expectations for student learning outcomes assessment for NASPAA-COPRA accreditation. Retrieved from http://www.naspaa.org/accreditation/NS/24%20COPRA%20Appendix%204%20White%20Paper%20Competencies.pdf

Rice, M. F. (2007). Promoting cultural competency in public administration and public service delivery: Utilizing self-assessment tools and performance measures. Journal of Public Affairs Education, 13(1), 41–57.

Robotham, D., & Jubb, R. (1996). Competences: Measuring the unmeasurable. Management Development Review, 9(5), 25–29.

Rodolfa, E., Bent, R., Eisman, E., Nelson, P., Rehm, L., & Ritchie, P. (2005). A cube model for competency development: Implications for psychology educators and regulators. Professional Psychology: Research and Practice, 36(4), 347–354.

Rodriguez, D., Patel, R., Bright, A., Gregory, D., & Gowing, M. K. (2002). Developing competency models to promote integrated human resource practices. Human Resource Management, 41(3), 309–324.

Competency Model Design and Assessment

Page 20: Competency Model Design and Assessment: Findings · PDF fileJPAE 19 Journal of Public Affairs Education 141 Competency Model Design and Assessment: Findings and Future Directions Heather

160 Journal of Public Affairs Education

Sanchez, J. I., & Levine, E. L. (2009). What is (or should be) the difference between competency modeling and traditional job analysis? Human Resource Management Review, 19(2), 53–63.

Schon, D. A. (1983). The reflective practitioner: How professionals think in action. New York: Basic Books.

Spencer, L. M., & Spencer, S. M. (1993). Competence at work: Models for superior performance. New York: Wiley.

Sprague, J., & Stuart, D. (2000). The speaker’s handbook. Fort Worth, TX: Harcourt College Publishers.

Talbot, M. (2004). Monkey see, monkey do: A critique of the competency model in graduate medical education. Medical Education, 38(6), 587–592.

Tompkins, J., Laslovich, M. J., & Greene, J. D. (1996). Developing a competency-based MPA curriculum. Journal of Public Affairs Education, 2(2), 117–130.

Heather Getha-Taylor is an assistant professor in the School of Public Affairs and Administration at the University of Kansas. Her teaching and research interests focus on human resource management and collaborative governance.

Ray Hummert is on the staff of the School of Public Affairs and Administration at the University of Kansas. He has a MPA from the University of Kansas. Before joining the University, he worked for over 30 years in local government management in cities in California, Nebraska, Missouri, and Kansas.

John Nalbandian is a professor in the School of Public Affairs and Administration. He teaches human resources management to MPA students, and he has been involved with the competencies project since its initiation.

Chris Silvia is an assistant professor in the School of Public Affairs and Administration at the University of Kansas. His teaching and research interests focus on the leadership and management of intersectoral networks and public and nonprofit service delivery.

H. Getha-Taylor et al.

Page 21: Competency Model Design and Assessment: Findings · PDF fileJPAE 19 Journal of Public Affairs Education 141 Competency Model Design and Assessment: Findings and Future Directions Heather

Journal of Public Affairs Education 161

aPPendix a

Chronology of Portfolio and Competencies Project

Chronological HistoryCompetency/Portfolio ProjectUniversity of Kansas

Prepared by Raymond Hummert, Academic Advisor, School of Public Affairs and Administration

March 7, 2001: Faculty, Practitioner, and Student representatives met with Dr. David G. Williams, West Virginia University, to discuss professional portfolios and the West Virginia assessment model. Discussion on the use of portfolios included

• Faculty evaluation of student performance• Personal self-evaluation• Career planning• Job search tool

March 30, 2001: Chuck Epp and John Nalbandian met with John Gaunt, dean of School of Architecture and Urban Design, to discuss use of portfolio by architects. In the field, portfolios were used for a long time that were generally graphic narratives that showed past professional development as well as well as had a limited use for future development. Portfolio concept solidified.

April–May 2001: Faculty begins discussing portfolio concepts.August 2001: Faculty approves Student Portfolio Policy.Summer 2001: Faculty, practitioners, and Intern Option students meet for

the first time to discuss the portfolio project. The discussion centered on ICMA competencies. Importance of faculty review was emphasized.

Summer 2002: Faculty meets with second class of Intern Option students. Bill Carswell, School of Architecture and Urban Design, to discuss use of portfo-lios by architects made presentation. List of competencies were expanded beyond ICMA. Creativity and flexibility were encouraged as a professional development tool. Review by supervisors, faculty, and others encouraged.

April 2003: Portfolios were discussed and reviewed by outside consultant (Bill Hansell). Emphasis was on professional development. Portfolio Project was evaluated by first class. Results were mixed, but generally favorable with encour-agement to proceed with the recommendations:

• Portfolios took two forms: (a) Compilation of materials and reflection and (b) Expanded resume.

• Use a faculty mentor.• Share with mentors other than faculty.

Competency Model Design and Assessment

Page 22: Competency Model Design and Assessment: Findings · PDF fileJPAE 19 Journal of Public Affairs Education 141 Competency Model Design and Assessment: Findings and Future Directions Heather

162 Journal of Public Affairs Education

Summer 2003: Faculty meets with third class of Intern Option students to discuss portfolios. Portfolios in the academic setting were discussed with represent- atives from the Writing Center, English Department, California State University, Long Beach, and the University of Kansas Portfolio project. Emphasis was given to process, importance of writing, and reflective nature of portfolio.

October 2003: Portfolio discussion was made part of Professional Develop-ment Seminar.

April 2004: Personal development was emphasized along with professional development in professional Development Center. Consultant reviewed/discussed portfolios (Jim Keene). Evaluation of second class of Intern Option students. Response was good to concept. Recommendations included

• Use as a self-development tool.• Use as a tool to connect with students.• Connect students with faculty in the second year of MPA program.

Summer 2004: Faculty meets with Intern and Career option students. Discussion centered on use of portfolio as professional and personal development. Process was better defined with emphasis on reflection, writing, evaluation, and lifelong learning process.

April 2005: Consultant (Linda Barton) and Practitioner in Residence (Carol Gonzales) discussed portfolios and continual learning. Portfolios have to be individualized to be relevant. Evaluation of third class. Portfolio better used by students. Consultants were impressed by concept. The discussion emphasized the individuality of the process/document. “Screw it! It is not theirs.”

April 2005: John Nalbandian convenes the Mid America Competency Summit to discuss learning in PA Departments. Representatives from regional NASPAA schools attended an afternoon session at KU to talk about outcomes based education and where their schools were programmatically. MU, UNO, UMKC, and Iowa State University (via phone) were present as well as NASPAA representatives: Steven Maynard-Moody, Laurel McFarland (NASPAA executive director via conference phone)

Spring 2006: Hummert surveys graduates on use of portfolios. Graduates responding to the survey recommended

• Provide students a better outline of what needs to be learned, or define competencies more clearly.

• Provide guidelines and a mechanism for both the student and the person evaluating the student.

Spring 2006: Nalbandian assigned an optional research paper in PUAD 834 on competencies. It consisted of

• A review of literature • A collection of lists and identification of competencies that

commonly appear in managerial/public service arena

H. Getha-Taylor et al.

Page 23: Competency Model Design and Assessment: Findings · PDF fileJPAE 19 Journal of Public Affairs Education 141 Competency Model Design and Assessment: Findings and Future Directions Heather

Journal of Public Affairs Education 163

Fall 2006: Nalbandian presented a paper at the NASPAA conference in Minneapolis on the project.

Fall 2006: Nalbandian made another optional research assignment in PUAD 834 to develop a rubric of competencies. This placed the competencies within the Canadian Public Service framework, which identified components of each competency (vertical element of the rubric) and levels of competence (horizontal elements)

Spring 2007: The rubric was given to graduating intern option students, who spent a morning discussing its values and drawbacks.

Fall 2007: Students participating in a PUAD 831 project reviewed the content of the rubric with the goal of achieving vertical and horizontal alignment.The rubric will be presented to all incoming students. The Intern Option students will anchor the boxes in the rubric with case studies provided from interviews with local government professionals who attend the ICMA annual conference. And Career Option students in PUAD 845 will find cases to describe the boxes.

Fall 2007: All incoming MPA students were presented the competency rubric and portfolio. They developed three additional documents. They were reflective essay guidelines; artifacts examples; and faculty expectations and student obligations.

Fall 2007: Met with second-year Intern Option students and suggested continuum instead of rubric, depth to the rubric, and continue to emphasize flexibility. “No KUCIMAT left behind program.” NOT!

Fall 2007: University IT agreed to do a feasibility study of an electronic portfolio that would include the competency rubric.

May 2008: The first-year students of the 2009 class leaving campus are asked where they are on the competency rubric.

Fall 2008: The electronic portfolio is tested by students.October 2008: At the Richmond ICMA Professional Development Seminar,

students of the 2009 class are asked where they are on the competency rubric.April 2009: At the last Professional Development meeting for the 2009

class, students are asked where they are on competency rubric.May 2009: As the 2010 class leaves campus, they are asked where they are

on the competency rubric.June 2009: Students in the incoming class of 2011 are asked where they are

on the competency rubric.August 2009: The electronic competency rubric and portfolio is activated

and moved to production server.January 2010: After testing electronic rubric and portfolio with students, it

was abandoned as a platform.March 2010: KU Center for Teaching Excellence demonstrates KU Keeps as

a platform for portfolios.

Competency Model Design and Assessment

Page 24: Competency Model Design and Assessment: Findings · PDF fileJPAE 19 Journal of Public Affairs Education 141 Competency Model Design and Assessment: Findings and Future Directions Heather

164 Journal of Public Affairs Education

Spring 2010: Continue to collect data from first- and second-year students on their placement on rubric.

August 2010: Getha-Taylor and Silvia join Nalbandian and Hummert in working on competencies and portfolios.

September 2010: Developed concept of electronic resume to develop, store, and present portfolio information.

October 2010: Explored Digication as a platform for rubric, portfolio, and electronic resume, which seemed promising.

November 2010: Presented to faculty two years of student data.Spring 2011: Continue to collect data from first- and second-year students

on their placement on rubric, which will be the beginning of four full years of data.April 2011: Students experiment using web-based sites for portfolios.

the Future

Phase I:• Refine competency rubric using information from faculty.• Connect the competency rubric to the curriculum and require a higher

level of confidence in the rubric. Students would be asked at the end of the semester to indicate which competencies were covered in a particular course.

• Use web-based sites for portfolios.

Phase II: Use the rubric to objectively evaluate student progress. This phase requires the highest level of confidence in the validity of the rubric.

H. Getha-Taylor et al.

Page 25: Competency Model Design and Assessment: Findings · PDF fileJPAE 19 Journal of Public Affairs Education 141 Competency Model Design and Assessment: Findings and Future Directions Heather

Journal of Public Affairs Education 165

aPPendix b

University of Kansas Competencies MatrixI.

Val

ues

& E

thic

s (s

ervi

ng w

ith

inte

grit

y an

d re

spec

t)

1D

iver

sity

M

anag

emen

t1

23

45

Indi

vidu

al

Diff

eren

ces

Litt

le e

xper

ienc

e in

w

orki

ng w

ith

peop

le

from

a d

iffer

ent b

ack-

grou

nd.

Aw

are

of th

e im

por-

tanc

e of

indi

vidu

al

diff

eren

ces.

Dem

onst

rate

s re

spec

t fo

r di

ffer

ence

in p

eopl

e in

ow

n pe

rson

al a

nd

prof

essi

onal

act

ions

.

Enc

oura

ges

othe

rs to

re

spec

t and

pro

vide

fair

an

d eq

uita

ble

trea

tmen

t fo

r all

peop

le. A

rtic

ulat

es

bene

fits

of in

divi

dual

di

ffer

ence

to o

ther

s.

Incu

lcat

es o

rgan

izat

ion-

w

ide

reco

gnit

ion

of

the

bene

fits

diff

eren

ces

brin

g to

the

orga

niza

tion

and

the

com

mun

ity.

Div

ersi

tyU

naw

are

of d

if-fe

renc

es b

etw

een

cultu

res,

eth

nici

ties

, an

d gr

oups

.

Aw

are

of th

e im

por-

tanc

e of

div

ersi

ty.

Dem

onst

rate

s sen

sitiv

ity

tow

ard

and

appr

ecia

-ti

on o

f div

ersi

ty in

ow

n pe

rson

al a

nd p

rofe

s-si

onal

act

ions

.

Enc

oura

ges

othe

rs to

va

lue

dive

rsit

y in

th

e w

orkp

lace

.

Stre

ngth

ens

orga

niza

-ti

on b

y in

tegr

atin

g di

vers

ity

into

op

erat

ing

cultu

re.

Em

ploy

men

t Law

Litt

le k

now

ledg

e of

em

ploy

men

t law

.U

nder

stan

ding

the

basi

cs o

f em

ploy

- m

ent l

aw.

App

lies

prin

cipl

es

empl

oym

ent l

aw in

pe

rson

al a

nd p

rofe

s-si

onal

act

ions

.

Enc

oura

ges

othe

rs to

un

ders

tand

and

fair

ly

appl

y pr

ovis

ion

of

empl

oym

ent l

aw.

Prom

otes

org

aniz

atio

n-al

cul

ture

that

adh

eres

to

the

lett

er o

f the

law

, an

d al

so v

alue

s th

e sp

irit

of t

he la

w.

2P

rofe

ssio

nalis

m1

23

45

Publ

ic S

ervi

ceD

oes

not d

isti

ngui

sh

betw

een

com

mit

men

t to

pub

lic s

ervi

ce a

nd

wor

king

in th

e

publ

ic s

ecto

r.

Gra

sps

the

mea

ning

of

com

mit

men

t to

publ

ic

serv

ice.

Dem

onst

rate

s co

mm

it-

men

t to

publ

ic s

ervi

ce

in p

erso

nal a

nd p

rofe

s-si

onal

act

ions

.

Inst

ills

in o

ther

s a

com

mit

men

t to

publ

ic

serv

ice.

Insp

ires

an

orga

niza

-ti

onal

com

mit

men

t to

publ

ic s

ervi

ce.

Inte

grit

y &

Eth

ics

Min

imal

und

erst

and-

ing

of th

e ro

le th

at

ethi

cs a

nd in

tegr

ity

play

in e

ffec

tive

pu

blic

ser

vice

.

Res

pect

s im

port

ance

of

inte

grit

y an

d et

hica

l re

ason

ing

in p

ublic

se

rvic

e an

d is

in fo

rmed

of

rel

ated

law

s, r

ules

, an

d re

gula

tion

s.

Dem

onst

rate

s in

tegr

ity

and

ethi

cal r

easo

ning

in

pers

onal

and

pro

fess

iona

l ac

tions

and

com

plie

s with

re

late

d re

quir

emen

ts.

Enc

oura

ges

othe

rs to

ac

t wit

h in

tegr

ity,

to

empl

oy e

thic

al r

easo

n-in

g, a

nd to

res

pect

re

late

d ru

les,

reg

ula-

tion

s, a

nd la

ws.

Ele

vate

s in

tegr

ity

and

ethi

cal r

easo

ning

as

defin

ing

orga

niza

tion

al

char

acte

rist

ics.

Competency Model Design and Assessment

Page 26: Competency Model Design and Assessment: Findings · PDF fileJPAE 19 Journal of Public Affairs Education 141 Competency Model Design and Assessment: Findings and Future Directions Heather

166 Journal of Public Affairs Education

II. S

trat

egic

Thi

nkin

g (i

nnov

atin

g th

roug

h an

alys

is a

nd id

eas)

1A

dmin

istr

ativ

e Po

licy

Mak

ing

12

34

5

Polic

y

Form

ulat

ion

Has

a li

mit

ed k

now

-le

dge

of p

olic

y fo

r-m

ulat

ion

proc

esse

s.

Aw

are

of h

ow p

olic

y pr

oces

ses

wor

k.Pa

rtic

ipat

es e

ffec

tive

ly in

po

licy-

mak

ing

init

iati

ves.

Has

led

an e

ffec

tive

po

licy-

mak

ing

team

or

eff

ort.

Set o

vera

ll or

gani

zati

onal

pol

icy

dire

ctio

n an

d se

rves

as

over

arch

-in

g po

licy

entr

epre

neur

.

Polic

y Im

ple-

men

tati

onSi

mpl

isti

c un

der-

st

andi

ng o

f how

po

licy

gets

impl

e-m

ente

d.

Bas

ic a

nd s

ound

und

er-

stan

ding

of t

he im

por-

tanc

e of

pol

icy

impl

e-m

enta

tion

str

ateg

y.

Play

s a

role

in th

e

impl

emen

tati

on o

f ad

opte

d po

licy.

Lead

s po

licy

im

plem

enta

tion

ef

fort

or

team

.

Res

pons

ible

for

real

izat

ion

of

orga

niza

tion

’s po

licy

goal

s.

Polic

y Tr

ends

Una

war

e of

pol

icy

tren

ds th

at m

ay

impa

ct o

rgan

izat

ion.

Aw

are

of p

olic

y tr

ends

th

at m

ay im

pact

th

e or

gani

zati

on.

Is m

indf

ul o

f the

impa

ct o

f po

licy

tren

ds in

per

sona

l and

pr

ofes

sion

al a

ctio

ns.

Enc

oura

ges

wor

k

grou

p to

con

side

r

broa

der

polic

y tr

ends

.

Inte

grat

es tr

ends

into

org

aniz

a-ti

on’s

polic

y m

akin

g an

d

stra

tegi

c pl

anni

ng.

2In

nova

tion

12

34

5

Cre

ativ

ity

&

Inno

vati

onU

naw

are

of th

e ne

ed c

reat

ivit

y or

in

nova

tion

.

App

reci

ates

val

ue

of c

reat

ivit

y in

the

wor

kpla

ce.

Dem

onst

rate

s cr

eati

vity

in

pers

onal

and

pro

fess

iona

l ac

tion

s.

Enc

oura

ges

crea

tivi

ty

amon

g co

wor

kers

an

d st

aff.

Dev

elop

s a

wor

k en

viro

nmen

t th

at e

ncou

rage

s cr

eati

ve

solu

tion

s th

at le

ad to

org

aniz

a-ti

onal

impr

ovem

ents

.

3St

rate

gic

M

anag

emen

t1

23

45

Long

-Ter

m

Out

look

Lim

ited

aw

aren

ess

of

long

-ter

m is

sues

or

nee

ds.

Dev

elop

s lon

g-te

rm p

er-

spec

tive

on

orga

niza

-ti

onal

issu

es a

nd n

eeds

.

Fact

ors l

ong-

term

con

sequ

ence

s an

d ob

ject

ives

into

per

sona

l an

d pr

ofes

sion

al a

ctio

ns.

Res

pons

ible

for a

con

duct

-in

g st

rate

gic

plan

ning

te

am o

r ac

tivi

ties

.

Art

icul

ates

an

orga

niza

tion

al v

i-si

on th

at fr

ames

str

ateg

ic p

lans

.

Cap

acit

y

Bui

ldin

gU

naw

are

of o

rgan

i-za

tion

al c

apac

itie

s.A

war

e of

org

aniz

atio

nal

capa

citi

es.

Part

icip

ates

in e

ffor

ts to

de

fine

and

expa

nd n

eede

d or

gani

zati

onal

cap

acit

ies.

Lead

s a

team

eff

ort t

o de

fine

and

expa

nd n

eede

d or

gani

zati

onal

cap

acit

ies.

Alig

ns v

isio

n, s

trat

egic

pla

nnin

g,

and

capa

city

dev

elop

men

t.

Suffi

cien

t cap

acit

y is

rea

lized

to

achi

eve

orga

niza

tion

al v

isio

n

and

plan

s.

H. Getha-Taylor et al.

Page 27: Competency Model Design and Assessment: Findings · PDF fileJPAE 19 Journal of Public Affairs Education 141 Competency Model Design and Assessment: Findings and Future Directions Heather

Journal of Public Affairs Education 167

III.

Eng

agem

ent

(mob

ilizi

ng p

eopl

e, o

rgan

izat

ions

, & p

artn

ers)

1C

omm

unic

atio

n1

23

45

Ver

bal

Bas

ic v

erba

l com

mun

ica-

tion

ski

lls.

Col

lege

-lev

el

spea

king

ski

lls.

Eff

ecti

vely

com

mun

icat

es

rega

rdin

g ow

n pe

rson

al

and

prof

essi

onal

act

ions

(e

.g.,

conf

erri

ng w

ith

colle

ague

s an

d re

port

ing

to s

uper

iors

).

Eff

ecti

vely

com

mun

icat

es

wit

hin

depa

rtm

ent o

r w

orkg

roup

(e.

g., s

taff

m

eeti

ngs,

dep

artm

enta

l br

iefin

gs).

Eff

ecti

ve a

t pub

lic c

om-

mun

icat

ion

and

clea

rly

and

resp

onsi

bly

arti

cu-

late

s or

gani

zati

on’s

mis

-si

on a

nd a

ctiv

itie

s (e

.g.,

give

s ef

fect

ive

spee

ches

, te

stim

ony,

is c

omfo

rtab

le

in p

ublic

dis

cour

se).

Wri

tten

Bas

ic w

riti

ng s

kills

.C

olle

ge-l

evel

w

riti

ng a

bilit

y.E

ffec

tive

ly w

rite

s fo

r pe

rson

al a

nd p

rofe

ssio

nal

need

s (e

.g.,

inte

rnal

m

emos

, let

ters

, and

st

aff r

epor

ts).

Ens

ures

eff

ecti

ve w

riti

ng

from

uni

t/w

orkg

roup

(i

nclu

des

abili

ty to

edi

t, e.

g., b

udge

t nar

rati

ves,

de

part

men

tal r

epor

ts,

polic

y st

atem

ents

).

Ens

ures

eff

ecti

ve

orga

niza

tion

al

wri

tten

com

mun

icat

ion

(inc

lude

s ed

itin

g, e

.g.,

pres

s re

leas

es, a

nnua

l re

port

s, le

gisl

ativ

e te

sti-

mon

y, s

trat

egic

pla

ns).

2C

onfl

ict

12

34

5

Res

olut

ion

Inex

peri

ence

in

con

flict

res

olut

ion.

Aw

are

of d

iffer

ent

proc

esse

s fo

r

confl

ict r

esol

utio

n.

Wor

king

fam

iliar

ity

w

ith

at le

ast o

ne

AD

R te

chni

que.

Invo

lved

in th

e fo

rmal

re

solu

tion

of a

con

flict

an

d sk

ills

soug

ht b

y ot

hers

.

Cre

ates

org

aniz

atio

nal

cultu

re th

at r

ecog

nize

s an

d re

solv

es c

onfli

cts

as

they

ari

se.

Prev

enti

onU

naw

are

of h

ow to

pr

even

t con

flict

in th

e w

orkp

lace

.

Und

erst

ands

and

use

s pr

oper

pro

toco

l to

prev

ent e

scal

atio

n of

w

ork-

rela

ted

confl

icts

.

Ant

icip

ates

and

take

s

appr

opri

ate

acti

ons

to

avo

id d

etri

men

tal

confl

icts

in

the

wor

kpla

ce.

Prov

ides

cou

nsel

to

indi

vidu

als

in e

arly

st

ages

of w

orkp

lace

co

nflic

t and

enc

oura

ges

indi

vidu

als

to

take

app

ropr

iate

pr

even

tive

act

ion.

Cre

ates

org

aniz

atio

nal

cultu

re, w

here

con

flict

is

rec

ogni

zed

in

earl

iest

sta

ges

and

has

syst

emat

ic m

eans

for

earl

y re

solu

tion

.

Competency Model Design and Assessment

Page 28: Competency Model Design and Assessment: Findings · PDF fileJPAE 19 Journal of Public Affairs Education 141 Competency Model Design and Assessment: Findings and Future Directions Heather

168 Journal of Public Affairs Education

III.

Eng

agem

ent

(mob

ilizi

ng p

eopl

e, o

rgan

izat

ions

, & p

artn

ers)

con

tinu

ed

3E

xter

nal A

war

enes

s1

23

45

Wor

king

in a

Pol

iti-

cal E

nvir

onm

ent

Una

war

e of

inex

tric

able

lin

k be

twee

n po

licy

an

d po

litic

s.

Rec

ogni

zes

the

de

moc

rati

c va

lues

th

at p

olit

ics

adds

to

polic

y m

akin

g.

Is m

indf

ul o

f app

ropr

iate

po

litic

al c

onsi

dera

tion

s in

his

or

her

pers

onal

an

d pr

ofes

sion

al p

olic

y-m

akin

g ac

tion

s.

Hel

ps w

orkg

roup

ap-

prec

iate

how

pol

itic

s in

form

s po

licy

mak

ing,

an

d vi

ce v

ersa

Wor

ks to

mai

ntai

n al

ign-

men

t bet

wee

n or

gani

za-

tion

’s po

licy

goal

s an

d po

litic

al s

uppo

rt.

Ext

erna

l Pol

icy

Impa

ctN

ot a

war

e of

ext

erna

l st

akeh

olde

rs.

Aw

are

of e

xter

nal s

take

-ho

lder

s an

d th

eir

inte

rest

s

Eff

ecti

vely

con

side

rs

exte

rnal

sta

keho

lder

s an

d th

eir

inte

rest

s in

per

sona

l an

d pr

ofes

sion

al a

ctio

ns.

Enc

oura

ges

wor

k gr

oup

to u

nder

stan

d an

d ad

-dr

ess

exte

rnal

sta

keho

ld-

ers

and

thei

r in

tere

sts.

Ensu

res t

hat e

xter

nal

stak

ehol

ders

are

vie

wed

as

legi

tim

ate

part

ners

and

ha

ve a

n ap

prop

riat

e vo

ice

in th

e or

gani

zati

on.

Cit

izen

Eng

agem

ent

Doe

s no

t und

erst

and

that

pub

lic s

ervi

ce e

xist

s to

ser

ve th

e in

tere

sts

and

need

s of

cit

izen

s.

App

reci

ates

that

pub

lic

serv

ice

exis

ts to

ser

ve

the

need

s of

cit

izen

s an

d is

fam

iliar

wit

h ba

sic

tech

niqu

es o

f cit

izen

en

gage

men

t.

Serv

ing

need

s of

cit

izen

s is

at t

he h

eart

of p

erso

nal

and

prof

essi

onal

act

ions

an

d is

ski

lled

plan

ning

an

d co

nduc

ting

cit

izen

en

gage

men

t.

Hel

ps w

orkg

roup

und

er-

stan

d th

e pu

blic

ser

vice

ex

ists

to s

erve

the

pub-

lic’s

need

s an

d de

velo

ps

in o

ther

s ef

fect

iven

ess

in

citi

zen

enga

gem

ent.

Fost

ers

an o

rgan

izat

iona

l cu

lture

that

is sk

illed

and

co

mm

itted

to u

sing

citiz

en

enga

gem

ent a

s an

esse

ntia

l co

mpo

nent

of p

olic

y pl

an-

ning

and

impl

emen

tatio

n.

4G

roup

Dyn

amic

s1

23

45

Inte

rper

sona

lH

as b

asic

sel

f- a

war

e-ne

ss a

nd s

ensi

tivi

ty to

ne

eds

of o

ther

s in

gro

up

sett

ing.

Has

use

d fo

rmal

inst

ru-

men

ts (

e.g.

, Mey

ers-

Bri

ggs,

NB

TI,

SD

I, o

r ot

her)

to a

sses

s in

terp

er-

sona

l ski

lls.

Info

rmat

ion

from

form

al

asse

ssm

ent i

nfor

ms

pers

onal

and

pro

fess

iona

l be

havi

or.

Eff

ecti

vely

man

ages

gr

oup’

s in

terp

erso

nal

skill

s an

d dy

nam

ics

pro-

mot

ing

grou

p ef

fect

ive-

ness

.

Ens

ures

dev

elop

men

t of

orga

niza

tion

’s in

terp

er-

sona

l ski

lls s

uffic

ient

to

eng

age

the

need

s of

em

ploy

ees,

cit

izen

s, a

nd

stak

ehol

ders

.

Col

labo

rati

onIn

expe

rien

ced

in c

ol-

labo

rati

ve e

ffor

ts.

Som

e ex

peri

ence

in

colla

bora

tive

eff

orts

an

d aw

are

of c

osts

and

be

nefit

s of

col

labo

rati

on

and

com

peti

tion

.

Req

uire

d to

wor

k in

a

colla

bora

tive

fash

ion

in

pers

onal

and

pro

fess

iona

l ac

tivi

ties

.

Lead

s co

llabo

rati

ve e

f-fo

rts

wit

hin

wor

kgro

up/

unit

(e.

g., p

olic

y de

vel-

opm

ent t

eam

or

annu

al

plan

ning

ret

reat

s).

Ens

ures

eff

ecti

ve c

ol-

labo

rati

on b

oth

wit

hin

the

orga

niza

tion

and

am

ong

the

orga

niza

tion

’s st

akeh

olde

rs.

H. Getha-Taylor et al.

Page 29: Competency Model Design and Assessment: Findings · PDF fileJPAE 19 Journal of Public Affairs Education 141 Competency Model Design and Assessment: Findings and Future Directions Heather

Journal of Public Affairs Education 169

IV. M

anag

emen

t E

xcel

lenc

e (d

eliv

erin

g th

roug

h ac

tion

man

agem

ent,

peo

ple

man

agem

ent,

& fi

nanc

ial m

anag

emen

t)

1D

ecis

ion

Mak

ing

12

34

5

Tim

elin

ess

Aw

are

only

of p

erso

nal

dead

lines

.U

nder

stan

ds v

alue

of

tim

elin

es a

nd d

ead-

lines

ass

ocia

ted

wit

h th

e de

cisi

on-m

akin

g pr

oces

ses.

Eff

ecti

vely

est

ablis

hes

tim

elin

es, a

nd w

orks

ef

fect

ivel

y w

ith

com

pet-

ing

dead

lines

ass

ocia

ted

wit

h de

cisi

on-m

akin

g pr

oces

ses.

Alig

ns g

roup

act

ivit

ies

wit

h ti

min

g of

dec

isio

n-m

akin

g pr

oces

ses

and

is

seen

as

a re

sour

ce in

tim

e m

anag

emen

t and

dec

ision

-m

akin

g pr

oces

ses.

Rec

ogni

zes

mom

ents

of

opp

ortu

nity

and

act

s to

adv

ance

the

or

gani

zati

on’s

goal

s.

Evid

ence

-Bas

ed

Prac

tice

Lim

ited

und

erst

andi

ng

of li

nks

betw

een

info

r-m

atio

n, a

naly

tica

l too

ls,

and

deci

sion

mak

ing.

Sees

the

need

to li

nk

info

rmat

ion

and

anal

yti-

cal t

hink

ing

and

tool

s to

de

cisi

on m

akin

g.

Eff

ecti

vely

link

s in

form

a-ti

on, a

naly

tica

l thi

nkin

g,

and

tool

s to

dec

isio

n m

akin

g in

per

sona

l and

pr

ofes

sion

al a

ctio

ns.

Aw

are

of in

form

atio

n an

d in

form

atio

n ga

ps

need

ed to

sup

port

the

deci

sion

-mak

ing

proc

ess

wit

hin

a un

it o

r de

part

-m

ent a

nd e

ffec

tive

ly

com

mun

icat

es n

eeds

an

d ga

ps to

oth

ers.

A

ble

to g

uide

oth

ers

in

syst

emat

ic c

olle

ctiv

ely

of

info

rmat

ion

and

appl

ica-

tion

of i

nfor

mat

ion

to

deci

sion

mak

ing.

Dev

elop

s an

d im

ple-

men

ts a

str

ateg

ic p

lan

to g

athe

r in

form

atio

n ne

eded

to s

uppo

rt d

eci-

sion

mak

ing

wit

hin

the

orga

niza

tion

.

Dec

isio

n A

naly

sis

Act

s on

dec

isio

ns m

ade

else

whe

re.

Rec

ogni

zes

that

dec

isio

n m

akin

g ar

ises

from

ch

oosi

ng a

mon

g av

ail-

able

opt

ions

.

Dev

elop

s, c

onsi

ders

, an

d ev

alua

tes

diff

eren

t op

tion

s in

per

sona

l and

pr

ofes

sion

al a

ctio

ns.

Enc

oura

ges

wor

kgro

up

to g

ener

ate

and

con-

side

r va

riou

s op

tion

s fo

r ag

ency

dec

isio

ns.

Cre

ates

an

orga

niza

tion

al

cultu

re w

here

opt

ions

are

cu

ltiva

ted

and

cons

id-

ered

, but

hol

ds d

ecis

ion-

mak

ing

resp

onsi

bilit

y.

Competency Model Design and Assessment

Page 30: Competency Model Design and Assessment: Findings · PDF fileJPAE 19 Journal of Public Affairs Education 141 Competency Model Design and Assessment: Findings and Future Directions Heather

170 Journal of Public Affairs Education

IV. M

anag

emen

t E

xcel

lenc

e (d

eliv

erin

g th

roug

h ac

tion

man

agem

ent,

peo

ple

man

agem

ent,

& fi

nanc

ial m

anag

emen

t) c

onti

nued

2Fi

nanc

ial R

esou

rce

Man

agem

ent

12

34

5

Res

ourc

e A

lloca

tion

Litt

le e

xpos

ure

to b

asic

bu

dget

pro

cess

es.

Und

erst

andi

ng o

f bas

ic

budg

et p

rinc

iple

s, p

rac-

tice

s, a

nd p

roce

sses

.

Profi

cien

cy in

bas

ic

budg

et p

repa

rati

on.

Prep

ares

bud

get a

nd in

-te

grat

es a

udit

and

oth

er

perf

orm

ance

info

rmat

ion

for

an e

ntir

e un

it, w

ork-

grou

p, o

r de

part

men

t.

Des

igns

and

gui

des

budg

et p

roce

ss to

re

ach

desi

red

orga

niza

-ti

onal

out

com

es.

Fina

ncia

l Man

agem

ent

Litt

le e

xpos

ure

to c

ore

finan

cial

doc

umen

ts

(bal

ance

she

et, c

ash

flow

st

atem

ent,

and

acti

vity

st

atem

ent)

.

Rea

ds a

nd in

terp

rets

ba

sic fi

nanc

ial d

ocum

ents

.E

ffec

tive

ly u

ses

finan

cial

do

cum

ents

to g

uide

re

sour

ce m

anag

emen

t de

cisi

ons

in p

erso

nal a

nd

prof

essi

onal

act

ions

.

Use

s fin

anci

al d

ocu-

men

ts to

gui

de r

esou

rce

man

agem

ent d

ecis

ions

an

d op

erat

ions

in u

nit

or d

epar

tmen

t.

Use

s fin

anci

al d

ocu-

men

ts to

gui

de o

rgan

iza-

tion

’s m

anag

emen

t and

op

erat

iona

l dec

isio

ns.

3In

form

atio

n

Man

agem

ent

&

Tech

nica

l U

nder

stan

ding

12

34

5

Info

rmat

ion

Syst

em

Man

agem

ent

Has

bas

ic

com

pute

r sk

ills.

Gen

eral

com

pute

r sk

ills

in a

ddit

ion

to a

war

enes

s of

sys

tem

s co

nten

t plu

s ca

paci

ty.

Use

s sy

stem

con

tent

s an

d ca

paci

ties

in p

er-

sona

l and

pro

fess

iona

l ac

tion

s.

Und

erst

ands

sys

tem

’s co

nten

ts, c

apac

itie

s, a

nd

defic

ienc

ies

and

enab

les

grou

p to

take

adv

anta

ge

of a

vaila

ble

reso

urce

s.

Dev

elop

s a

stra

tegy

to

build

, mai

ntai

n, a

nd

intr

oduc

e a

syst

em th

at

supp

orts

the

orga

niza

-ti

on’s

acti

viti

es.

Con

tinu

ous T

echn

o-lo

gica

l Im

prov

emen

tU

naw

are

of

basi

c te

chno

logy

.U

nder

stan

ds s

tate

-of-

art

adva

ncem

ents

Mai

ntai

ns c

urre

nt te

ch-

nolo

gica

l pro

ficie

ncie

s in

pe

rson

al a

nd p

rofe

ssio

nal

acti

ons.

Ant

icip

ates

and

art

icu-

late

s te

chno

logi

cal n

eeds

an

d ad

apts

to te

chno

log-

ical

cha

nges

that

aff

ect

the

wor

kgro

up.

Dev

elop

s a

stra

tegy

to

ensu

re th

at th

e or

gani

-za

tion

sta

ys c

urre

nt in

ne

eded

tech

nolo

gica

l co

mpe

tenc

ies.

H. Getha-Taylor et al.

Page 31: Competency Model Design and Assessment: Findings · PDF fileJPAE 19 Journal of Public Affairs Education 141 Competency Model Design and Assessment: Findings and Future Directions Heather

Journal of Public Affairs Education 171

IV. M

anag

emen

t E

xcel

lenc

e (d

eliv

erin

g th

roug

h ac

tion

man

agem

ent,

peo

ple

man

agem

ent,

& fi

nanc

ial m

anag

emen

t) c

onti

nued

4Se

rvic

e M

anag

emen

t1

23

45

Serv

ice

Stan

dard

s

& D

eliv

ery

Una

war

e of

org

aniz

a-ti

on’s

basi

c se

rvic

e st

anda

rds.

Aw

are

of o

rgan

izat

ion’

s ba

sic

serv

ice

stan

dard

s.Pa

rtic

ipat

es in

the

deve

l-op

men

t and

impl

emen

-ta

tion

of p

erfo

rman

ce

man

agem

ent i

niti

ativ

es.

Lead

s gr

oup

effo

rt to

co

ntin

uous

ly im

prov

e se

rvic

e st

anda

rds

and

serv

ice

deliv

ery.

Cre

ates

org

aniz

atio

n th

at

is c

onti

nuou

sly

seek

ing

to b

ette

r un

ders

tand

and

m

eet t

he p

ublic

’s ex

pec-

tati

ons

and

need

s an

d to

m

easu

re r

esul

ts.

Prod

ucti

vity

/ E

ffici

ency

Una

war

e of

eit

her

publ

ic

need

s or

org

aniz

atio

nal

capa

citi

es.

Aw

are

of p

ublic

nee

ds,

orga

niza

tion

al c

apac

i-ti

es, a

nd th

e re

lati

onsh

ip

betw

een

the

two.

Con

side

rs p

ublic

nee

ds

and

orga

niza

tion

al

capa

citi

es in

per

sona

l an

d pr

ofes

sion

al

acti

ons

and

is a

ble

to

com

mun

icat

e th

e

rela

tion

ship

to o

ther

s.

Wor

ks w

ithi

n a

team

to

incr

ease

team

’s ca

paci

ty

to a

ddre

ss d

efine

d pu

blic

ne

eds

and

to a

rtic

ulat

e th

e re

lati

onsh

ip b

etw

een

need

s an

d re

sour

ces.

Cre

ates

org

aniz

atio

n-w

ide

unde

rsta

ndin

g

of e

lem

ents

invo

lved

in

bal

anci

ng n

eeds

and

re

sour

ces

and

effe

ctiv

ely

deve

lops

org

aniz

atio

nal

met

hods

that

sys

tem

- at

ical

ly c

onve

y th

e

rela

tion

ship

to o

ther

s.

Competency Model Design and Assessment