2010 assessment roundtable

2010 ASSESSMENTROUNDTABLE

March 17, 201011:00 a.m. – 2:30 p.m.

Assessing Research in the FAMU Environmental Sciences Institute

Marcia Allen Owens, J.D., Ph.D.Assistant Professor

Chair, ESI Assessment Committee

FAMU Assessment RoundtableMarch 17, 2010

FAMU Environmental Sciences Institute

Established in 1995Bachelors, Masters, Doctoral Degrees

Environmental Biotechnology Environmental Restoration and Waste Management Marine and Estuarine Environments Environmental Policy and Risk Management Radiation Protection

Thesis required for all ESI degrees

FAMU ESI Mission

The objectives of the Environmental Sciences Institute are to provide instruction, conduct research, perform public service, and initiate technology transfer which will result in the development of remedies for existing environmental problems; the enlightenment of communities on environmental science issues; and the production of students uniquely prepared to address present and future environmental science concerns.

FAMU Environmental Sciences Institute

Currently 10 Full-Time Tenured/Tenure Track Faculty (including 1 Distinguished Professor)

1 Visiting Faculty 4 Postdoctoral Research Fellows100 Students#1 Producer of Black PhD’s in Environmental

Sciences

FAMU ESI 7-Year Review StrengthsA strong environmental science program at an HBCU

that has an excellent chance not only to succeed but to excel

Potential for supporting and promoting a dynamic research program and establishing strong partnerships with other Universities and with federally-funded research labs

Productive faculty at Research I universities as well as scientists with federal environmental entities are anxious to collaborate with ESI and increase minority representation in the Environmental Sciences

Provides significant employment opportunities for graduates in all sectors

FAMU ESI 7-Year Review Strengths

Interdisciplinary approach to student education and research

Formal seminar series with distinguished lecturers from around the country

Recognized faculty throughout the State of Florida and the Nation

This small group produced nearly 40 publications in peer-reviewed scientific journals, books and reports, generated $4.5 million in research grants and graduated four Ph.D. students. (2005-2006)

Guiding Principles of Development of ESI Assessment Plan

Preparing Stewards of the DisciplineAn ESI student is expected to serve as “a steward of her

discipline or profession, dedicated to the integrity of its work in the generation, critique, transformation, transmission, and use of its knowledge.”

Lee Shulman, President, The Carnegie Foundation for the the Advancement of Teaching

Expected Research Objectives/Outcomes① Maintain an academic culture that incorporates the core

values identified in the University’s mission statement, specifically collaboration, collegiality and integrity throughout all aspects of the ESI research enterprise which includes including but not limited to, idea generation, proposal development, execution of studies and dissemination of research-based products.

Criteria for Success – Objective 1

Direct Measure(s)50% of full-time, tenured

and tenure-track faculty will have competitive funding

Indirect Measure(s)70% of full-time, tenured

and tenure-track faculty will rate their ability to conduct and promote environmental science research as satisfactory.

Performance Measures – Objective 1

Direct Measure(s)ESI will generate an

annual and cumulative list of competitive funds garnered, refereed publications, citations, conference presentations and engagement in local, regional, national, and international organizations and agencies.

Indirect Measure(s) Inventory of research

activities compiled from annual report submitted to Office of Sponsored Programs

ESI will continue to use its 7-year program review to identify and develop implementation strategies for research

Expected Research Objectives/Outcomes② Place emphasis on areas that advance our institutional

mission while addressing grand challenges throughout all aspects of the ESI research enterprise, including but not limited to, idea generation, proposal development, execution of studies and dissemination of research-based products.


Direct Measure(s)60% of existing research

products will align with ESI focus areas

Indirect Measure(s)100% of ESI faculty will

be able to articulate a research connection with at least one of ESI’s focus areas.


Direct Measure(s)ESI will evaluate faculty

and student research for alignment with ESI focus areas

ESI will evaluate curriculum and syllabi for alignment with ESI focus areas

Indirect Measure(s)ESI will continue to use

its 7-year program review to collaborate faculty self report, and to identify and develop implementation strategies for research and proper alignment with focus areas

Expected Research Objectives/Outcomes③ Actively engage students all along the educational

pipeline, particularly those from underrepresented groups, in the research enterprise in ESI.


Direct Measure(s)ESI will annually review

and revise (when needed) policies for ensuring student engagement in the research enterprise

Indirect Measure(s)40% of ESI students will

report involvement in the research enterprise with multiple constituencies


Direct Measure(s)ESI will generate a list of

students’ refereed publications, citations, conference presentations and engagement in local, regional, national, and international organizations and agencies

Indirect Measure(s)Analysis of focus group

data conducted at the end of each academic year will report student consensus that they have engaged in multiple opportunities for research with different constituencies since the prior academic year

Lessons and Challenges

LessonsSet realistic goals which

allow for improvementUse 100% sparinglyUse existing data

collection mechanisms as much as possible

ChallengesConceptual acceptance

of assessment as important

Difference in faculty and student perceptions

Faculty acceptance of student focus group data

Questions????

[email protected](850) 599-8556


March 17, 201011:00 a.m. – 2:30 p.m.

Assessing Research and

Community/Public Service

Jennifer Collins, Ph.D.School of Business and Industry

Public/Community Service

SBI Goal: The School of Business and Industry will engage in Economic Development on the Southside of

Tallahassee and statewide.

Public/Community Service Objectives1. SBI will work with community organizations to

provide economic development opportunities in the Big Bend area.

2. SBI faculty will seek funding opportunities that support development on the Tallahassee Southside.

3. SBI will provide financial literacy opportunities to residents in the Big Bend area.

4. SBI faculty will participate in professional associations.

5. SBI faculty and administrators will serve in leadership positions of civic and social organizations in Tallahassee and elsewhere.

Objective 1: SBI will work with community organizations to provide economic development opportunities in the Big Bend area. Direct Measure: SBI will work with community

organizations and/or the Small Business Development Center to provide at least two (2) small business/ entrepreneurship workshops annually.

Indirect Measure: 75% positive feedback on workshop participant survey.

Direct Measure: A database of attendees at SBI sponsored or co-sponsored workshops will be developed for data collection.

Indirect Measure: A customer satisfaction survey will be conducted to assess participant satisfaction with the workshops.

Objective 2: SBI faculty will seek funding opportunities that support economicdevelopment on the Tallahassee Southside. Direct Measure: SBI faculty and/or staff will

secure one (1) grant or contract bi-annually that will provide economic development funding support for the Tallahassee Southside.

Indirect Measure: 80% of the faculty will rate themselves as being satisfied with the level of support they received from the School of Business and Industry to participate in grant opportunities.

Objective 3: SBI will provide financial literacy opportunities to residents in the Big Bend area.

Direct Measure: SBI will sponsor and/or co-sponsor two (2) financial literacy workshops annually in the Big Bend area.

Indirect Measure: 75% positive feedback on participant surveys.

Direct Measure: A database of outreach activities/contributions will be developed for data collection purposes.

Indirect Measure: A customer satisfaction survey will be conducted to assess participant satisfaction with the financial literacy workshops.

Objective 4: SBI faculty will participate in professional associations. Direct Measures:

90% of faculty will hold membership in professional associations within their disciplines.

30% of faculty will hold leadership positions in professional associations within their disciplines.

50% of faculty will review articles submitted for conference presentations and/or publication in refereed journals.

Indirect Measures: 30% of faculty will participate in invited presentations

within their discipline. 80% of the faculty will rate themselves as being

satisfied with the level of support they received from the School of Business and Industry that made it possible to participate in research related activities.

Objective 4 cont’d Direct Measure: A database of faculty

participation in professional associations will be developed for data collection purposes.

Indirect Measures: A faculty survey will be conducted in the Spring semester. There will be items that measure faculty satisfaction with the level of support they receive from the School of Business and Industry to participate in professional associations.

Objective 5: SBI faculty and administrators will serve in leadership positions for civic and social organizations in Tallahassee and elsewhere. Direct Measure: 20% of faculty will hold leadership positions in

civic and social organizations in Tallahassee and elsewhere. Indirect Measure: 80% of the faculty will rate themselves as being

satisfied with the level of support they received from the School of Business and Industry that made it possible to participate in civic and social organizations.

Direct Measure: A database of faculty participation in civic and social organizations will be used for data collection purposes.

Indirect Measure: A faculty survey will be conducted in the Spring semester. There will be items that measure faculty satisfaction with the level of support they receive from the School of Business and Industry to participate in civic and social organizations.

What we’ve done…

Objective 1 Innovation Insights hosted by

Innovation Matters beginning March 2010

Workshops for small businesses will begin May 2010

Satisfaction surveys to be administered at each session.

Objective 2 We have secured a grant from Thurgood

Marshall College Fund for $20,000 to conduct research on economic development via small businesses in Big Bend Area.

Faculty satisfaction survey will be administered in April 2010.

Objective 3 Financial literacy workshops to be

offered for SBI students (April 1st), FAMU and community (April 8th), and Tallahassee community (March 27th)

Satisfaction surveys to be administered at each session.

Objective 4 Database of faculty credentials has been

developed Faculty satisfaction survey will be

administered in April 2010.

Objective 5 Faculty credentials database includes

information on civic organization membership and leadership positions

Faculty satisfaction survey will be administered in April 2010.

Questions?


March 17, 201011:00 a.m. – 2:30 p.m.

ASSESSING RESEARCH AND

PUBLIC/COMMUNITY SERVICE

IN THE SCHOOL OF ALLIED HEALTH SCIENCES

Florida A&M UniversityAssessment Roundtable

March 17, 2010

Presented by:Dr. Marjorie McNeill and Prof. Aurelia

Alexander

ASSESSMENT- KEY POINTS: Make it a team effort that is spearheaded

by a dedicated committee. Inform all faculty of goals and procedures. Have assessment as a standing item on all

meeting agendas – division/department, school/college.

Give frequent reminders for documentation of activities participated in. Supply deadlines and the process to get data in a timely manner.

Foster a culture of continuous improvement to ensure student success and institutional effectiveness.

ASSESSING RESEARCH

SECTION II_ COLLEGE/SCHOOL MISSION/GOALS CONNECTION

FAMU is committed to inspirational teaching, exemplary research, and meaningful public and community service through creative partnerships at the local, state, national, and global levels.Strategic Goal 3.4: Firmly establish the University as a competitive doctoral/research-intensive University that is highly regarded in the research community and is noted for state-of-the-art research that supports high quality graduate, undergraduate, and professional programs.SOAHS Mission Statement:

The mission of the School of Allied Health Sciences is to provide an enlightened and enriched academic, intellectual, moral, cultural, ethical, technological, and student-centered environment for the purpose of educating individuals to become competent allied health professionals who are capable of: Complex critical thinking Comprehensive communication skills Interdisciplinary collaboration Analysis and involvement in research processes Improving the health status of under-represented and underserved populations Lifelong learning

This mission will be accomplished through the contributions of dedicated faculty and staff that are capable of meeting student needs through inspirational and creative teaching, exemplary scholarship and meaningful public, community, and professional service at local, stat e, national, and global levels. As a result, students will be prepared to meet existing and emerging health care needs that will benefit the citizens of Florida, the nation, and the world.

Expected Outcomes:

1. Faculty will present profession specific best practices and research findings at local, state, and national meetings.

2. Faculty will attend professional development activities in the area of research.3. Faculty will participate in student research activities.

SECTION III_ FAMOUS SIX STEPS

EXPECTED RESEARCH OUTCOME #1

Step 1 Formulate OutcomeFaculty will present profession specific best practices and research findings at local, state, and national meetings.

Step 2Ascertain Criteria for

Success

Direct Measure10% of full-time faculty will make at least one presentation at the local, state, or national level. Indirect Measure80% of full-time faculty will rate themselves as being satisfied with opportunities to present best practices and research findings at professional meetings.

Step 3Measure Performance

Using Direct and Indirect Methods of Assessment

Direct MeasureCompilation of professional meeting presentations.Indirect MeasureResults from a faculty survey administered annually.

Step 4 Observe and Summarize Results

Direct Measure29% (6/21) of full-time faculty have made a presentation at the local, state, or national level.

Indirect Measure100% (12/12) of faculty are satisfied (1-completely satisfied; 4 – very satisfied; 7 – somewhat satisfied) with opportunities to present best practices and research findings at professional meetings.

Step 5Use of Results for

Improvement (Implemented)

Results are shared with all faculty. Faculty members are encouraged to submit proposals at the local, state, and national professional meetings.

Step 6 Strengthen College or School (Action Plan)

Continue to monitor outcomes and identify opportunities to present.

ASSESSING PUBLIC/COMMU

NITY SERVICE

SECTION II_ COLLEGE/SCHOOL MISSION/GOALS CONNECTION

Excerpt(s) Citing Linkage to University Mission

Statement forCommunity/Public Service

FAMU is committed to inspirational teaching, exemplary research, and meaningful public and community service through creative partnerships at the local, state, national, and global levels.

Excerpt(s) Citing Linkage to University Goal (s)

Statement forCommunity/Public Service

Strategic Goal 4.2: To enhance the services provided to the local, state, national, and international communities.

Program Mission/Goals on Community/Public Service

From College or School Strategic Plan

SOAHS Mission Statement:The mission of the School of Allied Health Sciences is to provide an enlightened and enriched academic, intellectual, moral, cultural, ethical, technological, and student-centered environment for the purpose of educating individuals to become competent allied health professionals who are capable of: Complex critical thinking Comprehensive communication skills Interdisciplinary collaboration Analysis and involvement in research processes Improving the health status of under-represented and underserved

populations Lifelong learningThis mission will be accomplished through the contributions of dedicated faculty and staff that are capable of meeting student needs through inspirational and creative teaching, exemplary scholarship and meaningful public, community, and professional service at local, stat e, national, and global levels. As a result, students will be prepared to meet existing and emerging health care needs that will benefit the citizens of Florida, the nation, and the world.

Program Objectives or Outcomes on

Community/Public Service From College or School

Strategic Plan

Expected Outcomes:1. The School will participate in community health events in an effort

to share knowledge regarding healthy lifestyles.2. The School will provide continuing education for community

healthcare providers and/or the general public.3. The School will participate in the development of health care policy

at the local, state, and national levels.

SECTION III_ FAMOUS SIX STEPSEXPECTED COMMUNITY/PUBLIC SERVICE OUTCOME #1

Step 1 Formulate Outcome The School will participate in community health events in an effort to share knowledge regarding healthy lifestyles.

Step 2Ascertain Criteria for

Success

Direct MeasureFaculty and students in the School will participate in at least 2 local area health fairs or other related community events during the academic year.Indirect Measure80% of community agencies will give a satisfactory rating for the level of participation they received from the School in community health events.

Step 3Measure Performance

Using Direct and Indirect Methods of Assessment

Direct MeasureAnnual report listing community health event, date, location, audience, participating divisions within School.Indirect MeasureConfirmation of participation from community agency.

Step 4 Observe and Summarize Results

Direct MeasureFaculty and/or students have participated in the following community events:1.Habitat for Humanity – Health Science students; continuous, ongoing participation2.CarFit for Seniors – Occupational Therapy faculty and students; October 20083.ATTAC Tobacco Cessation Program in collaboration with the Big Bend AHEC; Fall 20084.Open Airways – Cardiopulmonary Science faculty and students; Fall 20085.American Lung Association Lung Walk – Cardiopulmonary Science faculty; Spring 20096.Live Oak Geriatric Education Center – Dean’s Office; continuous, ongoing participation7.Health Check/Balance Clinic – Occupational Therapy faculty and students; Fall 20088.Adaptive Equipment Tech Fair – Occupational Therapy faculty and student; Fall 20089.Habitat for Humanity/Rainbow Rehabilitation – Occupational Therapy faculty; Spring 2009

Indirect Measure100% (9/9) of community agencies have indicated a satisfactory rating for the level of participation they received from the School.

Step 5Use of Results for

Improvement (Implemented)

Faculty/student involvement and community agency feedback will be used to strengthen the School’s efforts in sharing knowledge of healthy lifestyles.

Step 6 Strengthen College or School (Action Plan)

Continue community involvement and partnering efforts. Seek additional opportunities to participate in.

CLOSING COMMENTS:

This is a learning process for all! Remember, this is a way to demonstrate

all the hard work that is already going on in each of our areas.

By sharing good news, we can make informed decisions regarding change.

QUESTIONSand ANSWERS

THANK YOU!

Dr. Marjorie [email protected]

du

Prof. Aurelia Alexander

561-2018aurelia.alexander@famu.

edu


March 17, 201011:00 a.m. – 2:30 p.m.

2010 assessment roundtable

Documents