Use of a Stakeholder Survey in Research Unit Planning

Willard Hom

Director, Research & Planning Unit

Chancellor’s Office, Cal.Comm.Colleges

Strategic Planning for Research

• Analyze demand for research.

• Analyze capacity to supply research.

Strategic Planning Model

Demand

Internal

External

Topics

Quality

Topics

Quality

Initial Quality/Satisfaction Model

responsiveness

analytical capability

credibility

clarity of communictn.

relevance

Overall satisfaction

The Listserve Survey

• Economical

• Rapid development

• Quick response

• Low response rate

• Sample coverage problems

The Instrument

• 1. Using your impressions of the Research & Planning Unit, please rate us on the following dimensions, using a 0 - 9 scale, with the highest possible rating as 9, and the lowest possible rating as 0 (or use "DK" for Don't Know):

Rating Dimension

a. credibility (objectivity):

b. responsiveness (timeliness &

completeness):

c. analytical capability (technical competence):

d. clarity of communication:

e. relevance to your research & planning:

f. your overall satisfaction with the unit:

2. Please comment about your ratings:

3. Which topics concerning the California community college system will have the greatest need for research, considering a time frame of the next five years?

4. Which research issues at your college (or district if you directly work for a district) would benefit the most from work at the Research & Planning Unit of the Chancellor's Office?

credibility

9.08.07.06.05.0

12

10

8

6

4

2

0

Std. Dev = 1.18

Mean = 7.8

N = 30.00

responsiveness

9.08.07.06.05.0

12

10

8

6

4

2

0

Std. Dev = 1.24

Mean = 7.7

N = 30.00

analytical capability

9.08.07.06.0

14

12

10

8

6

4

2

0

Std. Dev = .97

Mean = 8.0

N = 34.00

clarity of communictn.

9.08.07.06.05.04.0

10

8

6

4

2

0

Std. Dev = 1.31

Mean = 7.2

N = 34.00

relevance

9.08.07.06.05.04.03.0

8

6

4

2

0

Std. Dev = 1.75

Mean = 6.7

N = 33.00

overall satisfaction

9.08.07.06.0

10

8

6

4

2

0

Std. Dev = 1.10

Mean = 7.6

N = 34.00

Correlations

1 .540** .575** .468** .326 .556**

. .004 .001 .009 .085 .001

30 27 30 30 29 30

.540** 1 .189 .471** .461* .741**

.004 . .317 .009 .012 .000

27 30 30 30 29 30

.575** .189 1 .115 .139 .437**

.001 .317 . .518 .441 .010

30 30 34 34 33 34

.468** .471** .115 1 .636** .678**

.009 .009 .518 . .000 .000

30 30 34 34 33 34

.326 .461* .139 .636** 1 .660**

.085 .012 .441 .000 . .000

29 29 33 33 33 33

.556** .741** .437** .678** .660** 1

.001 .000 .010 .000 .000 .

30 30 34 34 33 34

Pearson Correlation

Sig. (2-tailed)

N

Pearson Correlation

Sig. (2-tailed)

N

Pearson Correlation

Sig. (2-tailed)

N

Pearson Correlation

Sig. (2-tailed)

N

Pearson Correlation

Sig. (2-tailed)

N

Pearson Correlation

Sig. (2-tailed)

N

credibility

responsiveness

analytical capability

clarity of communictn.

relevance

overall satisfaction

credibilityresponsiv

enessanalyticalcapability

clarity ofcommunictn. relevance

overallsatisfaction

Correlation is significant at the 0.01 level (2-tailed).**.

Correlation is significant at the 0.05 level (2-tailed).*.

Point 1

• r of .437 for analytical capability is less than the r of .741 for responsiveness (.05 level).

• Among the respondents, analytical capability seems to have a weaker link to overall satisfaction than responsiveness.

Point 2

• Unlike the other four factors, analytical capability correlates better with credibility than with the remaining three factors.

• In this situation, analytical capability has a different role in respondent perceptions.

Point 3

• Responses to the open-ended follow-up item to the ratings gave excellent information.

• We learned how valid the ratings were.

• We discovered some new research interests and perceptions among the respondents.

Point 4

• This survey was actually the easiest survey of the environmental scan.

• The surveys for internal demand were more problematic.

Conclusion

• Use stakeholder surveys to learn about the demand for research.

• Try to use both qualitative and quantitative measures in the surveys.

Contact Information

• (916) 327-5887

• Email: whom@cccco.edu

• Chancellor’s Office, CCC1102 Q StreetSacramento, CA 95814-6511