This article was downloaded by: [Wayne State University]On: 26 November 2014, At: 10:35Publisher: RoutledgeInforma Ltd Registered in England and Wales Registered Number: 1072954 Registeredoffice: Mortimer House, 37-41 Mortimer Street, London W1T 3JH, UK
International Journal of ScienceEducationPublication details, including instructions for authors andsubscription information:http://www.tandfonline.com/loi/tsed20
Perceptions of Science GraduatingStudents on their Learning GainsCristina Varsavskya, Kelly E. Matthewsb & Yvonne Hodgsonc
a Faculty of Science, Monash University, Melbourne, Victoria 3800,Australiab Teaching and Educational Development Institute, University ofQueensland, Brisbane, Australiac School of Biomedical Science, Monash University, Victoria 3800,AustraliaPublished online: 21 Aug 2013.
To cite this article: Cristina Varsavsky, Kelly E. Matthews & Yvonne Hodgson (2014) Perceptions ofScience Graduating Students on their Learning Gains, International Journal of Science Education,36:6, 929-951, DOI: 10.1080/09500693.2013.830795
To link to this article: http://dx.doi.org/10.1080/09500693.2013.830795
PLEASE SCROLL DOWN FOR ARTICLE
Taylor & Francis makes every effort to ensure the accuracy of all the information (the“Content”) contained in the publications on our platform. However, Taylor & Francis,our agents, and our licensors make no representations or warranties whatsoever as tothe accuracy, completeness, or suitability for any purpose of the Content. Any opinionsand views expressed in this publication are the opinions and views of the authors,and are not the views of or endorsed by Taylor & Francis. The accuracy of the Contentshould not be relied upon and should be independently verified with primary sourcesof information. Taylor and Francis shall not be liable for any losses, actions, claims,proceedings, demands, costs, expenses, damages, and other liabilities whatsoever orhowsoever caused arising directly or indirectly in connection with, in relation to or arisingout of the use of the Content.
This article may be used for research, teaching, and private study purposes. Anysubstantial or systematic reproduction, redistribution, reselling, loan, sub-licensing,systematic supply, or distribution in any form to anyone is expressly forbidden. Terms &
Conditions of access and use can be found at http://www.tandfonline.com/page/terms-and-conditions
Dow
nloa
ded
by [
Way
ne S
tate
Uni
vers
ity]
at 1
0:35
26
Nov
embe
r 20
14
Perceptions of Science Graduating
Students on their Learning Gains
Cristina Varsavskya∗, Kelly E. Matthewsb andYvonne Hodgsonc
aFaculty of Science, Monash University, Melbourne, Victoria 3800, Australia; bTeaching
and Educational Development Institute, University of Queensland, Brisbane, Australia;cSchool of Biomedical Science, Monash University, Victoria 3800, Australia
In this study, the Science Student Skills Inventory was used to gain understanding of student
perceptions about their science skills set developed throughout their programme (scientific
content knowledge, communication, scientific writing, teamwork, quantitative skills, and ethical
thinking). The study involved 400 responses from undergraduate science students about to
graduate from two Australian research-intensive institutions. For each skill, students rated on a
four-point Likert scale their perception of the importance of developing the skill within the
programme, how much they improved it throughout their undergraduate science programme,
how much they saw the skill included in the programme, how confident they were about the
skill, and how much they will use the skill in the future. Descriptive statistics indicate that overall,
student perception of importance of these skills was greater than perceptions of improvement,
inclusion in the programme, confidence, and future use. Quantitative skills and ethical thinking
were perceived by more students to be less important. t-Test analyses revealed some differences
in perception across different demographic groups (gender, age, graduate plans, and research
experience). Most notably, gender showed significant differences across most skills. Implications
for curriculum development are discussed, and lines for further research are given.
Keywords: Learning gains; Science skills; Undergraduate science; Student perceptions
1. Introduction
The introduction of accountability processes is one of the most significant trends in
recent decades that has had an impact on higher education across the world (Santiago,
Tremblay, Basri, & Arnal, 2008). Quality assurance and accreditation agencies such
as the Quality Assurance Agency (QAA) for Higher Education in the UK and Tertiary
International Journal of Science Education, 2014
Vol. 36, No. 6, 929–951, http://dx.doi.org/10.1080/09500693.2013.830795
∗Corresponding author. Faculty of Science, Monash University, Melbourne, Victoria 3800,
Australia. Email: [email protected]
# 2013 Taylor & Francis
Dow
nloa
ded
by [
Way
ne S
tate
Uni
vers
ity]
at 1
0:35
26
Nov
embe
r 20
14
Education Quality and Standards Agency in Australia have been instrumental in gen-
erating a culture of institutional quality, transparency, and self-improvement. Within
this framework, institutions have made substantial efforts towards defining holistically
the characteristics or attributes of their graduates; that is, the knowledge and skills stu-
dents develop throughout their programmes. During most of the last decade the
quality assurance activities revolved around curriculum design and teaching standards
(Barrie, 2007), with a focus on defining attributes at the institutional or programme
(discipline) level (Kuh & Ewell, 2010; QAA, 2009; Tuning Association, 2011) and
mapping these across the curriculum (Spencer, Riddle, & Knewstubb, 2012).
In recent years, there has been a shift from a focus on programme design and
mapping graduate attributes to an increased emphasis on demonstrating what stu-
dents learn by the end of their programme (Coates, 2009). National and international
assessment systems are being developed and implemented for the purpose of account-
ability and comparability across institutions and across countries. In the USA, the
Collegiate Learning Assessment test is administered to samples of students within
an institution to derive a standardised measure of students’ development of skills;
data resulting from this sample testing are used to demonstrate the overall perform-
ance of the institution in adding value to the education of their students (Klein, Ben-
jamin, Shavelson, & Bolus, 2007). Globally, the Organisation for Economic
Cooperation and Development (OECD) is undertaking the Assessment of Higher
Education Learning Outcomes study to establish the feasibility of worldwide collec-
tion of data on the capabilities of final-year bachelor degree students (Coates &
Richardson, 2011). In Australia, the current focus is on developing teaching and
learning standards to apply for institutional re-accreditation, with no indications yet
on how these will be assessed (Australian Learning and Teaching Council, 2010).
1.1 Science Graduates Skill Set
The need for science graduates with a skill set appropriate to the current and future
rapidly evolving technological environment has been the focus of debates across the
world (National Academy of Sciences, 2006; OECD, 2006; Roberts, 2002), paired
with calls for the improvement of science education (Wieman, 2007; Wieman,
Perkins, & Gilbert, 2010).
In Australia, the government has invested in the development of discipline-specific
learning standards; it did so through its Learning and Teaching Assessment Standards
(LTAS) project. The science threshold learning outcomes developed as part of LTAS
project now provide a point of reference for the desired minimum standards of every
science graduate in Australia (Yates, Jones, & Kelder , 2011); they are the product of a
comprehensive national consultation involving science academics, policy-makers, and
industry. Although this a positive development, an agreed set of threshold learning
outcomes for science graduates is only a starting point. Within the current trend
towards institutional accountability, there is a need to demonstrate that our science
students graduate with these skills.
930 C. Varsavsky et al.
Dow
nloa
ded
by [
Way
ne S
tate
Uni
vers
ity]
at 1
0:35
26
Nov
embe
r 20
14
Universities have been addressing the skills agenda in various ways, including inte-
gration of skills in key units at each year level, or the so-called capstone units at the end
of the programme where students draw together what they learn from the point of
admission (Ewell, 2013). However, there is a paucity of literature on such efforts in
the context of science undergraduate programmes. There has been very little
change in the science curricula around the world. Science teaching and learning at
the undergraduate level still seem to focus primarily on knowledge transfer, with
little attention being paid to skills required to apply knowledge (Weiman, 2007;
Wood, 2009). Brownell and Tanner (2012) argue that profound cultural change is
needed to achieve real reform in science, and calls have been made to increase the
pace of that reform (Henderson, Beach, & Finkelstein, 2011).
1.2 Student Perceptions of Skills
Student surveys to appraise perceptions of skills developed within undergraduate pro-
grammes have been used in a variety of contexts. They are most commonly used at
graduation point, for institutional accountability and ranking purposes (see, e.g.
Kuh & Ewell, 2010 for the USA; Surridge, 2008 for the UK). In Australia, the instru-
ment used for this purpose is the Course Experience Questionnaire. Graduates com-
plete this survey approximately six months after graduation (Ramsden, 1991). Only
five items of the instrument are designed to gauge skill development, and similar to
other such instruments used around the world, no reference is made to the discipline
studied. In the context of bioscience, a UK study found a strong correlation between
the perception of importance of skills between graduates and their employers (Saun-
ders & Zuzel, 2010). The study also found that graduates tend to assess their skills
more highly than employers, particularly if they did not have an industry placement
experience as part of their programme.
To a lesser extent, the literature also includes studies where the student perception
of skills have been sought to inform curriculum development. For example, Walker
(2008) canvassed college students to identify five skills they should learn in college,
suggesting that learning is not always aligned with what teachers want students to
learn, and that grades do not always represent what students actually learned.
Leggett, Kinnear, Boyce, and Bennet (2004) conducted a study to address the
missing student voice in the debate on the importance of science skills, and concluded
that student perceptions align better with teacher perceptions towards the end of the
programme. This study also suggests that there is a link between the importance of
students place on science skills and the extent to which these are assessed.
The literature includes studies with arguments for and against self-reported learn-
ing gains as compared to direct measures. A US study involving over 2,000 students
comparing student’s grade point average, their results of a standardised test, and their
self-reported learning, suggested that student self-reported gains have a modest rela-
tive validity (Anaya, 1999). Kuh (2001) argued that the National Survey of Student
Engagement did not measure what American students learned from admission to
graduation, but that nevertheless the results of these surveys provided important
Perceptions of Science Graduating Students 931
Dow
nloa
ded
by [
Way
ne S
tate
Uni
vers
ity]
at 1
0:35
26
Nov
embe
r 20
14
information for institutional self-improvement. More recently, Douglass, Thomson,
and Zhao (2012) highlighted that well-designed surveys ‘offer a valuable and more
nuanced alternative in understanding and identifying learning outcomes’, particularly
in research intensive and complex institutions.
2. Purpose of Study
The purpose of this study is to address the scarcity of literature on skills developed in
the context of a whole science undergraduate programme, and begin to understand
how science students see their learning of these skills as they approach graduation.
More precisely, this research aims to explore the perceptions of graduating science
students of the skills they develop as part of a science programme, their importance,
their inclusion in the programme, and their confidence with the skills. We use the
Science Students Skills Inventory (SSSI) which was developed at the University of
Queensland (Matthews & Hodgson, 2012), modelled on the Student Assessment of
Learning Gains (Seymour, Wiese, Hunter, & Daffinrud, 2000). The distinctive
science graduate skills addressed in this inventory include
(a) Scientific content knowledge.
(b) Oral communications skills to make scientific presentations.
(c) Scientific writing skills.
(d) Team work skills (working with others to accomplish a shared task).
(e) Quantitative skills (mathematical and statistical reasoning).
(f) Ethical thinking skills (ethical responsibilities and approaches).
The specific research questions addressed in this study are
(1) What perceptions do graduating science students have of the importance of
developing science graduate skills during their degree programme? What is
their perceived confidence and improvement in these skills, and how much do
they think these skills were included in their degree programme and will be
used in the future?
(2) Are there mismatches between student perceptions of science graduate skills and
their perceptions of (i) the improvement they made within the whole programme,
(ii) how much they saw them included in the programme, (iii) their confidence
with these skills, and (iv) how much they will use them after graduation?
(3) Are there differences in perceptions by different demographic groups such as
gender, age, their research experiences within the programme, and their future
plans?
3. Methodology
The SSSI was used to capture the breadth of perceptions of graduating science stu-
dents about their skill set. This instrument is specific to science and explores how
the whole science degree programme contributes to the development of science
932 C. Varsavsky et al.
Dow
nloa
ded
by [
Way
ne S
tate
Uni
vers
ity]
at 1
0:35
26
Nov
embe
r 20
14
skills. The SSSI has been previously published, including information on its validity
and reliability (Matthews & Hodgson, 2012).
3.1 The Survey
For each of the six science graduate skills, the survey asked students to rate, on a four-
point Likert scale (Table 1).
. How important it is to have in the science programme activities that develop the par-
ticular skill (from 1 ¼ not at all important to 4 ¼ very important).
. The level of improvement they made regarding the particular skill as a result of the
overall science programme (from 1 ¼ no improvement to 4 ¼ a great deal of
improvement).
. To what extent were activities to develop the particular skill included in their science
programme (from 1 ¼ not included at all to 4 ¼ included a lot).
. To what extent they felt confident with the particular skill as a result of the science
programme (from 1 ¼ not at all confident to 4 ¼ very confident).
. Five years after they graduate from the science programme, how much do they think
they will use the particular skill (from 1 ¼ not at all to 4 ¼ a lot).
The demographic information sought from students included gender, age, partici-
pation in undergraduate research experiences (URE) (summer research scholarships,
Table 1. Structure of survey questions, with measures of perception and categories used for
analyses
Question 1 (low) 2 (low) 3 (high) 4 (high)
How important is to have in
the science programme
activities that develop [skill]?
Not at all
important
Not very
important
Important Very important
As a result of your overall
science programme what
improvements have you
made with [skill]?
No
improvement
Little
improvement
Moderate
improvement
A great deal of
improvement
To what extent were
activities to develop [skill]
included in your science
programme?
Not included
at all
Included a
little
Included a
moderate
amount
Included a lot
To what extent do you feel
confident about [skill] as a
result of your science
programme?
Not at all
confident
A little
confident
Moderately
confident
Very confident
Five years after you graduate
from your science
programme, how much do
you think you will be using
[skill]?
Not at all A little Quite a bit A lot
Perceptions of Science Graduating Students 933
Dow
nloa
ded
by [
Way
ne S
tate
Uni
vers
ity]
at 1
0:35
26
Nov
embe
r 20
14
or a research unit undertaken for credit) and plans students had for after graduation
(employment, postgraduate studies (research or other), or no plans yet). Finally, the
two institutions involved in the study are very similar; both belong to the Group of
Eight Australian universities, admit students at the highest end of academic perform-
ance, their science programmes are equivalent in breadth and depth, and their teach-
ing largely aligns with the more traditional approaches used in research-intensive
universities.
3.2 Data Collection
The survey was administered online to all students undertaking their final semester of
the Bachelor of Science or the Bachelor of Biomedical Science at two research-inten-
sive Australian institutions. A total of 1,207 final semester science students were
invited to complete the online survey, and 647 responses were received. Students
who were combining science studies with other disciplines (dual degrees) were
removed to ensure the perceptions were about what students learned in a science
degree programme. Incomplete surveys were also removed. In total, 400 surveys
were used to perform the data analysis; this represents 45.4% of all surveyed students
who were studying a science single degree. The data set included 56% female stu-
dents, 83% in the 19–22 age bracket, and 60% students from University A.
3.3 Data Analysis
For each skill, descriptive statistics of importance, improvement, confidence,
inclusion, and future use were examined. Similar to Wyer (2003), ordinal data were
analysed using logistic regression with Likert scale responses grouped into high and
low categories. Measures of perception were divided into high and low categories to
assess not only students’ average perception but also the degree of opposing views
within each skill. ‘Low’ category was based on the two lower points of the scale
(such as ‘not at all important’ and ‘not very important’) whereas ‘high’ category
was based on responses corresponding to the two highest points on the scale (such
as ‘moderately confident’ and ‘very confident’) (Table 1). Age was also categorised
to reflect the primary cohort within the undergraduate science degree programmes
(aged 19–22 years) relative to individuals outside of this cohort (aged 23+). Gradu-
ate plans were based on categories describing students’ intentions after graduating
from the science degree programme. Students intending to continue with postgradu-
ate studies aimed towards medicine or education were categorised as having pro-
fessional postgraduate plans. Those planning to undertake postgraduate studies in
research were categorised as having research postgraduate plans. Students intending
to enter the work force after graduation, whether that be in a science- or non-science-
related area, were categorised as ‘work force’. Students were categorised as not having
a set plan after graduation based on giving this response in the survey; ‘other’ graduate
plans include those intending to enrol in another postgraduate degree programme and
those who answered ‘other’ in the survey (Table 2).
934 C. Varsavsky et al.
Dow
nloa
ded
by [
Way
ne S
tate
Uni
vers
ity]
at 1
0:35
26
Nov
embe
r 20
14
A series of independent samples t-tests and one-ways Analyses of variance
(ANOVAs) were used, where appropriate, to determine whether student perceptions
of each graduate skill differed according to gender, age, graduate plans, URE, and uni-
versity. When using one-way ANOVAs, Bonferroni adjustment was used for planned
contrasts. A series of paired t-tests were used to determine whether there were differ-
ences between student perception regarding importance of graduate skills and percep-
tion regarding improvement, inclusion, confidence, and future use of these skills. For
all analyses, an alpha level of 0.05 was used as an indication of statistical significance.
Data were analysed using PASW 20.0.
4. Findings
4.1 Student Perceptions of Skills
Table 3 gives descriptive statistics of perceptions of importance, improvement, inclusion,
confidence, and future use for each of the six skills. Figure 1 complements this
Table 3. Perceptions of importance, improvement, inclusion, confidence, and future use for each
of the six skills: mean (standard deviation) and number (percentage) of student rating high
Scientific
content
Oral
communication Writing Teamwork Quantitative
Ethical
thinking
Importance 3.78 (+.42) 3.50 (+.57) 3.70 (+.51) 3.34 (+.68) 3.36 (+.69) 3.17 (+.77)
High 399 (99.8%) 385 (96.3%) 393 (98.3%) 359 (89.9%) 356 (89.0%) 330 (82.5%)
Improvement 3.72 (+.58) 3.06 (+.82) 3.36 (+.73) 2.95 (+.78) 2.88 (+.87) 2.76 (+.85)
High 385 (96.3%) 314 (78.5%) 352 (88.0%) 302 (75.5%) 270 (67.5%) 253 (63.3%)
Inclusion 3.77 (+.47) 3.12 (+.74) 3.49 (+.70) 3.30 (+.69) 2.84 (+.76) 2.46 (+.71)
High 391 (97.8%) 323 (80.8%) 359 (89.9%) 352 (88.0%) 261 (65.3%) 163 (40.8%)
Confidence 3.37 (+.60) 3.17 (+.79) 3.24 (+.69) 3.35 (+.72) 2.64 (+.86) 2.92 (+.85)
High 378 (94.5%) 335 (83.8%) 354 (88.5%) 363 (90.8%) 242 (60.5%) 282 (70.5%)
Future use 3.32 (+.82) 3.42 (+.70) 3.07 (+.87) 3.56 (+.61) 2.65 (+.89) 2.96 (+.92)
High 330 (82.5%) 355 (88.8%) 289 (72.3%) 378 (94.5%) 221 (55.3%) 274 (68.5%)
Table 2. Demographic variables and categories used for analysis
Variable Categories
Sex Female Male
Age 19–22
years
23+ years
University University
A
University B
Graduate plans No set
plans
Work force Postgraduate
(professional)
Postgraduate
(research)
Other
Research
experience
(URE)
None Summer
research
scholarship
Unit (for credit) Both
Perceptions of Science Graduating Students 935
Dow
nloa
ded
by [
Way
ne S
tate
Uni
vers
ity]
at 1
0:35
26
Nov
embe
r 20
14
information, displaying the percentage of students who rated high each of the five vari-
ables. Tables 4–9 show the results of the independent sample t-tests and one-way
ANOVAs; where significant differences in perceptions were found, these are highlighted.
4.1.1 Scientific content knowledge. Results from independent sample t-tests and
one-way ANOVAs showed perception of scientific content knowledge were largely
consistent by gender, age, university, graduate plans, and URE with some exceptions.
Specifically, males were more confident. Students completing both a research course
unit and research scholarship had a significantly higher rating of scientific content
knowledge relative to students with no URE. Finally, students reporting ‘other’ as
their graduate plan had more future use of this knowledge compared to those intend-
ing to enter the workforce or enrolling in postgraduate research studies.
Figure 1. Percentage of students assigning high ratings
936 C. Varsavsky et al.
Dow
nloa
ded
by [
Way
ne S
tate
Uni
vers
ity]
at 1
0:35
26
Nov
embe
r 20
14
Table 4. Differences in perception of scientific content knowledge by demographic and academic factors
Variables
Importance Improvement Inclusion Confidence Future use
M (SD) p M (SD) p M (SD) p M (SD) p M (SD) p
Gender .35 .15 .94 .02 .80
Female 3.80 (+.40) 3.75 (+.55) 3.77 (+.46) 3.31 (+.60) 3.34 (+.78)
Male 3.76 (+.44) 3.66 (+.60) 3.77 (+.48) 3.46 (+.60) 3.32 (+.87)
Age .68 .45 .61 .53 .09
19–22 3.78 (+.42) 3.72 (.57) 3.78 (+.47) 3.38 (+.61) 3.31 (+.83)
23+ 3.80 (+.40) 3.65 (.64) 3.74 (+.49) 3.33 (+.52) 3.52 (+.72)
University .67 .43 .82 .25 .61
Institution A 3.77 (+.43) 3.69 (.57) 3.78 (+.47) 3.40 (+.59) 3.35 (+.82)
Institution B 3.79 (+.41) 3.74 (.58) 3.77 (+.47) 3.33 (+.62) 3.30 (+.83)
Graduate plans .48 .09 .21 .08 .02
No set plans 3.71 (+.47) 3.57 (+.85) 3.50 (+.65) 3.29 (+.47) 3.36 (+.93)
Work force 3.72 (+.45) 3.76 (+.46) 3.79 (+.41) 3.25 (+.55) 3.20 (+.90)
Postgraduate(prof) 3.78 (+.43) 3.66 (+.61) 3.77 (+.50) 3.38 (+.62) 3.35 (+.79)
Postgraduate(res) 3.77 (+.43) 3.59 (+.73) 3.73 (+.46) 3.23 (+.75) 2.91 (+.92)
Other 3.84 (+.37) 3.83 (+.48) 3.82 (+.42) 3.49 (+.58) 3.49 (+.75)
Research experience .98 .05 .91 .26 .79
None 3.78 (+.03) 3.65 (+.65) 3.76 (+.48) 3.33 (+.61) 3.30 (+.81)
Scholarship 3.76 (+.43) 3.72 (+.45) 3.79 (+.44) 3.37 (+.60) 3.34 (+.87)
Course unit 3.80 (+.41) 3.80 (+.46) 3.80 (+.46) 3.48 (+.55) 3.40 (+.84)
Both 3.78 (+.42) 3.86 (+.46) 3.78 (+.48) 3.46 (+.61) 3.39 (+.79)
Note: Bold values represent statistically different perceptions (p , 0.05).
Percep
tions
ofS
cience
Gra
duatin
gS
tuden
ts937
Dow
nloa
ded
by [
Way
ne S
tate
Uni
vers
ity]
at 1
0:35
26
Nov
embe
r 20
14
Table 5. Differences in perception of communication skills by demographic and academic factors
Importance Improvement Inclusion Confidence Future use
M (SD) p M (SD) p M (SD) p M (SD) p M (SD) p
Sex .01 .01 .02 .80 .61
Female 3.56 (+.56) 3.15 (+.82) 3.19 (+.73) 3.16 (+.81) 3.44 (+.70)
Male 3.40 (+.58) 2.94 (+.81) 3.02 (+.73) 3.18 (+.76) 3.39 (+.70)
Age .54 .90 .45 .12 .96
19–22 3.49 (+.57) 3.06 (+.82) 3.13 (+.73) 3.19 (+.79) 3.42 (+.70)
23+ 3.54 (+.55) 3.04 (+.82) 3.04 (+.79) 3.00 (+.73) 3.41 (+.69)
University .03 .001 .001 .84 .35
Institution A 3.45 (+.58) 2.95 (+.82) 2.95 (+.69) 3.16 (+.74) 3.42 (+.70)
Institution B 3.57 (+.56) 3.23 (+.80) 3.38 (+.74) 3.18 (+.86) 3.41 (+.71)
Graduate plans .08 .37 .84 .19 .05
No set plans 3.21 (+.58) 2.93 (+.83) 2.93 (+.92) 3.29 (+.73) 3.71 (+.47)
Work force 3.54 (+.50) 3.16 (+.71) 3.13 (+.74) 3.07 (+.74) 3.45 (+.68)
Postgraduate(prof) 3.44 (+.62) 2.98 (+.84) 3.12 (+.73) 3.19 (+.78) 3.35 (+.72)
Postgraduate(res) 3.55 (+.51) 3.09 (+.81) 3.23 (+.61) 2.86 (+.89) 3.18 (+.80)
Other 3.59 (+.51) 3.14 (+.86) 3.11 (+.76) 3.24 (+.81) 3.53 (+.66)
Research experience .13 .001 .001 .29 .02
None 3.46 (+.59) 2.91 (+.84) 3.00 (+.73) 3.10 (+.81) 3.35 (+.69)
Scholarship 3.46 (+.58) 3.19 (+.82) 3.41 (+.72) 3.21 (+.82) 3.51 (+.70)
Course unit 3.53 (+.55) 3.23 (+.73) 3.18 (+.75) 3.25 (+.67) 3.33 (+.76)
Both 3.64 (+.48) 3.30 (+.73) 3.17 (+.69) 3.29 (+.71) 3.61 (+.65)
Note: Bold values represent statistically different perceptions (p , 0.05).
938
C.
Varsa
vsk
yet
al.
Dow
nloa
ded
by [
Way
ne S
tate
Uni
vers
ity]
at 1
0:35
26
Nov
embe
r 20
14
Table 6. Differences in perception of writing skills by demographic and academic factors
Importance Improvement Inclusion Confidence Future use
M (SD) p M (SD) p M (SD) p M (SD) p M (SD) p
Sex .001 .07 .08 .70 .48
Female 3.77 (+.46) 3.42 (+.71) 3.54 (+.63) 3.25 (+.69) 3.10 (+.86)
Male 3.60 (+.55) 3.28 (+.75) 3.42 (+.77) 3.22 (+.71) 3.03 (+.89)
Age .09 .93 .56 .47 .01
19–22 3.68 (+.51) 3.36 (+.73) 3.48 (+.70) 3.32 (+.70) 3.03 (+.88)
23+ 3.80 (+.45) 3.37 (+.71) 3.54 (+.72) 3.30 (+.63) 3.39 (+.77)
University .40 .39 .38 .65 .99
Institution A 3.68 (+.52) 3.33 (+.73) 3.46 (+.72) 3.25 (+.67) 3.07 (+.86)
Institution B 3.72 (+.49) 3.40 (+.72) 3.53 (+.66) 3.22 (+.73) 3.07 (+.89)
Graduate plans .04 .70 .51 .86 .001
No set plans 3.43 (+.51) 3.14 (+.86) 3.50 (+.65) 3.21 (+.43) 2.50 (+.76)
Work force 3.71 (+.46) 3.41 (+.72) 3.57 (+.60) 3.22 (+.67) 3.22 (+.86)
Postgraduate(prof) 3.65 (+.57) 3.34 (+.71) 3.43 (+.77) 3.22 (+.71) 2.98 (+.85)
Postgraduate(res) 3.81 (+.48) 3.45 (+.86) 3.41 (+.73) 3.14 (+.83) 2.59 (+.67)
Other 3.70 (+.40) 3.38 (+.73) 3.55 (+.63) 3.30 (+.69) 3.32 (+.89)
Research experience .98 .13 .24 .57 .001
None 3.70 (+.50) 3.31 (+.74) 3.49 (+.70) 3.21 (+.69) 2.91 (+.88)
Scholarship 3.68 (+.56) 3.34 (+.75) 3.62 (+.57) 3.24 (+.67) 3.13 (+.88)
Course unit 3.70 (+.52) 3.60 (+.59) 3.45 (+.71) 3.38 (+.63) 3.23 (+.72)
Both 3.68 (+.50) 3.41 (+.73) 3.38 (+.77) 3.25 (+.76) 3.43 (+.87)
Note: Bold values represent statistically different perceptions (p , 0.05).
Percep
tions
ofS
cience
Gra
duatin
gS
tuden
ts939
Dow
nloa
ded
by [
Way
ne S
tate
Uni
vers
ity]
at 1
0:35
26
Nov
embe
r 20
14
Table 7. Differences in perception of team work skills by demographic and academic factors
Importance Improvement Inclusion Confidence Future use
M (SD) p M (SD) p M (SD) p M (SD) p M (SD) p
Sex .01 .14 .02 .32 .38
Female 3.41 (+.64) 3.00 (+.80) 3.37 (+.66) 3.38 (+.71) 3.59 (+.60)
Male 3.23 (+.72) 2.48 (+.76) 3.21 (+.72) 3.31 (+.74) 3.53 (+.63)
Age .75 .92 .19 .01 .46
19–22 3.34 (+.68) 2.94 (+.79) 3.32 (+.68) 3.38 (+.71) 3.57 (+.61)
23+ 3.30 (+.70) 2.96 (+.76) 3.17 (+.71) 3.09 (+.76) 3.50 (+.62)
University .10 .38 .26 .66 .60
Institution A 3.29 (+.69) 2.92 (+.78) 3.27 (+.69) 3.33 (+.69) 3.55 (+.63)
Institution B 3.41 (+.65) 2.99 (+.79) 3.35 (+.68) 3.37(+.77) 3.58 (+.59)
Graduate plans .67 .41 .50 .58 .80
No set plans 3.29 (+.47) 3.21 (+.58) 3.21 (+.70) 3.36 (+.63) 3.36 (+.93)
Work force 3.38 (+.65) 3.05 (+.75) 3.28 (+.69) 3.26 (+.68) 3.58 (+.57)
Postgraduate(prof) 3.28 (+.69) 2.91 (+.80) 3.33 (+.69) 3.35 (+.73) 3.57 (+.60)
Postgraduate(res) 3.36 (+.66) 2.95 (+.72) 3.50 (+.60) 3.23 (+.75) 3.55 (+.67)
Other 3.40 (+.70) 2.89 (+.82) 3.23 (+.70) 3.43 (+.75) 3.57 (+.61)
Research experience .80 .15 .04 .75 .81
None 3.33 (+.70) 2.87 (+.79) 3.26 (+.69) 3.36 (+.70) 3.57 (+.60)
Scholarship 3.38 (+.60) 3.12 (+.72) 3.49 (+.59) 3.40 (+.67) 3.51 (+.74)
Course unit 3.25 (+.74) 2.98 (+.80) 3.13 (+.82) 3.25 (+.71) 3.53 (+.51)
Both 3.35 (+.66) 2.99 (+.80) 3.33 (+.66) 3.32 (+.87) 3.61 (+.57)
Note: Bold values represent statistically different perceptions (p , 0.05).
940
C.
Varsa
vsk
yet
al.
Dow
nloa
ded
by [
Way
ne S
tate
Uni
vers
ity]
at 1
0:35
26
Nov
embe
r 20
14
Table 8. Differences in perception of quantitative skills by demographic and academic factors
Importance Improvement Inclusion Confidence Future use
M (SD) p M (SD) p M (SD) p M (SD) p M (SD) p
Sex .73 .15 .28 .001 .10
Female 3.37 (+.67) 2.83 (+.88) 2.80 (+.74) 2.49 (+.86) 2.59 (+.88)
Male 3.34 (+.72) 2.95 (+.85) 2.88 (+.79) 2.83 (+.82) 2.73 (+.89)
Age .08 .25 .26 .90 .004
19–22 3.33 (+.70) 2.86 (+.87) 2.82 (+.75) 2.64 (+.85) 2.60 (+.87)
23+ 3.52 (+.62) 3.02 (+.77) 2.96 (+.84) 2.65 (+.92) 3.00 (+.92)
University .14 .14 .13 .50 .10
Institution A 3.40 (+.65) 2.93 (+.84) 2.88 (+.74) 2.66 (+.86) 2.59 (+.90)
Institution B 3.29 (+.75) 2.80 (+.90) 2.77 (+.79) 2.60 (+.86) 2.74 (+.88)
Graduate plans .09 .06 .002 .05 .002
No set plans 3.14 (+.86) 3.14 (+.95) 3.21 (+.70) 3.07 (+.48) 2.43 (+.94)
Work force 3.49 (+.68) 3.08 (+.76) 3.07 (+.75) 2.78 (+.78) 2.84 (+.80)
Postgraduate(prof) 3.29 (+.68) 2.78 (+.86) 2.71 (+.69) 2.58 (+.85) 2.57 (+.89)
Postgraduate(res) 3.44 (+.68) 2.68 (+.99) 2.68 (+.72) 2.32 ((+.95) 2.14 (+.83)
Other 3.36 (+.69) 2.93 (+.90) 2.89 (+.85) 2.65 (+.93) 2.81 (+.89)
Research experience .33 .27 .43 .37 .10
None 3.34 (+.67) 2.87 (+.83) 2.86 (+.70) 2.60 (+.80) 2.55 (+.84)
Scholarship 3.26 (+.77) 2.75 (+.97) 2.71 (+.83) 2.59 (+.89) 2.76 (+.99)
Course unit 3.48 (+.64) 2.95 (+.85) 2.93 (+.85) 2.83 (+.76) 2.78 (+.87)
Both 3.36 (+.72) 3.03 (+.87) 2.86 (+.76) 2.71 (+.94) 2.78 (+.89)
Note: Bold values represent statistically different perceptions (p , 0.05).
Percep
tions
ofS
cience
Gra
duatin
gS
tuden
ts941
Dow
nloa
ded
by [
Way
ne S
tate
Uni
vers
ity]
at 1
0:35
26
Nov
embe
r 20
14
Table 9. Differences in perception of ethical thinking skills by demographic and academic factors
Importance Improvement Inclusion Confidence Future use
M (SD) p M (SD) p M (SD) p M (SD) p M (SD) p
Sex .001 .002 .003 .60 .56
Female 3.35 (+.68) 2.88 (+.83) 2.55 (+.72) 2.90 (+.87) 3.07 (+.88)
Male 2.94 (+.82) 2.61 (+.86) 2.34 (+.68) 2.95 (+.83) 2.82 (+.95)
Age .22 .86 .08 .24 .44
19–22 3.16 (+.78) 2.76 (+.86) 2.44 (+.70) 2.94 (+.86) 2.94 (+.93)
23+ 3.30 (+.70) 2.74 (+.83) 2.63 (+.80) 2.78 (+.81) 3.11 (+.85)
University .001 .003 .02 .18 .40
Institution A 3.05 (+.81) 2.66 (+.83) 2.39 (+.64) 2.88 (+.84) 2.89 (+.94)
Institution B 3.35 (+.67) 2.92 (+.87) 2.56 (+.79) 2.99 (+.88) 3.06 (+.88)
Graduate plans .29 .35 .42 .90 .97
No set plans 2.86 (+.66) 2.79 (+.80) 2.50 (+.65) 3.14 (+.77) 2.64 (+.84)
Work force 3.17 (+.76) 2.92 (+.76) 2.58 (+.74) 2.93 (+.81) 2.83 (+.93)
Postgraduate(prof) 3.22 (+.75) 2.76 (+.89) 2.44 (+.72) 2.90 (+.85) 3.09 (+.87)
Postgraduate(res) 3.32 (+.57) 2.68 (+.84) 2.55 (+.80) 2.91 (+.87) 2.45 (+.80)
Other 3.09 (+.86) 2.65 (+.86) 2.38 (+.67) 2.93 (+.92) 2.96 (+.97)
Research experience .75 .84 .97 .71 .86
None 3.16 (+.74) 2.74 (+.86) 2.47 (+.73) 2.88 (+.81) 2.91 (+.92)
Scholarship 3.26 (+.77) 2.75 (+.87) 2.47 (+.74) 2.93 (+.97) 3.13 (+.91)
Course unit 3.13 (+.85) 2.88 (+.82) 2.48 (+.68) 3.00 (+.85) 2.93 (+.86)
Both 3.16 (+.83) 2.77 (+.86) 2.42 (+.63) 2.92 (+.85) 2.99 (+.93)
Note: Bold values represent statistically different perceptions (p , 0.05).
942
C.
Varsa
vsk
yet
al.
Dow
nloa
ded
by [
Way
ne S
tate
Uni
vers
ity]
at 1
0:35
26
Nov
embe
r 20
14
Results from a series of paired t-tests suggest that, on average, students believed the
importance of scientific content knowledge was greater than their improvement, con-
fidence, and future use of this skill (p , 0.05). See Table 3 for a summary of the mean
differences.
In addition, differences between importance of scientific content knowledge and
graduate perceptions, stratified by age, gender, URE, university, and graduate
plans, were also explored. A consistent trend emerged such that individuals across
gender, age, university, and URE reported that importance of scientific content
knowledge was greater than their confidence and future use of this skill (all p ,
0.01) with one exception. There was no difference between perception of importance
and future use of this content knowledge among students without graduate plans (p ¼
0.14). See Table 4 for a summary of the mean differences.
4.1.2 Oral communication skills to make scientific presentations. Females as well as
students from Institution B perceived oral communication to be better improved,
more important and with greater inclusion in the undergraduate science programme
relative to males and students from Institution A, respectively. Those with no URE
reported lower improvement, saw lower inclusion in the programme and predicted
lower future use of oral communication skills compared to students who had partici-
pated in URE.
Students’ perception regarding the importance of communication skills was signifi-
cantly higher than their perception of their improvement, inclusion, confidence, and
future use of these skills (all p , 0.05). In addition, differences between importance of
communication skills and graduate perceptions, stratified by age, gender, URE, uni-
versity, and graduate plans, were also explored and revealed that importance of com-
munication skills was greater than their perception of improvement, confidence, and
inclusion of these skills (all p , 0.05), with some exceptions. Specifically, perceptions
regarding importance and future use of communication skills were the same between
males, students 23 years and older, those who completed a research scholarship,
research course, both a scholarship, and a course and students who plan to work or
‘other’ after graduating from the undergraduate programme (p ¼ 0.08 and p ¼
0.74, respectively). Further null differences were found between inclusion and impor-
tance among those who completed a research scholarship (p ¼ 0.79) and those with
no set plans after graduation (p ¼ 1.00). Null differences were also found with the
latter regarding confidence and importance of communication skills (p ¼ 0.75). See
Table 5 for a summary of the mean differences.
4.1.3 Scientific writing skills. Most differences regarding scientific writing skills
centred on future use of this skill. Older students considered they would use this
skill more in the future. Students with ‘other’ graduate plans reported that they
would utilise scientific writing more in the future relative to those with postgraduate
plans, work, or no plans. Students who planned to work after graduating also thought
they were more likely to use scientific writing relative to those enrolling in
Perceptions of Science Graduating Students 943
Dow
nloa
ded
by [
Way
ne S
tate
Uni
vers
ity]
at 1
0:35
26
Nov
embe
r 20
14
postgraduate research studies as well as those with no plans. Furthermore, students
with course and scholarship research experience also predicted greater future use of
scientific writing compared to students without URE (Table 6).
Students’ perception regarding the importance of writing skills was significantly
higher than their perception of the improvement, inclusion, confidence, and future
use of these skills (all p , 0.001). See Table 3 and Figure 1 for a summary of the
mean differences. In addition, differences between importance of writing skills and
graduate perceptions, stratified by age, gender, URE, university, and graduate
plans, were also explored. Data suggest students older than 23 years, those who com-
pleted a research scholarship, those who completed a research course unit, those with
no set plans as well as those preparing to undertake postgraduate research work after
graduation had the same perception regarding importance of writing skills and
inclusion of writing skills in this programme (p ¼ 0.99–1.00). See Table 4 for a
summary of the mean differences.
4.1.4 Team work skills. Few differences in perceptions were found when examining
team work skills. Females believed team work was more important and more included
in the undergraduate science degree programme. Younger students reported greater
confidence of these skills. Students completing a research scholarship thought team
work had higher inclusion in their programme relative to students completing a
research unit.
Results from paired t-tests suggest that, on average, students believed the impor-
tance of team work skills was greater than their improvement in this skill within the
undergraduate science programme (p , 0.05). However, students also perceived
that team work skills had greater future use relative to the importance they placed
on these skills. Perceptions of importance matched perceptions of inclusion (p ¼
0.20) and confidence (p ¼ 0.91). See Table 3 and Figure 1 for a summary of the
mean differences. In addition, differences between importance of team work skills
and graduate perceptions, stratified by age, gender, URE, university, and graduate
plans, were also explored. Unlike the other graduate skills, ratings of importance rela-
tive to improvement, confidence, inclusion, and future use were the same over cat-
egories of age and gender. This trend of null differences was also found across
university, URE, and graduate plans, with few exceptions. First, students with no
set plans, University A students as well as those with both scholarship and course
experience in research perceived future use of team work skills higher than importance
of team work skills (p , 0.05). See Table 7 for a summary of the mean differences.
4.1.5 Quantitative skills. Males reported higher confidence in this area; older stu-
dents perceived greater future use of these skills. Students planning to enter the work-
force also reported greater inclusion of quantitative skills and higher future use
compared to students planning to undertake postgraduate studies in a professional
area.
944 C. Varsavsky et al.
Dow
nloa
ded
by [
Way
ne S
tate
Uni
vers
ity]
at 1
0:35
26
Nov
embe
r 20
14
Perception regarding the importance of quantitative skills was significantly higher
than their perception of the improvement, inclusion, confidence, and future use of
these skills (all p , 0.001). See Table 3 and Figure 1 for a summary of the mean differ-
ences. This trend was consistent by age, gender, URE, and graduate plans (all p ,
0.001) with few exceptions. Those with no set plans reported similar perceptions
relating to importance and inclusion (p ¼ 1.00) as well as confidence (p ¼ 0.54) in
quantitative skills. See Table 8 for a summary of the mean differences.
4.1.6 Ethical thinking skills. Regarding ethical thinking all differences are centred
on gender and university. Specifically, females as well as University B students per-
ceived ethical thinking skills to be more important, better improved, and more
included in the degree programme compared to their male counterparts and Univer-
sity A students, respectively.
Perception of importance of ethical thinking skills was significantly higher than their
perception of the improvement, inclusion, confidence, and future use of these skills
(all p , 0.001). See Table 3 and Figure 1 for a summary of the mean differences.
Again, this trend was largely consistent across the different socio-demographic and
academic groups explored in this study (all p , 0.05). However, perception of impor-
tance was the same as confidence and future use of ethical thinking among students
who completed a research course unit, both a scholarship and research course unit
and those with no plans after graduation (p ¼ 0.10–.38). Males also had similar per-
ceptions regarding importance and confidence (p ¼ 0.89) with those completing
research scholarships rating importance and future use of ethical thinking (p ¼
0.28) on the same level. See Table 9 for a summary of the mean differences.
5. Discussion
This study gives an insight into how students perceive the development of skills in the
context of science studies, across their whole degree programme, as they approach
graduation. Students will draw upon their skills as they embark on their next stage
in life, be this employment or further studies; hence, a reflection on these skills
close to graduation becomes highly relevant to them. The development of employabil-
ity skills is one of the main reasons students pursue higher education; while a good
qualification is important when seeking employment, employers are now more inter-
ested in the set of skills they have to offer rather than grades (Yorke, 2006).
5.1 Perceptions of Importance, Improvement, Inclusion, Confidence, and Future Use of
Science Skills
Students reported all six skills to be important, although ethical thinking, quantitative
skills, and teamwork were perceived to be less important than scientific content
knowledge, oral communication, and scientific writing. On average, students consist-
ently reported that most graduate skills were moderately improved throughout their
Perceptions of Science Graduating Students 945
Dow
nloa
ded
by [
Way
ne S
tate
Uni
vers
ity]
at 1
0:35
26
Nov
embe
r 20
14
programme, they saw them included a moderate amount in their programme, and stu-
dents were moderately confident in applying these skills, and would use them in the
future. High and low ratings of these skills show a similar picture, with the majority
of students consistently viewing these skills as having high importance, high inclusion,
high improvement, have high confidence in applying them, and see high future use.
In this analysis two of the six skills stand out: quantitative skills and ethical thinking.
Although these show similar patterns as the other four skills, more students reported
lower importance, inclusion, improvement, confidence, and future use of these skills.
These perceptions seem to be a reflection of the curriculum. Despite general agree-
ment across the world that quantitative skills are essential graduate outcomes (Mat-
thews, Belward, Coady, Rylands, & Simbag, 2012), the importance of mathematics
in science programmes has been de-emphasised (Berlin & Hyonyong, 2005;
Brown, 2009; Koenig, 2011). On the other hand, the role of ethics in the science cur-
riculum has not been discussed up until recently (Atweh & Brady, 2009; Boyd et al.,
2008; Reiss, 1999) and has largely focused on plagiarism. Our results suggest that not
enough attention is being paid to ethics in the science curriculum, despite it being
articulated as a graduate attribute in the science threshold learning outcomes (Yates
et al., 2011).
Overall, perception of importance of all six science skills being included in the cur-
riculum was greater than perception of improvement, inclusion, confidence, and
future use. The only exception was team work; this skill was perceived consistently
across socio-demographic and academic groups of students as being highly relevant
in their future. The perceptions of our respondents match Saunders and Zuzel’ find-
ings (2010) that teamwork was rated more highly than other skills by bioscience
graduates and their employers. Learning in teams does not only help students build
team work skills; studies in the context of science have shown that small group learn-
ing also has positive effects on student attitudes towards learning (Springer, Stanne, &
Donovan, 1999) and on performance (Gupta, 2004). Interestingly, the participants of
our study felt very confident about their team work skills even when they saw this skill
less included in the curriculum. Greater research is required to understand how and
where students develop team work skills.
5.2 Demographic Differences in Perceptions
There were some differences in perceptions across the different demographic groups.
Most notably, gender showed significant differences in perceptions across most skills.
Male students reported greater confidence in scientific content knowledge and in
quantitative skills.
On the other hand, their female counterparts assigned greater importance to oral
communication, scientific writing, team work and ethical thinking and saw greater
inclusion of communication, teamwork, and ethical thinking skills. There is a
dearth of literature on gender differences in perception and development of skills in
the science context; however, our findings are largely consistent with the few
studies related to these. A UK study found that male students are more confident
946 C. Varsavsky et al.
Dow
nloa
ded
by [
Way
ne S
tate
Uni
vers
ity]
at 1
0:35
26
Nov
embe
r 20
14
in quantitative skills than their female counterparts. (Tariq, Qualter, Roberts,
Appleby, & Barnes, 2012). Other studies concluded that females prefer teamwork
and gain more educational benefits than males (Curran, Sharpe, Forristall, &
Flynn, 2008; Wainer, Bryant, & Strasser, 2001). Research at the university level on
ethics teaching has largely been conducted in business-related fields; one such
study found that female university students showed more favourable perception
towards ethics than males (Luthar, DiBattista, & Gautschi, 1997). An Australian
study of tertiary entrance exam performance found that females scored higher on
written communication than males (Cox, Leder, & Forgasz, 2004). Finally, when
researching attitudes of high school students towards science as they were choosing
their university studies, Miller, Slawinski Blessing, and Schwartz (2006) found that
females were more interested than males in majors that were more people oriented
and they choose science largely because of the skills required to achieve this end.
This may explain why women doing science assign greater importance to oral com-
munication, scientific writing, team work, and ethical thinking.
Our study found that students with URE of some kind report greater improvement
of their communication skills, even when they do not assign greater importance to this
skill. Furthermore, those who had both types of research experiences (scholarship and
course unit) also predict greater use of scientific writing and oral communication in
the future. It could be argued that the latter group had in mind a postgraduate
pathway that will require those skills; however, this is not reflected in the differences
seen in their future plans: those with plans for postgraduate studies did not rate higher
the future use of scientific writing and communication. The present findings support
prior research on the benefits of URE (Seymour, Hunter, Laursen, & DeAntoni,
2004).
With relation to future plans, those with plans other than postgraduate studies or
workforce saw greater future use for scientific content knowledge. It is not obvious
why this is the case, and no literature was found to explain it; further investigation
will be required to understand this difference. Finally, age seems to influence percep-
tions of scientific writing and team work skills, with older students seeing greater
future use and greater confidence with team work skills. It is likely that older students
have already operated in a workplace, and hence have the benefit of the insight into the
requirements of employment (Saunders & Zuzel, 2010).
Students from both institutions responded consistently across most variables and
skills, with two exceptions. These related to oral communication and ethical thinking
where importance, improvement, and inclusion of these two skills were rated higher in
one of the two institutions. This is surprising, as it would appear that the teaching and
assessment practices of the two institutions are comparable; further research will be
required to understand what lies behind these differences.
6. Conclusion and Further Research
This quantitative study gives a picture of student perceptions about their science skill
set as they are about to enter their next stage in life after their undergraduate degree.
Perceptions of Science Graduating Students 947
Dow
nloa
ded
by [
Way
ne S
tate
Uni
vers
ity]
at 1
0:35
26
Nov
embe
r 20
14
Overall, student perceive all six skills as important, they report moderate improve-
ment, see them moderately included in their programme, feel moderately confident
and they see themselves using them in their future. Perceptions of importance of
these skills are greater than perceptions of improvement, inclusion in the programme,
confidence, and future use. Quantitative skills and ethical thinking were perceived by
more students to be less important. Team work skills were perceived as having greater
future use, but were seen less often in their programme. Some differences in percep-
tion across different demographic groups were found. Most notably, gender showed
significant differences across most skills. Male students reported greater confidence
in scientific content knowledge and in quantitative skills; female students assigned
greater importance to oral communication, scientific writing, team work and ethical
thinking and saw greater inclusion of communication, teamwork, and ethical thinking
skills.
Caution should be exercised when generalising these results. The data set analysed
is large, but it should be noted that data represent perceptions of only about half of the
students surveyed, and that this study involved two very similar institutions with a
strong focus on research. Also, our study does not attempt to explain these percep-
tions and the differences found across demographic groups.
The present study has several implications for curriculum reform and further
research. An examination of teaching and assessment practices is required to under-
stand the difference of perception of importance of skills and improvement, inclusion,
confidence, and future use. For example, how are these skills integrated throughout
the programme? Are they explicitly included in the teaching and in the assessment
tasks? Does performance on these skills count towards their grades? The use of a
survey on student perceptions of their skills has several advantages for curriculum
reform. First, student surveys focused on a particular programme taught within an
institution provide valuable information for short-term curriculum changes; unlike
national and institutional generic surveys, a programme directed survey can provide
information in a timely fashion allowing responsive changes to be made to curricula
(Harris et al., 2010). Second, students are more likely to be responsive to a survey
that comes from the academics who teach them as opposed to administrators from
institutions or government (Denson, Loveday, & Dalton, 2010), and hence the infor-
mation gathered is of greater value. Finally, programme level surveys of perceptions of
skills provide an opportunity to engage all academics teaching into the programme, to
increase their familiarity with the programme intended learning skills, and hence
improve teaching and assessment practices (de la Harpe & David, 2012).
Future research should examine several areas. First, our results would be enriched
with a qualitative approach to explain student perceptions of importance, inclusion,
improvement, confidence, and future use of science skills. Second, further work
needs to be done to understand student perceptions of where, how, and when
science skills are developed. For example, a possible line of inquiry could seek to
complement the study by Leggett et al. (2004) to gain greater understanding of
student perceptions of their science skills as they progress level by level from the com-
mencement of their programme through to graduation. Third, more research
948 C. Varsavsky et al.
Dow
nloa
ded
by [
Way
ne S
tate
Uni
vers
ity]
at 1
0:35
26
Nov
embe
r 20
14
contextualised in undergraduate science is required to understand the demographic
differences found in this study, particularly gender differences on perceptions about
ethics and teamwork. Fourth, because our findings are in the context of large
research-intensive universities, it is important to question if they can be generalised
to other institutions. Finally, studies that examine the relationship between student
perceptions of learning gains in science skills and academic assessment of those
gains would greatly benefit the higher education sector.
References
Anaya, G. (1999). College impact on student learning: Comparing the use of self-reported gains,
standardized test scores, and college grades. Research in Higher Education, 40(5), 499–526.
Atweh, B., & Brady, K. (2009). Socially response-able mathematics education: Implications of an
ethical approach. Eurasia Journal of mathematics, science & technology education, 5(3), 267–276.
Australian Learning and Teaching Council. (2010). Learning and teaching academic standards
(LTAS) project.
Barrie, S. C. (2007). A conceptual framework for the teaching and learning of generic graduate attri-
butes. Studies in Higher Education, 32, 439–458. doi:10.1080/03075070701476100
Berlin, D. F., & Hyonyong, L. (2005). Integrating science and mathematics education: Historical
analysis. School Science and Mathematics, 105, 15–24.
Boyd, W. B. E., Healey, R. L., Hardwick, S. W., Haigh, M., Klein, P., Doran, B., . . ., Bradbeer, J.
(2008). ‘None of us sets out to hurt people’: The ethical geographer and geography curricula in
higher education. Journal of Geography in Higher Education, 32(1), 37–50.
Brown, G. (2009). Review of education in mathematics, data science and quantitative disciplines: Report
to the Group of Eight Universities. Canberra: Group of Eight.
Brownell, S. E., & Tanner, K. D. (2012). Barriers to faculty pedagogical change: Lack of training,
time, incentives, and . . . Tensions with professional identity? Life Sciences Education, 11(4),
339–346.
Coates, H. (2009). What is the difference? A model measuring the value added by higher education
in Australia. Higher Education Management and Policy, 21(1), 77–96. Retrieved from http://
www.oecd.org/edu/imhe/50309916.pdf
Coates, H., & Richardson, S. (2011). An international assessment of bachelor degree graduates’
learning outcomes. Higher Education Management and Policy, 23(3), 51–70.
Cox, P. J., Leder, G. C., & Forgasz, H. J. (2004). Victorian certificate of education: Mathematics,
science and gender. Australian Journal of Education, 48(1), 27–46.
Curran, V. R., Sharpe, D., Forristall, J., & Flynn, K. (2008). Attitudes of health sciences students
towards inter professional teamwork and education. Learning in Health and Social Care, 7(3),
146–156.
Denson, N., Loveday, T., & Dalton, H. (2010). Student evaluation of courses: What predicts satis-
faction? Higher Education Research and Development, 29, 339–356. doi:10.1080/
07294360903394466
Douglass, J. A., Thomson, G., & Zhao, C. M. (2012). The learning outcomes race: The value of
self-reported gains in large research universities. Higher Education, 64(3), 317–335.
Ewell, P. T. (2013). The lumina degree qualifications profile (DQP): Implications for assessment.
Occasional Paper# 16. National Institute for Learning Outcomes Assessment.
Gupta, M. L. (2004). Enhancing student performance through cooperative learning in physical
sciences. Assessment & Evaluation in Higher Education, 29(1), 63–73.
de la Harpe, B., & David, C. (2012). Major influences on the teaching and assessment of graduate
attributes. Higher Education Research & Development, 31, 493–510. doi:10.1080/
07294360.2011.629361
Perceptions of Science Graduating Students 949
Dow
nloa
ded
by [
Way
ne S
tate
Uni
vers
ity]
at 1
0:35
26
Nov
embe
r 20
14
Harris, L., Driscoll, P., Lewis, M., Matthews, L., Russell, C., & Cumming, S. (2010). Implement-
ing curriculum evaluation: Case study of a generic undergraduate degree in health sciences.
Assessment & Evaluation in Higher Education, 35(4), 477–490.
Henderson, C., Beach, A., & Finkelstein, N. (2011). Facilitating change in undergraduate STEM
instructional practices: An analytic review of the literature. Journal of Research in Science Teach-
ing, 48(8), 952–984.
Klein, S., Benjamin, R., Shavelson, R., & Bolus, R. (2007). The collegiate learning assessment:
Facts and fantasies. Evaluation Review, 31, 415–439. doi:10.1177/0193841X07303318
Koenig, J. (2011). A survey of the mathematics landscape within bioscience undergraduate and postgradu-
ate UK higher education. Leeds: UK Centre for Bioscience, Higher Education Academy.
Kuh, G. (2001). Assessing what really matters to student learning: Inside the national survey of
student engagement. Change, 33(3), 10–17.
Kuh, G., & Ewell, P. (2010). The state of learning outcomes assessment in the United States. Higher
Education Management and Policy, 22(1), 1–20.
Leggett, M., Kinnear, A., Boyce, M., & Bennett, I. (2004). Student and staff perceptions of the
importance of generic skills in science. Higher Education Research & Development, 23,
295–312. doi:10.1080/0729436042000235418
Luthar, H. K., DiBattista, R. A., & Gautschi, T. (1997). Perception of what the ethical climate is
and what it should be: The role of gender, academic status, and ethical education. Journal of
Business Ethics, 16(2), 205–217.
Matthews, K., & Hodgson, Y. (2012). The science students skills inventory: Capturing graduate
perceptions of their learning outcomes. International Journal of Innovation in Science and Math-
ematics Education, 20(1), 24–43.
Matthews, K. E., Belward, S., Coady, C., Rylands, L., & Simbag, V. (2012). The state of quantitative
skills in undergraduate science education: Findings from an Australian study. Australia: Office for
Learning and Teaching (OLT).
Miller, P. H., Slawinski Blessing, J., & Schwartz, S. (2006). Gender differences in high-school stu-
dents’ views about science. International Journal of Science Education, 28(4), 363–381.
National Academy of Sciences. (2006). Rising above the gathering storm: Energizing and employing
America for a brighter economic future. Washington, DC: NAS Committee on Science, Engineer-
ing and Public Policy.
Organisation for Economic Cooperation and Development (OECD). (2006). Evolution of student
interest in science and technology studies: Policy report. Paris: OECD Global System Forum.
Quality Assurance Agency (QAA). (2009). Subject benchmark statements. Retrieved from www.qaa.
ac.uk
Ramsden, P. (1991). A performance indicator of teaching quality in higher education: The course
experience questionnaire. Studies in Higher Education, 16, 129–150. doi:10.1080/
03075079112331382944
Reiss, M. J. (1999). Teaching ethics in science. Studies in Science Education, 34, 115–140.
Roberts, G. (2002). SET for success: The supply of people with science, engineering and mathematics skills.
London: HM Treasury.
Santiago, P., Tremblay, K., Basri, E., & Arnal, E. (2008). Tertiary education for the knowledge society,
Vol 1. Paris: OECD.
Saunders, V., & Zuzel, K. (2010). Evaluating employability skills: Employer and student percep-
tions. Bioscience Education, 15, 1–15.
Seymour, A. D., Wiese, D. A., Hunter, A., & Daffinrud, S. M. (2000). Creating a better mousetrap:
On-line student assessment of their learning gains. Proceedings of National Meeting of the Amer-
ican Chemical Society, San Francisco, CA.
Seymour, E., Hunter, A. B., Laursen, S. L., & DeAntoni, T. (2004). Establishing the benefits of
research experiences for undergraduates in the sciences: First findings from a three-year
study. Science Education, 88, 493–534. doi:10.1002/sce.10131
950 C. Varsavsky et al.
Dow
nloa
ded
by [
Way
ne S
tate
Uni
vers
ity]
at 1
0:35
26
Nov
embe
r 20
14
Spencer,D., Riddle, M., &Knewstubb, B. (2012). Curriculummapping toembed graduate capabilities.
Higher Education Research & Development, 31, 217–231. doi:10.1080/07294360.2011.554387
Springer, L., Stanne, M. E., & Donovan, S. S. (1999). Effects of small-group learning on under-
graduates in science, mathematics, engineering, and technology: A meta-analysis. Review of
educational research, 69(1), 21–51.
Surridge, P. (2008). The national student survey 2005–2007: Findings and trends. A report to the Higher
Education Funding Council for England. Retrieved from http://www.hefce.ac.uk/pubs/rdreports/
2008/rd12_08/rd12_08.pdf
Tariq, V. N., Qualter, P., Roberts, S., Appleby, Y., & Barnes, L. (2012). Mathematical literacy: Role of
gender and emotional intelligence. STEM Annual Conference, London. Retrieved from http://
www.heacademy.ac.uk/assets/documents/stemconference/MSOR/Vicki_Tariq.pdf
Tuning Association. (2011). Tuning educational structures in Europe. Retrieved from www.unideusto.
org/tuningeu/home.html
Wainer, J., Bryant, L., & Strasser, R. (2001). Sustainable rural practice for female general prac-
titioners. Australian Journal of Rural Health, 9(Suppl), S43–S48.
Walker, P. (2008). What do students think they (should) learn at college? Student perceptions of
essential learning outcomes. Journal of the Scholarship of Teaching and Learning, 8(1), 45–60.
Wieman, C. E. (2007). Why not try a scientific approach to science education? Change, 39(5), 9–15.
Wieman, C. E., Perkins, K., & Gilbert, S. (2010). Transforming science education at large research
intensive universities: A case study in progress. Change, 42(2), 6–14.
Wood, W. B. (2009). Revising the AP biology curriculum. Science, 325, 1627–1628.
Wyer, M. (2003). Intending to stay: Images of scientists, attitudes toward women, and gender as
influences on persistence among science and engineering majors. Journal of Women and Min-
orities in Science and Engineering, 9(1), 1–16.
Yates, B., Jones, S., & Kelder, J. (2011). Learning and teaching academic standards project: Science.
Final report. Retrieved from http://www.olt.gov.au/resource-learning-and-teaching-academic-
standards-science-2011
Yorke, M. (2006). Employability in higher education: What it is – What it is not. York: Higher Edu-
cation Academy.
Perceptions of Science Graduating Students 951
Dow
nloa
ded
by [
Way
ne S
tate
Uni
vers
ity]
at 1
0:35
26
Nov
embe
r 20
14