mwsu admissions page - usability testing methods & results
TRANSCRIPT
MWSU ADMISSIONS WEBPAGE
Nelson (Team Lead)
Hicks
Khalandi
Madannagari
AGENDA
1. Primary Question
a. Developer Needs
2. Testing Methods
a. Tasks
b. Laboratory Testing
c. Guerrilla Testing
3. Results
4. Strengths & Opportunities
5. Conclusion
PRIMARY QUESTION What are we looking to find out?
DEVELOPER NEEDS
1. We want people to easily find the “Apply” page.
2. We want people to easily find the "Join our Mailing List" button.
3. Can students find information regarding their particular student type?
4. Are students able to easily schedule a campus visit appointment?
5. Can students easily find the Majors/Minors section of our Admissions website?
6. Is the scholarships and tuition pages of the admissions page easily navigable?
Hicks Khalandi Madannagari Nelson
Primary Question
PRIMARY QUESTION
Is the Admissions page user-friendly?
Are users finding the information they're looking for?
Hicks Khalandi Madannagari Nelson
Primary Question
TESTING METHODSTasks
Laboratory Testing
Guerrilla Testing
METHODS
Laboratory Setting
• Formal usability testing
• Conducted on campus
• Recruited 5 MWSU undergraduate students
• Signed consent form
• Think-aloud method
• Completed 7 tasks per participant
• Recorded sessions using Camtasia
Guerrilla Style
• Less formal usability testing
• Conducted at Lafayette High School
• Recruited 5 high school seniors
• Signed consent form
• Think-aloud method
• Completed 7 tasks per participant
• Recorded sessions using MoraeTesting Methods
MEASURES COLLECTED
1. Effectiveness
2. Efficiency
3. Error
4. Task completion rate
5. Satisfaction
Testing Methods
RESULTS
Click icon to add picture
EFFICIENCYTIME ON TASK
Results
Apply
Mai
ling
Tran
sfer
Step
s to
Enr
oll
Appoi
ntm
ent
Nursin
g
Scho
lars
hip
0
20
40
60
80
100
120
140
160
LabGuerrilla
Tim
e o
n T
ask
(se
c)
EFFECTIVENESSNUMBER OF CLICKS
Results
Apply
Mai
ling
Tran
sfer
Step
s to
Enr
oll
Appoi
ntm
ent
Nursin
g
Scho
lars
hip
0
2
4
6
8
10
12
14
LabGuerrilla
Nu
mb
er
of
Cli
ck
s
ERRORS
Results
Apply
Mai
ling
Tran
sfer
Step
s to
Enr
oll
Appoi
ntm
ent
Nursin
g
Scho
lars
hip
0
1
2
3
4
5
6
7
LabGuerrilla
Ave
rag
e E
rro
r
COMPLETION RATE
Apply Mailing Transfer Steps to Enroll
Appointment Nursing Scholarship0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
LabGuerrilla
Co
mp
leti
on
Ra
te (
%)
Results
SATISFACTION
Ease of Completion Time Support Info5
5.2
5.4
5.6
5.8
6
6.2
6.4
6.6
LabGuerrilla
Ave
rag
e S
ati
sfa
cti
on
Results
MOST DIFFICULT/FRUSTRATING
Results
Apply
Mai
ling
Tran
sfer
Step
s to
Enr
oll
Appoi
ntm
ent
Nursin
g
Scho
lars
hip
0
2
4
6
8
10
12
14
16
Most FrustratingMost Difficult
LEAST DIFFICULT/FRUSTRATING
Results
Apply
Mai
ling
Tran
sfer
Step
s to
Enr
oll
Appoi
ntm
ent
Nursin
g
Scho
lars
hip
0
2
4
6
8
10
12
14
16
Least FrustratingLeast Difficult
FUNCTION AS EXPECTED?
Results
YES NO
STRENGTHS & OPPORTUNITIES
USABILITY SCORE
Strengths & Opportunities
Clicks TimeIncomplete
RateErrors
Usability Score
USABILITY SCORES
Strengths & Opportunities
Apply
Mai
ling
Tran
sfer
Step
s to
Enr
oll
Appoi
ntm
ent
Nursin
g
Scho
lars
hip
0
20
40
60
80
100
120
140
160
63.2
100
73.4
150
71.2
139.4
42.447.2
102.6
50.8
139.2
88.4
68.8
53 LabGuerrilla
Usa
bil
ity S
co
re
Apply Mailing Transfer Steps to Enroll
Appointment Nursing Scholarship0
20
40
60
80
100
120
140
160
55.7
101.8
62.6
146.6
79.8
104.1
47.7
Usa
bil
ity S
co
re
Strengths & Opportunities
COMBINED USABILITY SCORE
COMBINED USABILITY SCORESTRENGTHS
Apply Mailing Transfer Steps to Enroll
Appointment Nursing Scholarship0
20
40
60
80
100
120
140
160
55.7
101.8
62.6
146.6
79.8
104.1
47.7
Usa
bil
ity S
co
re
Strengths & Opportunities
COMBINED USABILITY SCOREOPPORTUNITIES
Apply Mailing Transfer Steps to Enroll
Appointment Nursing Scholarship0
20
40
60
80
100
120
140
160
55.7
101.8
62.6
146.6
79.8
104.1
47.7
Usa
bil
ity S
co
re
Strengths & Opportunities
COMBINED USABILITY SCOREOPPORTUNITIES
Apply Mailing Transfer Steps to Enroll
Appointment Nursing Scholarship0
20
40
60
80
100
120
140
160
55.7
101.8
62.6
146.6
79.8
104.1
47.7
Usa
bil
ity S
co
re
Strengths & Opportunities
CONCLUSION
CONCLUSION
• Users were satisfied with the Admissions site overall
• Majority of users were able to complete all tasks
• Main issue we found – Task 4 (Find the steps to enroll)
• Did the site function as expected?
• “No because other colleges have a better layout to find direct access to the necessary
page.”
• “I feel the program could be better, but as a senior I find it the easiest to guide through,
compared to other college websites. I would improve the 'profile' pages and the
'apply/enroll' pages”Conclusion
TASK 4
Find the steps to enroll at MWSU
TASK 2
How would you get admissions information about MWSU sent to you?
LESSONS LEARNED
• Organization pays off
• Communication
• Better formatting our questionnaires
• High schools offer a great source of users
Conclusion
QUESTIONS Don’t be shy!
TASKS
1. As a high school student, where would you go to apply to MWSU?
2. How would you get admissions information about MWSU sent to you?
3. Where would you go to find admissions information about transferring to MWSU?
4. Find the steps to enroll at MWSU.
5. Schedule an appointment with the admissions office for November 13th at
1:30pm.
6. Where would you go to find information about majoring in nursing?
7. Where would you go to find information about scholarships for transfer students?Testing Methods