Usability Test Findings

Aequum Global BusinessSabah Raja, Parlin Roziya, Jessica Lam, Shalinka Kudahetty

December 2, 2016

Agenda1) Team members and roles

2) Process overview

3) Heuristic evaluation

4) Test plan overview

5) Participant information

6) Test findings

7) Results

8) Recommendations

Introduction: Team Members and RolesRole Team Member Responsibilities

Moderator Parlin Roziya Greets participant, follow the moderator script through the test. Present the gift at the end of the session and escort participant out.

Technician Jessica Lam Operates control room equipment.

Observer Sabah Raja, Shalinka Kudahetty, Jessica Lam

Observes the participant and records findings.

Writer and Editor Parlin Roziya, Sabah Raja, Jessica Lam, Shalinka Kudahetty.

Writes and edits usability documents.

Process Overview1) Heuristic Study

2) Test Plan

3) Usability Testing

4) Test Findings

Heuristic Evaluation • Heuristic Evaluation was done in order to determine the usability of Aequum Global Access’ website http://aequumglobalaccess.com/ .

• Used Jakob Nielsen's 10 Usability Heuristics for User Interface Design and Deniese Pierotti’s Heuristic Evaluation - A System Checklist.

• Following Heuristics apply to original website:

1. Visibility of System Status 2. Match Between Systems and the Real World 3. Consistency and Standards 4. Aesthetic and Minimalist Design 5. Error Prevention

Test Plan OverviewBased on the finding from the Heuristic evaluation, by Barnum and team discussions. The purpose of the test objectives was to evaluate the user’s ability to:

● Find information (i.e. about Aequum, founder) on the site.

● To test out what kind of problems the user run into as they navigate the site.

● Contact the business through the email form on the site.

● Join an event through the Aequum site.

● Calculate the time it takes for a user navigate through the site.

Participant Information• Age: 41 – 50 • Gender: Female • Used computers since: more than 12 months • Platforms for surfing web: desktop and mobile • Preferred web browsers: Google Chrome and Safari • Hours per week on internet: more than 20 hours • Favourite Internet activity: researching and shopping • Knows about accessibility: yes • Owns a business: no

Test Schedule and Test Day Information

Testing date: November 11, 2016

9:00 am – 9:05 am (5 mins) Introduction and briefing 9:05 am – 9:15 am (10 mins) Pre-test questionnaire

9:15 am – 9:45 am (30 mins) Task scenarios (6 total)

9:45 am – 10:00 am (15 mins) Debriefing

Presentation date: December 9, 2016

9:30 am – 10:00 am (30 mins) Presentation to Aequum

Location: Room J216, Sheridan College Trafalgar campus, Oakville ON

Positive Findings● Sending an email through the website was easy.

○ Participant was able to complete the task with ease.

● Likes the Event option on the site, the participant did not know about these events

happening in her area.

● Found that the information on the site provided is very useful.

Negative Findings● Unable to reach to other content from the About submenu because the text-to-speech software was not able

to reach hover links.

● Too many similar buttons throughout the page.

○ Prefers to have a menu on top and in footer.

● Need more information about AODA (i.e. why is it important? Who needs this?) since the topic is very broad.

● Confused as to how to get back to the homepage since the site did not have a Home button.

System Usability Score (SUS)• The SUS is a set of ten questions on a system usability, developed by John

Brooke.

• Scale: 1 (strongly disagree) to 5 (strongly agree)

• The SUS of the site is 95%, making the site very usable.

Recommendations• Information on Founder: create a sub menu

for the main About page that links other about pages of the business to allow text-to-speech users to access the information, currently the text-to speech users cannot access the sub-menu hover buttons.

Recommendations• Homepage Buttons: consider

removing the buttons on the feature images (home page), it currently uses up navigation time for text-speech-users.

• Instead, replace the buttons with a single button that links to the bottom of the page that contains the information about the business.

Recommendations• Content Reduction: reduce the amount of information on the website to avoid

repeating the same information on more than one page.

• Information Content: Consider providing information about the importance of AODA as users may not understand its significant purpose to their business. Perhaps consider to link the user to Canada’s Stats site for more information about AODA or a PDF containing the information.

• Text Alignment: align the text and avoid using too many bullet points, currently the unaligned text and bullets causes the text-to-speech function to skip the content.

Recommendations• Footer Menu: consider removing the contact information and about Aequum

information on the footer to lessen the navigation time for text-to speech users.

ConclusionsThe aequumglobalaccess.com site is very usable.

• Positive feedback from the test and questionnaire.

• Has a system usability score (SUS) of 95%, the average is 68%

• Participant is likely to return to the site and would refer the site to a friend.

Seed Questions1) How did we create and developed the task scenarios for the text-to-speech participant?

2) What is the most significant issue on the site?

Appendix 1We contacted our participant via email and asked her how she navigates through websites. The participant informed us that she uses a text-to-speech function to navigate through website and prefers to use her own laptop.

Through this feedback, we created scenarios based from her perspective (a text-to-speech stand point). We did a few test on how text-to-speech works and decided what scenarios to use to test for the participant.

Appendix 2Overall, the significant issue on the website is the time it takes for the participant to navigate through the website. This is due to the large amount of information, which is repetitive throughout the website. In addition, there are too many similar buttons on the website that could have been removed.