usability test plan for blogger mobile application · usability test plan for blogger mobile...

17
Prepared For: Kevin McGowan, Project Sponsor Luke Bjerring, Software Engineer Completed By: Alanna Lewis Blogger.com 7/20/2015 Usability Test Plan for Blogger Mobile Application

Upload: others

Post on 22-May-2020

11 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Usability Test Plan for Blogger Mobile Application · Usability Test Plan for Blogger Mobile Application 2015 Page | 3 Purpose The purpose of the Blogger Mobile Application usability

Prepared For:

Kevin McGowan, Project Sponsor

Luke Bjerring, Software Engineer

Completed By:

Alanna Lewis

B l o g g e r . c o m

7 / 2 0 / 2 0 1 5

Usability Test Plan for Blogger Mobile Application

Page 2: Usability Test Plan for Blogger Mobile Application · Usability Test Plan for Blogger Mobile Application 2015 Page | 3 Purpose The purpose of the Blogger Mobile Application usability

Usability Test Plan for Blogger Mobile Application 2015

Page | 2

Table of Contents

Purpose ................................................................................................................................ 3 User Profiles Summary ......................................................................................................... 4

User 1 ............................................................................................................................... 4

User 2 ............................................................................................................................... 4

User 3 ............................................................................................................................... 4

Problem Statement and Test Objectives ............................................................................... 5

Test Environment ................................................................................................................. 6

Methodology ......................................................................................................................... 6

Number of Participants ...................................................................................................... 6

Length of Sessions ............................................................................................................ 7

Test Procedure ..................................................................................................................... 7

Pre-Test Questionnaire and Lab Orientation ..................................................................... 7

User Specific Scenarios .................................................................................................... 7

Post-Test Questionnaire and Closing ................................................................................ 7

Appendix A: User Scenarios and Tasks................................................................................ 8

User 1 Scenarios ............................................................................................................... 8

Scenario 1 ...................................................................................................................... 8

Scenario 2 ...................................................................................................................... 9

Scenario 3 ...................................................................................................................... 9

User 2 Scenarios ............................................................................................................. 10

Scenario 1 .................................................................................................................... 10

Scenario 2 .................................................................................................................... 11

Scenario 3 .................................................................................................................... 11

User 3 Scenarios ............................................................................................................. 12

Scenario 1 .................................................................................................................... 12

Scenario2..................................................................................................................... 12

Scenario 3 .................................................................................................................... 13

Appendix B: Pre-Test Questionnaire .................................................................................. 14

Appendix C: Post-Test Questionnaires ............................................................................... 15

User 1 Post-Test Questionnaire ...................................................................................... 15

User 2 Post-Test Questionnaire ...................................................................................... 16

User 3 Post-Test Questionnaire ...................................................................................... 17

Page 3: Usability Test Plan for Blogger Mobile Application · Usability Test Plan for Blogger Mobile Application 2015 Page | 3 Purpose The purpose of the Blogger Mobile Application usability

Usability Test Plan for Blogger Mobile Application 2015

Page | 3

Purpose The purpose of the Blogger Mobile Application usability test is to collect feedback

regarding how users use the Mobile application on both iOS and Android mobile

devices, including tablets, iPads and mobile phones. The usability test will also collect

feedback about problems users may encounter while using the application, and what

improvements users would like to see made to the Blogger mobile application in order

to improve the user experience.

Mr. Kevin McGowan, is the project sponsor, and is working closely with Luke Bjerring,

the Blogger software engineer. They would like to learn about users’ experiences on

Android devices as compared to their experiences on iOS devices.

The test plan describes:

user profiles to recruit for testing

problem statement and test objectives

testing methodology

test environment and equipment required in the usability center

test procedure

User scenarios

o Appendix A: User Scenarios and Tasks

questionnaires in appendices:

o Appendix B: Pre-Test Questionnaire

o Appendix C: Post-Test Questionnaire

Page 4: Usability Test Plan for Blogger Mobile Application · Usability Test Plan for Blogger Mobile Application 2015 Page | 3 Purpose The purpose of the Blogger Mobile Application usability

Usability Test Plan for Blogger Mobile Application 2015

Page | 4

User Profiles Summary To recruit prospective test participants, five user profiles were developed and submitted

previously. Personas for each user were also developed and submitted. Three of these

five user profiles will be the target for participant recruitment. The following user profiles

were selected as they represent target audiences for customer expansion for Blogger.

User 1 Bill Keeley, age 65

Goals:

Grow his business’ customer base.

Showcase specialty work done by his company.

Educate potential clients about his products.

“I need to spread the word about my business, but I have very little time to invest in this

project. I need to showcase my work and connect with new clients. This tool needs to

be effective and efficient.”

User 2 Melanie Nicholls, age 22

Goals:

Document her travels, and share her experiences with friends and family.

Create a journal for herself.

Upload pictures.

“I have lots of friends and family who want to follow my journey, many of who are looking for tips

for their own trips. I want to be able to share my experiences with them, and have a journal of

lasting memories for myself.”

User 3 Bethany Shaw, age 37

Goals:

Host her resume.

Keep a current portfolio online.

Accept freelance jobs.

“I need a site that I can customize to get the right look and feel for me, but that I won’t have to

build from scratch, that’s too much like my work.”

Page 5: Usability Test Plan for Blogger Mobile Application · Usability Test Plan for Blogger Mobile Application 2015 Page | 3 Purpose The purpose of the Blogger Mobile Application usability

Usability Test Plan for Blogger Mobile Application 2015

Page | 5

Problem Statement and Test Objectives The usability test of the Blogger Mobile Application will provide qualitative and

quantative data addressing Blogger’s corporate management team and Blogger’s

software engineers’ interest in understanding the user experience across multiple

platforms. We will assess the users’ experience with creating an account, personalizing

a blog, and uploading photos across multiple devices, as well as overall satisfaction with

the mobile application. Tasks for testing the Blogger Mobile Application will include:

The general feeling/layout of the application:

o Is the layout comparable across multiple devices and operating systems?

Does the layout suggest the route first time users will take to create a

blog?

The procedure for creating an account:

o Entering personal information – does the application require reasonable

information from users?

o Are users able to easily create an account on all platforms including iOS

and Android devices?

The procedure for personalizing a blog:

o Are users able to easily select a template for their blog?

o Are users able to personalize and edit a template?

o Are users able to develop their own blog layout if they have prior

knowledge with web design?

o Is template display consistent and accurate across both Android and iOS

devices?

o Is template selection and application intuitive for the user?

The procedure for uploading photos:

o Are users able to easily upload photos taken on their mobile device?

o Are users able to easily upload photos from their email on a mobile

device?

o Are upload procedures intuitive for the users?

o Are upload procedures comparable across both Android and iOS devices?

Navigation:

o Can users intuitively navigate the application across all devices?

Satisfaction:

o Which aspects do users like and which aspects do they dislike?

o What would users like to see improved?

o Are satisfaction levels consistent across all devices and operating

systems?

Page 6: Usability Test Plan for Blogger Mobile Application · Usability Test Plan for Blogger Mobile Application 2015 Page | 3 Purpose The purpose of the Blogger Mobile Application usability

Usability Test Plan for Blogger Mobile Application 2015

Page | 6

This usability study will be designed to allow us to obtain mostly qualitative data. The

questions used in the testing were developed from a range of user personas, including

target audiences across a wide age range. The focus of the study will be task-oriented.

Participants will be given a pre-test questionnaire to obtain information about their

typical device usage, preferred operating system, prior usage of Blogger and/or similar

blogging applications, as well as their expectations regarding the mobile application.

Participants will be given scenarios that direct them to perform specific tasks that will

help assess the issues listed in the questions above. Post-test questionnaires will be

completed after each scenario, as well as a summative questionnaire with opportunity

for user comments at the end of the testing session.

Participants will be scheduled in sessions 90 minutes in length to include pre-test and

post-test questionnaires. Users will be given one hour to complete 3 scenarios using

two different devices. Before and after the scenarios are complete users will be given a

15 minute window to complete questionnaires. If users complete the scenarios in less

than one hour, they will be able to begin the post-test questionnaire immediately, in

order to obtain accurate responses.

Test Environment The tests will be conducted in a full-scale usability lab in Toronto Ontario, at Consumer

Vision Ltd. Participants will be recruited through the Consumer Vision Ltd in-house

recruiting telephone survey centre. Logging and recording of sessions will be performed

using Morae, with additional eye tracking technology provided by Consumer Vision Ltd.

Methodology This section describes the testing methodology and scenarios that users will complete.

A total of 12 participants will take part in the 3 scenarios in 90 minute sessions. Three

users will participate in the test simultaneously.

Number of Participants A total of 12 participants will partake in the test scenarios. Four users will be recruited

from each of the three user profiles outlined previously. Participant age ranges may vary

from the user profiles ± 3 years, and participants will be recruited based on similarity to

the previously submitted user personas in order to achieve the desired demographic for

testing.

Page 7: Usability Test Plan for Blogger Mobile Application · Usability Test Plan for Blogger Mobile Application 2015 Page | 3 Purpose The purpose of the Blogger Mobile Application usability

Usability Test Plan for Blogger Mobile Application 2015

Page | 7

Length of Sessions The total length of each session will be 90 minutes including:

Pre-test questionnaire and usability lab orientation (15 minutes)

Task scenarios (60 minutes)

Post-test questionnaire and user comments (15 minutes)

Test Procedure The test will begin with a pre-test questionnaire as well as a basic usability lab

orientation. This will give users the opportunity to have any basic device operation

questions or test procedure questions answered such as how to turn on the devices,

which devices will be used, number of tests that will be conducted. Users will not be

allowed to ask any questions about the scenarios or about the Blogger Mobile

Application during this time.

Following the orientation scenarios will be presented as described in the following

sections, and afterwards a post-test questionnaire will be completed.

Participants will have access to the Blogger Mobile application, Gmail, and the photo

gallery on each device. All other applications will be locked using “Kid Mode” on the

devices. This information will be stated during the orientation to reduce participant

confusion and frustration during the scenarios.

Pre-Test Questionnaire and Lab Orientation The moderator will welcome participants and provide the pre-test questionnaire

(Appendix A). The moderator will allow the users to view the facilities and answer

questions following the guidelines as listed above. The moderator will ask users to think

out loud during the scenarios. Finally the moderator will have participants sign a video

consent form before testing begins.

User Specific Scenarios Users will be presented with 3 scenarios, each containing 2 similar tasks to complete on

different devices (Appendix A). The scenarios will be suited to match their user profile

as established during the screening process.

Post-Test Questionnaire and Closing The moderator will ask the participant to complete the post-test questionnaire, collect

any additional comments, and thank the participant for their involvement.

Page 8: Usability Test Plan for Blogger Mobile Application · Usability Test Plan for Blogger Mobile Application 2015 Page | 3 Purpose The purpose of the Blogger Mobile Application usability

Usability Test Plan for Blogger Mobile Application 2015

Page | 8

Appendix A: User Scenarios and Tasks

User 1 Scenarios Users from the User 1 demographic will complete these scenarios using an iPad and an

iPhone.

Scenario 1 You run a small business named Polytek Systems Limited which provides custom floor

coatings for a wide range of clients. You have decided to start a website using Blogger

to showcase your work. Complete the following tasks on the iPad provided in order to

start your blog.

Task 1 (iPad)

Use the Blogger app loaded on the iPad to create an account with the following

information. Your account information will be deleted following the test.

Name: Provide your real first and last name for testing purposes.

Email: [email protected]

Password: create your own password according to the password requirements.

Blog name: Polytek Ltd

Web address: polytekltd.blogspot.com

Task 2 (iPhone)

Use the Blogger app loaded on the iPhone to create an account with the following

information.

Your account information will be deleted following the test.

Name: Provide your real first and last name for testing purposes.

Email: [email protected]

Password: create your own password according to the password requirements.

Blog name: Polytek Systems

Web address: polyteksystems.blogspot.com

Page 9: Usability Test Plan for Blogger Mobile Application · Usability Test Plan for Blogger Mobile Application 2015 Page | 3 Purpose The purpose of the Blogger Mobile Application usability

Usability Test Plan for Blogger Mobile Application 2015

Page | 9

Scenario 2 You have successfully created a Blogger account. You want to present a professional

appearance for your Blogger website. Your company colours are blue and grey. You

want your website to reflect these colours.

Task 1 (iPad)

Select an appropriate template to use on your site polytekltd.blogspot.com based on

these colours. Apply the template to the website using the Blogger app on the iPad. Add

your company logo to the website from the photo gallery on your iPad.

Task 2 (iPhone)

Select an appropriate template to use on your site polyteksystems.blogspot.com based

on these colours. Apply the template to the website using the Blogger app on the

iPhone. Add your company logo to the website from the photo gallery on your iPhone.

Scenario 3 You are visiting a potential client tomorrow, and want to show them some of the work

you have done for other clients in the past. You need to be able to show the client

photos of your work during the meeting, by having your Blogger site open on your

mobile device. You will need to add pictures with captions to your site.

Task 1 (iPad)

Upload a photo of a jobsite to your site polytekltd.blogspot.com on your iPad from the

photo gallery. Upload a photo of a jobsite to your website using Gmail. You will already

be signed into a Gmail account. The photo is attached to the only email in your inbox.

Add a caption summarizing the photo.

Task 2 (iPhone)

Upload a photo of a jobsite to your site polyteksystems.blogspot.com on your iPhone

from the photo gallery. Upload a photo of a jobsite to your website using Gmail. You will

already be signed into a Gmail account. The photo is attached to the only email in your

inbox. Add a caption summarizing the photo.

Page 10: Usability Test Plan for Blogger Mobile Application · Usability Test Plan for Blogger Mobile Application 2015 Page | 3 Purpose The purpose of the Blogger Mobile Application usability

Usability Test Plan for Blogger Mobile Application 2015

Page | 10

User 2 Scenarios User 2 will complete the following scenarios using an iPad and an Android tablet.

Scenario 1 You have recently graduated from university and are spending the next several months

backpacking across Asia. You want to create a travel journal for yourself to log your

memories.

Task 1 (iPad)

Use the Blogger app loaded on the iPad to create an account and site with the following

information.

Your account information will be deleted following the test.

Name: Provide your real first and last name for testing purposes.

Email: [email protected]

Password: create your own password according to the password requirements.

Blog name: Trip Abroad

Web address: tripabroad.blogspot.com

Select a template for your site and add an introduction paragraph of text. Text is as

follows:

“Hello, my name is <insert name> welcome to my travel blog. I will be logging my

travels through Asia over the next several months.”

Task 2 (Android Tablet)

Use the Blogger app loaded on the Android tablet to create an account and site with the

following information.

Your account information will be deleted following the test.

Name: Provide your real first and last name for testing purposes.

Email: [email protected]

Password: create your own password according to the password requirements.

Blog name: Trip to Asia

Web address: triptoasia.blogspot.com

Page 11: Usability Test Plan for Blogger Mobile Application · Usability Test Plan for Blogger Mobile Application 2015 Page | 3 Purpose The purpose of the Blogger Mobile Application usability

Usability Test Plan for Blogger Mobile Application 2015

Page | 11

Select a template for your site and add an introduction paragraph of text. Text is as

follows:

“Hello, my name is <insert name> welcome to my travel blog. I will be logging my

travels through Asia over the next several months.”

Scenario 2 You have now been travelling for three weeks. You are about to move on to a new

country, and want to upload a gallery of photos from your first stop before getting on the

plane.

Task 1 (iPad)

Upload 5 photos to the site tripabroad.blogspot.com from the gallery on the iPad.

Task 2 (Android Tablet)

Upload 5 photos to the site triptoasia.blogspot.com from the gallery on the Android

tablet.

Scenario 3 Your family has emailed you some photos from home and you want to include them in

one of your blog posts.

Task 1 (iPad)

Upload 3 photos to the site tripabroad.blogspot.com from the Gmail account logged in

on the iPad. The photos are located in the only email in the inbox.

Task 2 (Android Tablet)

Upload 3 photos to the site tripabroad.blogspot.com from the Gmail account logged in

on the Android tablet. The photos are located in the only email in the inbox.

Page 12: Usability Test Plan for Blogger Mobile Application · Usability Test Plan for Blogger Mobile Application 2015 Page | 3 Purpose The purpose of the Blogger Mobile Application usability

Usability Test Plan for Blogger Mobile Application 2015

Page | 12

User 3 Scenarios User 3 will complete the following scenarios using an Android tablet and an Android

phone.

Scenario 1 You are graphic designer who has been doing mostly freelance work since graduating.

You want to start a website to host your resume in the hopes of finding more stable full-

time work. You have already signed up for a Blogger account and created a website,

and have the blogger app on your mobile device.

Task 1 (Android Tablet)

Using the Android tablet provided, upload your resume to the website called

mydesignservices.blogspot.com. Your resume is located in the Gmail inbox of the

account signed in on the device. The email subject line is “resume” and should be the

most recent email in the inbox.

Task 2 (Android Phone)

Using the Android phone provided, upload your resume to the website called

hiremetodesign.blogspot.com. Your resume is located in the Gmail inbox of the account

signed in on the device. The email subject line is “resume” and should be the most

recent email in the inbox.

Scenario2 You have been working at your new full-time job for a few months now, but miss

working with your freelance clients. You have decided to do a bit of freelance work on

the weekends and advertise your services through your Blogger website. You have

decided to add sample projects to your website to act as a portfolio for potential clients.

You are starting with the websites you designed for clients last summer.

Task 1 (Android Tablet)

Make a blog post containing 2 links to external sites on your blog

mydesignservices.blogspot.com using the Android tablet provided. Have the link text

read as specified below, use any font colour of your choice other than blue.

Link text Link to site

Poppytalk http://www.poppytalk.com/

I Heart Organizing http://iheartorganizing.blogspot.com/

Task 2 (Android Phone)

Make a blog post containing 2 links to external sites on your blog

hiremetodesign.blogspot.com using the Android phone provided. Have the link text read

as specified below, use any font colour of your choice other than blue.

Page 13: Usability Test Plan for Blogger Mobile Application · Usability Test Plan for Blogger Mobile Application 2015 Page | 3 Purpose The purpose of the Blogger Mobile Application usability

Usability Test Plan for Blogger Mobile Application 2015

Page | 13

Link text Link to site

My New Roots http://www.mynewroots.org/site/

Print and Pattern http://printpattern.blogspot.ca/

Scenario 3 You have a bit of spare time to work on your website this afternoon. You want to

personalize it to make it fit your design preferences. You are expecting friends in 20

minutes, so you need to be able to make small design and layout changes, not a

complete design overhaul.

Task 1 (Android Tablet)

Change the following components of your blog mydesignservices.blogspot.com using

the Blogger app on the Android tablet.

Adjust the layout

Adjust the width of the left sidebar

Change the colour scheme of your blog

Task 2 (Android Phone)

Change the following components of your blog hiremetodesign.blogspot.com using the

Blogger app on the Android phone.

Adjust the layout

Adjust the width of the left sidebar

Change the colour scheme of your blog

Page 14: Usability Test Plan for Blogger Mobile Application · Usability Test Plan for Blogger Mobile Application 2015 Page | 3 Purpose The purpose of the Blogger Mobile Application usability

Usability Test Plan for Blogger Mobile Application 2015

Page | 14

Appendix B: Pre-Test Questionnaire This test is suitable for all users

Name:

Age:

Have you ever run a blog before?

Have you ever used Blogger before?

If you were to start a blog what would the subject be?

Have you ever heard of these blog hosting sites before? (Circle all that apply)

Blogger Wordpress Weebly Squarespace.com

Which devices do you use most when working with mobile apps? Specify operating

system (Android or iOS).

Page 15: Usability Test Plan for Blogger Mobile Application · Usability Test Plan for Blogger Mobile Application 2015 Page | 3 Purpose The purpose of the Blogger Mobile Application usability

Usability Test Plan for Blogger Mobile Application 2015

Page | 15

Appendix C: Post-Test Questionnaires

User 1 Post-Test Questionnaire Test to be given to participants in User 1 category: iPad and iPhone

Overall how easy was it to use this application? (Circle one)

1 2 3 4 5

Very difficult Somewhat difficult

Neither difficult nor easy

Somewhat easy Very easy

Did you prefer using the Blogger application on the tablet or the phone? (Circle one)

iPad iPhone

Why?

How much time do you think you would need before you felt comfortable using Blogger?

Would you recommend the Blogger mobile app to a friend? Why or why not?

What was the most frustrating task you had to perform?

What was your favourite feature of the Blogger mobile application?

If you could add one feature to the app what would it be?

Page 16: Usability Test Plan for Blogger Mobile Application · Usability Test Plan for Blogger Mobile Application 2015 Page | 3 Purpose The purpose of the Blogger Mobile Application usability

Usability Test Plan for Blogger Mobile Application 2015

Page | 16

User 2 Post-Test Questionnaire Test to be given to participants in User 2 category: iPad and Android Tablet

Overall how easy was it to use this application? (Circle one)

1 2 3 4 5

Very difficult Somewhat difficult

Neither difficult nor easy

Somewhat easy Very easy

Did you prefer using the Blogger application on the iPad or the Android Tablet? (Circle

one)

iPad Android Tablet

Why?

How much time do you think you would need before you felt comfortable using Blogger?

Would you recommend the Blogger mobile app to a friend? Why or why not?

What was the most frustrating task you had to perform?

What was your favourite feature of the Blogger mobile application?

If you could add one feature to the app what would it be?

Page 17: Usability Test Plan for Blogger Mobile Application · Usability Test Plan for Blogger Mobile Application 2015 Page | 3 Purpose The purpose of the Blogger Mobile Application usability

Usability Test Plan for Blogger Mobile Application 2015

Page | 17

User 3 Post-Test Questionnaire Test to be given to participants in User 3 category: Android Tablet and Android Phone

Overall how easy was it to use this application? (Circle one)

1 2 3 4 5

Very difficult Somewhat difficult

Neither difficult nor easy

Somewhat easy Very easy

Did you prefer using the Blogger application on the iPad or the Android Tablet? (Circle

one)

Android Tablet Android Phone

Why?

How much time do you think you would need before you felt comfortable using Blogger?

Would you recommend the Blogger mobile app to a friend? Why or why not?

What was the most frustrating task you had to perform?

What was your favourite feature of the Blogger mobile application?

If you could add one feature to the app what would it be?