Deliverable E-Usability Testing

Team Yellow: Deliverable E-Usability Testing Plan

Mykle Brossette, Brian Green, Satyam Kaneria & Jessica LoPresti

ECT 455 Autumn 2011

_______________________________________________________________________

PURPOSE:

Pet Match will be a web and mobile solution for animal shelters and rescues that matches adoptable pets with interested adopters based on their personality preferences. Use of the site and mobile app will be free for both shelters and their customers in order to attract consumer interest and to support shelters’ efforts to engage and screen adoption candidates.

The scope of site functionality includes: Users will be able to create accounts, search database of available pets, view a detailed profile for each pet, take a pet personality quiz to receive customized matches, “like” and hide pets from list of recommended matches, manage preferences on the user profile page, inquire for more information about individual pets and submit adoption applications online.

The website will offer a more interactive feature that allows the user to search through recommended matches easily after filling out the “Match Me” personality matching quiz. The user can also click on any recommended pet to view more detailed info on the pet and fill out an adoption application form if the user wants to.

The mobile site will mainly allow the user to search for a pet and use the Match Me service. Both the website and mobile site will provide the same functionality, the main difference is the UI design.

The Usability testing of the application will evaluate the potential errors and difficulties involved with using the application for Pet Match. The usability tests are to ensure an ease of learning, efficiency of use, memorability, check for error frequency and severity, and subjective satisfaction.

The following objectives will be addressed in this usability evaluation:

The usability testing of the applications (website and mobile) will evaluate the potential for errors and difficulties involved in using the applications for Pet Match related activities. The following concerns are identified as being relevant to the testing process:

1. Is the mobile site suitable for mobile use in terms of its size, weight, and display clarity?

2. Is the application performance fast enough for the users?

3. Is the information logically organized and grouped? Can the user easily locate the information they are looking for?

4. Is the site organized where the user can finish their tasks with little help?

5. Are the graphics used and the icons recognizable to users and do they facilitate ease of use/understanding?

6. Can users successfully navigate through and between applications? Is the system status clear to users at all times? Is the navigation intuitive?

7. Could the user obtain information to answer their questions?

8. Is the user able to get support / help in using applications when required?

9. Does the user understand what information is held about them and their ability to modify and control it?

User Performance Evaluation Goals:

Specific user performance goals are developed from the objectives outlined above. The goals let us create evaluation scenarios and tasks that test the validity of our concerns and develop measures to use in user testing. The objectives listed above should be translated into measurable usability goals for testing.

User Goals:

We want to understand whether or not users will be able to navigate pet matching service with ease.
We want to understand whether or not users will be able to sign-in to their account without difficulty or confusion.
We want to understand whether or not users will be able to create an account without difficulty or confusion.
We want to understand whether or not the feedback Pet Match gives its users is appropriate and effectively relates to whatever issues a user is faced with.
We want to understand whether or not users will be able to understand when they are finished with the pet matching service.
We want to understand whether or not users are capable of understanding the feedback the website and mobile site gives them when encountering a wrong entry and how to recover.
We want to understand whether or not users are capable of navigating the site on recognition more than recall.
We want to understand whether or not users are satisfied with their pet matching submission results and whether they’ll recommend the service to others.

PERSONAE PROFILE:

PRIMARY PERSONA: Katie Anderson

Demographics:

· 28 years old

· Lives in Portland, Oregon

· Avid pet lover

Education and Occupation:

· BSN from Concordia University

· RN at Shriners Hospital for Children

Computer Proficiency:

· Uses a computer at work for recording notes and obtaining patient information

· Searches the web daily

Goals:

· To find the perfect pet suitable to her work schedule and lifestyle

Katie has been an avid pet lover since she was a little girl due to growing up with three playful dogs who brought a lot of love and fun to the household. As a college student, she missed having a pet around but knew daily life was too hectic to provide a stable environment. Now that Katie has settled in to her new condo, she is looking to adopt a cat or dog. She works four 12-hour shifts per week and wants to make sure chooses the right pet to fit her lifestyle.

SECONDARY PERSONA: Russ Forbes

Demographics:

· 31 years old

· Recently relocated to Asheville, North Carolina with his family

· Married for 6 years

Education and Occupation:

· MS in Environmental Management from University of Maryland

· Safety and Environmental Manager at Michelin

Computer Proficiency:

· Daily use of computer at work for emails and data recording

· Plays online learning games with his 5 year-old son

· Uses his smartphone for writing email and searching the web

Goals:

· To find a dog for his son from a local shelter or rescue group

· To email photos of potential pets to his wife and son using his smartphone

Three months ago, Russ moved from Baltimore to Asheville with his wife, Patrice, and 6-year-old son, Jesse, due to a promotion at his company. Now that he and his family are settled into their new home, he is looking forward to adding a playful small dog to the household. He is still becoming acclimated to the area and often uses the maps feature on his smartphone to locate places and other information.

NEGATIVE PERSONA: John Murphy

Demographics:

· 78 years old

· Lives in Chicago, Illinois during the warmer months and Sarasota, Florida during the winter

· Has never owned a pet

Education and Occupation:

· High School diploma

· Former small business owner, now retired

Computer Proficiency:

· Minimal experience with using a computer

· Does not own a smartphone

Goals:

· To permanently move to a retirement community in Florida

Ten years ago, John sold his small business and retired from working. Recently afterward, he and his wife, Phyllis, began renting a condo in Florida to escape the harsh Chicago winters. During the warmer months, John and his wife spend time with their children and grandchildren. Eventually, John and Phyllis plan to sell their house in Chicago and take up permanent residence at a retirement community in Florida.

SERVED PERSONA: Donna Moreau

Demographics:

· 62 years old

· Lives in Oak Creek, Wisconsin

· Grandmother

· Has 2 cats

Education and Occupation:

· Bachelors Degree in Education and French from Marquette University

· Masters Degree in French from University of Toledo

· French teacher at Oak Creek High School

Computer Proficiency:

· Employs French language software for class exercises and assignments

· Uses a computer on a daily basis for searching the Web and for frequently emailing her daughters and grandchildren

Goals:

· To find a pet for her oldest grandchild, Danny, as a gift for his seventh birthday

Donna is a 62-year-old mother of two daughters, aged 38 and 34. Her eldest daughter, Mary, has three children and lives a ten-minute drive away. Donna is excited for her grandson’s approaching seventh birthday and wants to surprise him with a pet. She plans to adopt an animal from one of the shelters in her county. She also wants to ensure she picks the right type of pet best suited for younger children.

DETAILED TASK IDENTIFICATION:

Website

1) Create User Account

System Beginning State

Home page

Sequential steps to complete task:

· find user account creation

· click on user account creation button

· fill in user account information including: name, whether a shelter or member, and contact info

· click on submit

System End State

Expected Response time of completion:

Create User Account

M, P, B, H, M, Time to fill in information - about 40 keystrokes avg 40+K1 and 8 keystroked random 8+K2, H, P, B

1.2 + 1.1 + .10 + .40 + 1.2 + 40*.2 + 8*.5 + .4 + 1.1 + .10 = 16.8 seconds

2) Sign-in to site

System Beginning State

Home page

Sequential steps to complete task:

· find the site log-in

· click on the site log-in

· fill in username and password

· click on submit

System End State

Expected Response time of completion:

Sign-in to Site

M, P, B, H, type in info - about 20 keystrokes avg 20+K1 and 8 keystrokes random 8+K2, H, P, B

1.2 + 1.1 + .1 + .40 + 20*.2 + 8*.5 + .4 + 1.1 + .10 = 12.4 seconds

3) Fill out pet match personality

System Beginning State

Home page

Sequential steps to complete task:

· find the pet match personality quiz

· click on the pet match quiz

· answer several questions on your lifestyle habits

· click the submit button

System End State

Expected Response time of completion:

Fill out Pet Match

M, P, B, H, filling out form - about 7 questions P & B - 7+P and 7+B with 7+M, H, P, B

1.2 + 1.1 + .1 + .40 + 7*1.2 + 7*.1 + 7*1.2 + .4 + 1.1 + .10 = 21.9 seconds

Mobile

1) Create User Account

System Beginning State

Home page

Sequential steps to complete task:

· find user account creation

· click on user account creation button

· fill in user account information including: name, whether a shelter or member, and contact info

· click on submit

System End State

Expected Response time of completion:

Create User Account

M, B, M, B, M, B, B, M, B, B

1.2 + .10 + 1.2 + .10 + 1.2 + .10 + .10 + 1.2 + .10 + .10 = 5.4 seconds

2) Sign-in to site

System Beginning State

Home page

Sequential steps to complete task:

· find the site log-in

· click on the site log-in

· fill in username and password

· click on submit

System End State

Expected Response time of completion:

Sign-in to Site

M, B, M, B

1.2 + .10 + 1.2 + .10 = 2.6 seconds

3) Search for a Siamese Cat in 60660

System Beginning State

Home page

Sequential steps to complete task:

· find a Siamese cat in your 60660 zip code

· use drop down to find cat

· use drop down to find Siamese cat breed

· enter in the zip code information 60660 into zip code field

· click on the search button

System End State

Expected Response time of completion:

Search for Siamese Cat in 60660

M, B, M, B, M, B

1.2 + .10 + 1.2 + .10 + 1.2 + .10 = 3.9 seconds

*Legend for GOMS-KLM in estimation of response time

P, Point the mouse to an object on screen --- 1.10 seconds

B, Button press or release (mouse) --- 0.10 seconds

H, Hand from keyboard to mouse or vice versa --- 0.40 seconds

M, Mental Preparation --- 1.20 seconds

K1 = average speed keystrokes (0.20 seconds)

K2 = typing random letters (0.50 seconds)

QUESTIONNAIRE:

1. Do you currently have any pets?

☐ Yes ☐ No

2. Are you or is someone you know looking to adopt a pet?

☐ Yes ☐ No

3. Do you use a computer for work and/or personal use?

☐ Yes ☐ No

4. If yes, what type of activities do you use the computer for?

☐ Word processing ☐ Sending Emails ☐ Searching the Web ☐ Social Networking (i.e. Facebook) ☐ Other __________________________________

6. Rate your level of experience in using the Internet:

☐ No experience ☐ Beginner ☐ Intermediate ☐ Advanced

7. How many hours a week do you spend viewing websites online?

☐ 0 hours ☐ 1-2 hours ☐ 3-4 hours ☐ 5+ hours ☐ Other____________

8. Do you own a smartphone?

☐ Yes ☐ No

9. If yes, what do you typically use your smartphone for (besides placing calls)?

☐ Sending Emails ☐ Searching the Web ☐ Social Networking (i.e. Facebook)

☐ Finding Directions/maps ☐ Other __________________________________

10. What age group do you belong to?

☐ Under 18 ☐ 18-29 ☐ 30-39 ☐ 40-49 ☐ 50-59 ☐ 60-69 ☐ 70 and over

TEST DATA RECORDING FORM FOR WEBSITE:

TASK 1: Create a user account

Time of Completion:_______________________

Actions:

☐ REGISTER link selected

☐ First Name entered

☐ Last Name entered

☐ Yes or No selected regarding organizational status

☐ If Yes, organizational name entered

☐ Email entered

☐ Password entered

☐ REGISTER button clicked

NOTES:__________________________________________________________________

________________________________________________________________________________________________________________________________________________________________________________________________________________________

TASK 2: Sign-in to website

Time of Completion:_______________________

Actions:

☐ SIGN IN link selected

☐ Email entered

☐ Password entered

☐ SIGN IN button clicked

NOTES:__________________________________________________________________

TASK 3: Fill out pet personality matching quiz

Time of Completion:_______________________

Actions:

☐ MATCH ME link selected on main navigation

☐ Question 1 answered

☐ Question 2 answered

☐ Question 3 answered

☐ Question 4 answered

☐ Question 5 answered

☐ Question 6 answered

☐ MATCH ME button clicked

NOTES:__________________________________________________________________

TEST DATA RECORDING FORM FOR MOBILE:

TASK 1: Create a user account

Time of Completion:_______________________

Actions:

☐ JOIN button selected on Main screen

☐ Email entered

☐ Password entered

☐ Confirm Password entered

☐ REGISTER button clicked

NOTES:__________________________________________________________________

TASK 2: Sign-in to mobile site

Time of Completion:_______________________

Actions:

☐ SIGN IN button selected on Main screen

☐ Email entered

☐ Password entered

☐ SIGN IN button clicked

NOTES:__________________________________________________________________

TASK 3: Search for a Siamese cat in zip code 60660

Time of Completion:_______________________

Actions:

☐ ADOPT/FIND A PET selected on Main screen

☐ 60660 Zip code entered

☐ Siamese Breed Selected from Drop down menu

☐ FIND PETS button clicked

NOTES:__________________________________________________________________

MEMBER CONTRIBUTIONS:

Mykle Brossette

· Created Purpose section of report

· Compiled Detailed Task Identification section

· Created Database

Brian Green

· Created and coded Website

Satyam Kaneria

· Created and coded Mobile site

Jessica LoPresti

· Devised Personae Profile

· Created the Questionnaire

· Created Test Data Recording Form

URL To Deliverable E: http://ectweb2.cs.depaul.edu/yellow46/deliverables/deliverableE.html