Usability Tests: Results and Scenarios

Owned by Rain Michaels (Unlicensed)
Last updated: Jul 23, 2016 by Mark Custer

Child Pages:

Notes for the observers (those who are administering the test)

  • Do not assist the tester in any step except to give very specific goals to the tester.
  • Observe tester's actions, but do not judge them. If actions seem odd to you, ask about the choices the tester made without giving the impression that they made the wrong choice or took a misstep. 
  • If the tester steers too far off course from the goal of the test and you are unable to redirect them back without making them feel like they made a wrong choice, end the specific test and ask about the choices they made, then move onto the next test.
  • If a tester doesn't understand the test, then skip the test and move onto the next one (e.g. some tester's may not understand test 4, which is about accession data).

The tests

Test 1: based on the Pam (archivist) persona

Tester receives a specific research question from an outsider: PLEASE ADD AN APPROPRIATE QUESTION OR TWO HERE

Tester runs the searches in the designated ASpace system: PLEASE PROVIDE WHICH SYSTEM WE SHOULD USE FOR THIS TEST

  • Allow the tester to take their own path to searching. Do not interfere. Record, and then ask why they made choices that seem odd to us (without indicating that those choices seemed odd).

Tester prepares a response (however they see most fit) to the question.
  • Do not direct them to prepare that response in any particular way. Watch how they do it, and ask why they made the choices they did.
  • Ask if they would have preferred another approach to preparing the response.

Test 2: based on the Maynard (archivist) persona

Tester visits the designated ASpace system: PLEASE PROVIDE WHICH SYSTEM WE SHOULD USE FOR THIS TEST

Searches for the record series number for the President George Stoddard records: PROVIDE THIS SERIES NUMBER

Based on results received, ask tester what they would do next with this information.

Test 3: based on the Monique (librarian) persona

Tester is about to teach a lesson on: SPECIFY TOPIC HERE, as well as system that should be used for test

  • What is the tester looking for? What is needed to teach this lesson?

Tester selects a few relevant results. Watch which results tester selects, and ask about the choices made. 

Tester collates that information into one place for reference. What how tester chooses to do this. Ask what they would like to have done.

Test 4: based on the Jamie (academic admin assistant) persona

Tester searches for a very specific item in a specific ASpace system: PLEASE PROVIDE WHICH SYSTEM TO USE AND WHICH ITEM TO SEARCH

Tester locates the accession and box number information for the chosen folder. 

Repeat with a second item/system: PLEASE PROVIDE A SECOND SYSTEM/ITEM.

Do not assist tester with this test. Ask about actions that seem odd, and observe. This test may not be appropriate for test subjects that are not familiar with accession data. 

Test 5: based on the Morgan (photo editor) persona

Tester searches for a very specific image in a specific ASpace system: PLEASE PROVIDE WHICH SYSTEM TO USE AND WHICH ITEM TO SEARCH

Tester locates the item. 

Ask the tester: where do they go and/or who do they contact to access this item? PLEASE PROVIDE CORRECT ANSWER SO THAT WE CAN ASSESS THE SUCCESS OF THE TEST

Repeat with a second item/system: PLEASE PROVIDE A SECOND SYSTEM/ITEM.

Test 6: based on the Nancy (journalist) and Alex (student) personas

Tester searches for digitized images of Ellington sitting at the piano: PLEASE PROVIDE WHICH SYSTEM TO USE

Tester locates the images.

Tester identifies which images are digitized, because those are the only ones that matter for tester's particular needs.

Tester selects one image, and identifies the IP rights of that image. 

Ask the tester: what are the IP rights? What do they need to do next to use the image? PLEASE PROVIDE CORRECT ANSWER SO THAT WE CAN ASSESS THE SUCCESS OF THE TEST