1. Drupal Usability Testing University of Baltimore February 2009

2. Why do another usability study?

Just as the testing framework is used to test code, usability tests are used to test User Interface changes

Drupal needs to be easy to use

3. Video 4. 5. Dries Challenge

...I won't release Drupal 7 until I crossed off

at least 90%of the problems they identified.

source: http://buytaert.net/usability-usability-and-usability

6. Differences

Less formal

Beginner and Intermediate

Remote sessions

7. University of BaltimoreUsability Lab

Eye tracking

One way mirror

8. Behind the glass Bojhan Somers ( bojhan ) Brad Bowman ( beeradb ) Addison Berry ( add1sun ) Becca Scollon ( beccascollan ) Matt Tucker ( ultimateboy ) Sumit Kataria ( sumitk ) Nathan Haug ( quicksketch ) Nat Catchpole ( catch ) 9. Participants

Freelance developer

Systems consultant

Lead programmer

Lead UI developer

Student

Product director

Professor (web design)

Computer consultant

Internet application developer

Designer and developer

Admin assistant - blogger

10. Participants

Freelance developer

Systems consultant

Lead programmer

Lead UI developer

Student

Product director

Professor (web design)

Computer consultant

Internet application developer

Designer and developer

Admin assistant - blogger

94 years combined weband/or CMS experience 11. 12. 13. 14. Intermediate test plan

Install Drupal

Create content

Add a link to the Navigation Menu

Create a content type

Setup roles and permissions

Categorize content

Enable and use Path module

Add to Filtered HTML

Enable search

Set up a trigger for new content notifications

15. Beginner test plan

Install Drupal

Post some sample content

Add a link to the Navigation Menu

Add a block to the right sidebar

Categorize content

Change the color of the site

16. Approach

Test and observe

Analyze and stickies

Organize and prioritize

Record and share

17. 18. Drupal 7.x + patches

Vertical tabs [#323112]

19. 20. 21. 22. Drupal 7.x + patches

Text format widget [#304330]

23. 24. 25. 26. Drupal 7.x + patches

Remove post-settings admin screen [#361277]

27. Drupal 7.x + patches

Finer control over the Parent Menu select box [#351249]

28. 29. 30. Drupal 7.x + patches

Recap

Vertical tabs [#323112]

Text format widget [#304330]

Remove post-settings admin screen [#361277]

Finer control over the Parent Menu select box [#351249]

31. Password checker before 32. Password checker after 33. Findings 34. Findings A few things are working 35. Stuff that works

Drupal installation

36. Video 37. 38. Stuff that works

Input formats => Text formats

39. 40. 41. Findings We confirmed issues from the first two studies. giving us a better sense of what's most important. 42. Issues

How do I create content?

43. Video 44. 45. Issues

WTFam I looking at?WTFdo users see?

46. Video 47. 48. WTF am I looking at? 49. WTF am I looking at? 50. Issues

Navigation + administration & menus as blocks

51. Video 52. 53. Node orphanage

Nodes are orphaned by default unless they are promoted to the front page.

Menus and taxonomy are optional, and mis-understood.

Even if they find the content inadmin/content/node it isn't part of the site.

54. Issues

How do I create content?

WTF am I looking at? WTF do users see?

Navigation + administration & menus as blocks

Node orphanage

55. Findings We found some new -ishissues mostly from our intermediate group. 56. Search

When you enable the search module, the box appears magically in the theme.

Users enabled the search block before they saw the one already created.

Users click 're-index' to re-index their site. (even when they know about cron)

57. 58. Video 59. 60. Menus

Users aren't clear who can see the navigation menu.

The relationship between menus and blocks is not made clear.

Menu item creation is ordered path first, then title, unlike most other forms in Drupal where title or name is first.

Parent item selection Create a main menu item is a valid menu parent.

61. 62. Text formats 63. 64. 65. No configuration! 66. 67. 68. Taxonomy

Wall of text - Thats more than I want to read right now

Expect categories or tags - not configurable vocabularies

The example 'Tags' vocabulary without a corresponding example of a structured vocabularyis confusing.

Terms are created in alphabetical order, not the order entered.

"Abstract

69.

Terms sorted alphabetically

instead of order of entry

70. Video 71. 72. Solution

Help patch with additional features

73. Example 74. Enable the search module and then 75. 76. Dries Challenge

...I won't release Drupal 7 until I crossed off

at least 90%of the problems they identified.

source: http://buytaert.net/usability-usability-and-usability

77. 5% took us 7 months 78. 128 specific issues 79. 90% When its ready. (estimated 2019) 80.

All issues, videos, test plans

www.drupalusability.org

81. Special thanks to And many more 82.

All issues, videos, test plans

www.drupalusability.org