design research: course creation
TRANSCRIPT
• Mission! • Tools & Methods• Interviews• User Testing Screencasts• Recommendations
DESIGN RESEARCH:COURSE CREATION
Vanessa Gennarelli@mozzadrellaCC-BY
• P2PU <3 course creators
• Align our design with human behavior
MISSION!
• Interviews with our totally rad power users
• 3 screencasts with usability testing tool usertesting.com: http://www.usertesting.com/
TOOLS & METHODS
?
• Formative evaluation
• 11 interviews over 2 weeks
• Subjects are power-users
• All data is self-reported
• Focus on process of creating a course
INTERVIEWS
GENERAL BACKGROUND
Individual Community Membersn=11
Mean= 9.45 courses Median= 6 coursesMode= 6 courses
Mean= 23 months Median=18 monthsMode= 36 months
TIMEFRAMES
n=11
3 3
54
2
4
TIMEFRAMES
4
2
4
n=11
3 3
560% of folks take 2 weeks+to develop courses
Users iterate quite a bit: 72% visit P2PU21 times or more overdevelopment
45% are on P2PU.org constantly over development
TOOLS USED IN COURSE DEVELOPMENT
(n=11)
• Users asked to list tools used over the development of their course
TOOLS USED IN COURSE DEVELOPMENT
Why Etherpad?
• “The P2PU website did not seem to be a place where you batted around ideas”
• “There was nowhere to draft a course.”
• “Feel like there’s a social aspect that’s missing--quick communication with people.”
(n=11)Tools that support co-creation of content were most frequently cited (Etherpad, Googledocs)
Only one respondent worked entirely in P2PU.org for course development
Means our users are doing *a lot* of copying and pasting...bummer.
• How many people did you work with on your P2PU course?
• Answer includes respondent
COLLABORATIVE WORK
25
15
6
3
2
6
2
2
1
1
1
• How many people did you work with on your P2PU course?
• Answer includes respondent
COLLABORATIVE WORK
25
15
6
3
2
6
2
2
1
1
1
Mean= 5.81
Median= 2
Mode= 2
Most course organizers
(81%) develop courses
in collaboration with others
USERTESTING.COMSCREENCASTS
• 3 users asked to create a course from scratch and publish
• Note: we are being tested against
Watch results:
• User 1: https://www.usertesting.com/videos/42K77HnmZFA%3d
• User 2: https://www.usertesting.com/videos/hS5QE8b0WtA%3d
• User 3: https://www.usertesting.com/videos/H%2b1aF%2bmmBtc%3d
• Design course creation to look & feel like actually *being* in the course
• Hover commands or a shadowbox to help the user (disappears upon 2nd sign in)
• Support features that help users iterate (incremental save, improve text editor)
• Bump up collaborative editing feature to support co-creation of content
RECOMMENDATIONS
RECOMMENDATIONS:CREATE COURSE 1
I’m a Course Title: Fill Me in with a Zippy Title!Home > Learn > Course Title Home Page
I’m a Task: Fill Me In With What You’d Like Folks to do FirstI’m a subtitle: fill me in with a bit more description & context.
I’m a Task: Fill Me In With What You’d Like Folks to do SecondI’m a subtitle: fill me in with a bit more description & context.
Next Step: Ask for Community Review
New task
Course Organizer Bio:
I am into Religious Studies and Anthropology and am a freak about research, fact checking, and curating content. I write the internet, maybe you have read it?
Christopher Crawford
Start Course
Course Home
InviteCollaborators
AdminCourse
I’m a Course Title: Fill Me in with a Zippy Title!Home > Learn > Course Title Home Page
I’m a Task: Fill Me In With What You’d Like Folks to do FirstI’m a subtitle: fill me in with a bit more description & context.
I’m a Task: Fill Me In With What You’d Like Folks to do SecondI’m a subtitle: fill me in with a bit more description & context.
Next Step: Ask for Community Review
New task
Course Organizer Bio:
I am into Religious Studies and Anthropology and am a freak about research, fact checking, and curating content. I write the internet, maybe you have read it?
Christopher Crawford
Start Course
Course Home
InviteCollaborators
AdminCourse
RECOMMENDATIONS:CREATE COURSE 2
Directly edit text inline,which autosaves
Add organizer bio
Move in-course nav to all flesh right, add invite/share
Move “new task” button to where users need it
Include Community Review Step
I’m a Course Title: Fill Me in with a Zippy Title!Home > Learn > Course Title Home Page
I’m a Task: Fill Me In With What You’d Like Folks to do FirstI’m a subtitle: fill me in with a bit more description & context.
I’m a Task: Fill Me In With What You’d Like Folks to do SecondI’m a subtitle: fill me in with a bit more description & context.
Next Step: Ask for Community Review
New task
Course Organizer Bio:
I am into Religious Studies and Anthropology and am a freak about research, fact checking, and curating content. I write the internet, maybe you have read it?
Christopher Crawford
Start Course
Course Home
InviteCollaborators
AdminCourse
RECOMMENDATIONS:CREATE COURSE 3Start by giving your course a name
Then add a photo Begin to fill
in the tasks for your course
Create more tasks as you see fit
When you’re at a point you’re happy with, ask for Community Review
See alltasks
Share & invitecollaborators
Give feedback
Tweakunder the hood
RECOMMENDATIONS:CREATE COURSE 4
I’m a Course Title: Fill Me in with a Zippy Title!Home > Learn > Course Title Home Page
I’m a Task: Fill Me In With What You’d Like Folks to do FirstI’m a subtitle: fill me in with a bit more description & context.
I’m a Task: Fill Me In With What You’d Like Folks to do SecondI’m a subtitle: fill me in with a bit more description & context. New task
Course Organizer Bio:
I am into Religious Studies and Anthropology and am a freak about research, fact checking, and curating content. I write the internet, maybe you have read it?
Christopher Crawford
Start Course
Course Home
InviteCollaborators
AdminCourse
Last Step: Open for Signup
• Community review & testing
• Add advice on learning theory to the copy
• Integrate with Dirk’s “unification” plan
• Next study: mental model research on *why* people create courses
• Raw data is up on Googledocs: http://ow.ly/dujBH
• Direct feedback to community list or to [email protected]
• Thanks to usertesting.com for comping the tests!
NEXT STEPS
Vanessa Gennarelli@mozzadrellaCC-BY