What does Quality What does Quality Assurance Mean to Sakai?Assurance Mean to Sakai?

Megan May

Where does QA fit in? What kinds of activities occur?

• 6 Releases – 2.1.1 (1/19- 2/14)

– 2.1.2 (2/24 - 4/12)

– 2.2.0 (5/12-7/19)

– 2.2.1 (7/15-8/15)

– 2.2.2 (9/18)

– 2.3.0 (9/15-11/3)

Development

Testing & Software Release

Requirement Gathering and Design

Focus on Functional Testing

JIRA Ticket Breakdown

0

10

20

30

40

50

60

Account

Announcements

Assignments

Attachment Widget

Chat RoomDatabase

Discussion

Documentation (other than Help)

Drop box

E-mail Archive

Forms

FrameworkGateway

Global

Gradebook

HelpHelp InstallJSF

LicensingMembership

Message Center

MOTD (Admin Site Management)

Multiple Components

My WorkspaceNews (RSS)

Permission Widget (authz)

PortalPost'Em

PreferencesPresence

Presentation

Profile

Providers

Quartz SchedulerRealms (Admin Site

Resources

RosterRwiki

ScheduleSchedule Search

Section Info

Site Archive (Admin Site

Site Info

Sites (Admin Site Management)

Sites (Gateway)

Skins (CSS)

SUToolSyllabus

Tests & QuizzesUsers (Admin User

Web ContentWeb Services

WebDAV

Worksite Information

Worksite Setup

WYSIWYG Widget

Trivial

Minor

Major

Critical

Blocker

2.1.1 Release• Distinguishing points

• QA Servers – Special thanks to Gongqin & Craig from MIT

2.1.2 Release

• Distinguishing points

• Formulation of QA Network– http://issues.sakaiproject.org/confluence/x/ZT8

How did 2.1.1 and 2.1.2 Compare?

• 2.1.1– Small Scope– Participation

• 40 People• 18 Institutions• 4 Countries

– Hours• 392 hours

• 2.1.2– Large Scope – Participation

• 60 People• 20 Institutions• 5 Countries

– Hours• 904 hours

2.2.0 Release

• Distinguishing points– OSP fully integrates with Sakai– QA WG realizes they are driving

• QA Network

2.2.0 Release Goal Achievement and Setting

• Areas of Improvement– Deployment testing– Data retention &

conversion script testing

– Automated testing• Static code review

• Forward Looking– Facilitate further work

on automation– Review of JIRA priority

system– Web services– Assist in developing

strategy for releases

Reflection –proposal for new Release process

• Why did this occur?

• What was proposed as it relates to QA?– Maintenance branch– QA as the official driver of the “Sakai 500”

• Proposal location: http://issues.sakaiproject.org/confluence/x/QDU

2.2.1 & 2.2.2.Releases

• Distinguishing Points

• QA Server Network

• What was 2.2.2?

Further Reflection on proposed Release process

• What did we learn from 2.2.1?

• Timing

• New Proposal – Maintenance releases – Maintenance branch

2.3.0 Release

• Distinguishing points

• Face of QA server

network

2.3.0 Release Goal Achievement and Setting

• Process Improvement– Automated testing

using Selenium of Schedule and Cal Summary

• Forward Looking Including code

coverage Including accessibility

testing A Sakai Web Project Recruiting more WG

Members

Integration Week

“Code Freeze”

Selective Merging

Stealth Provisional Tools

Documentation Finalized Release!

Weekly Tags

Communication

Information Gathering

Summary - JIRA Activity

2.2.1 – 85% Verification

2.2.0 – 85% Verification

2.1.1 – 100% Verification

2.1.2 – 85% Verification

2.3.0 – 85% Verification

2.2.2– NA/Security Release

(611 JIRA Tickets)

(119 JIRA Tickets)

(504 JIRA Tickets)

(74 JIRA Tickets)

(465 JIRA Tickets)

Summary - Participation

2.1.1

40 People

18 Institutions

4 Countries

2.1.2

60 People

20 Institutions

5 Countries

2.2.0

82 People

28 Institutions

6 Countries

2.2.1

23 People

10 Institutions

4 Countries

2.3.0

44 People

17 Institutions

5 Countries

QA Super Stars U Mich QC Team-Moises Curiel -Nihar Nabar-Bali Mansoor

-Garin Fons-Pramod Prabhu

Clay Fenlason

Kevin Brokamp

Derek Ramsey

Alan Berg

Seth Theriault

Theron Feist

Laura Burchard

Jim Williamson

Kim Gausepohl

Dawn Eckert

Stephen Marquard

John Leasia

Nick Pachis

Margaret Petit

Salwa Khan

Tom Kuipers Harriet Truscott

Huong Nguyen

Vivie Sinou

QA Participants in ‘06Aaron Zeckoski, Alan Berg, Amy Neymeyr, Andrew Poland, Andrew Thornton, Antranig Basman, Ari Consul, Ayaz Noor, Bas Toeter, Beth Kirschner, Bilal Mansoor, Bill Steele, Brad Anderson, Brooke Biltimier, Cherie Dodd, Cheryl Wogahn, Chris Coppola, Chris Maurer, Christina Gentry, Chuck Severance, Clay Fenlason, Cordah Robinson Pearce, Daisy Flemming, Daniel Perry, Daphne Ogle, David Adams, David Bickel, David Cole, David Horwitz, Dawn Eckert, Debra Reis, Derek Ramsey, Desiree McKie, Diana Lee Perpich, Donald Siegel, Ernie Souhrada, Feliz Gouveia, Florence Martin, Garin Fons, Glenn Golden, Gonzalo Silverio, Greg Doyle, Hannah Reeves, Harriet Truscott, Helen Malin, Huan Yang, Huong Nguyen, Ian Boston, James Williamson, Jean-Francois Leveque, Jesse Schibilia, Jim Eng, Jim Green, Jim Julovich, Jim Williamson, Joann Farris, Jodie Reminder, John Bush, John Ellis, John Leasia, John McCullough, John Norman, Joseph Delaney , Josh Holtzman, Julia Jackson, Karen Tsao, Karin Brekelmans, Kate Ellis, Kathryn Propst, Kathy Moore, Kevin Brokamp, Kevin Deckard, Kim Gausepohl, Kristol Hancock, Lance Speelmon, Laura Burchard, Linda Place, Lisa Wilson, Louis Majanja, Luke Fernandez, Lydia Li, Magnus Tagesson, Marc Brierley, Margaret Petit, Megan May, Melissa Zarella, Michelle Lazarow, Mike De Simone, Mike Elledge, Moises Curial, Nicolas Pachis, Niels Vegter, Nihar Naber, Nuno Fernandes, Oliver Heyer, Pat Kava, Paul Beckett, Peter Knoop, Pramod Prabhu, Ray Davis, Salwa Khan, Sam Ottenhoff, Sammy Chan, Sean DeMonner, Sean Keegan, Seth Theriault, Soo Il Kim, Stephen Marquard, Stephen Masterson, Steve Githens, Steve Lonn, Steven Githens, Tatsuki Sugiura, Theron Feist, Thijs Jansen, Tom Dinchak, Tom Kuipers, Victor Maijer, Vivie Sinou, Yazmi Yahya, Yeh, Yen-Ching C, Yuanyuan Joanne Sui, Zhen Qian

Perceived Quality Poll

Quality, like beauty, is clearly in the eyes of the beholder.

Perceived Quality Poll

What we can do!

• Infiltration of entire development

process

• Formulate Working Group

• Refine processes & grow WG

Development

Testing & Software Release

Requirement Gathering and Design

Areas where QA is needed

Resources Available

http://bugs.sakaiproject.org/confluence/display/Q

A/Home

Pledge Resources

• Why?– What happens in the community has a direct

local impact

• Easy point of entry into Sakai

How to get started

• Create account for JIRA & Confluence

• Join Collab site

• FAQ– http://bugs.sakaiproject.org/confluence/display/QA/FA

Q+QA

• Dream, test or join an effort!– http://issues.sakaiproject.org/confluence/x/ckw

Questions