xray for jira - how to automate your qa process
TRANSCRIPT
How to automate your QA process?
Add-on Discovery Day
Sergio Freire
Xray’s Product Manager
Xray for JIRA empowers test teams to manage and deliver rock solid software solutions
Agenda
1. QA challenges
2. Test Automation
3. Automation on workflows
4. Automation on reporting
5. Live showcase
6. Wrap-up
1. QA challenges
Xray for JIRA
1. Releasing faster (speed vs quality)
2. Manual and automated testing
3. Fast feedback, where you need it
4. Integration with many different automation frameworks
5. Easy integration
6. Support for different methodologies (waterfall, Agile, “hybrid”)
7. Losing time doing all kinds of extra stuff
QA Challenges (well… some of them)
1. Releasing faster
Speed vs Quality - are they real enemies?Let these help you out:
• Agile
• DevOps, DevTestOps
• Continuous Integration
• Automated Testing
• Continuous Testing
• Continuous Delivery
Release often, with confidence. Motivate your team, make your customers happy.
Image by www.genalice.com.
2. Test Automation
Xray for JIRA
Can you automate everything? Or should you?
• Tests can be automated but choose well what to automate
• Defect creation and analysis will be manual (AI will take time to achieve
this goal)
• Some collateral activities can be automated (e.g. environment setup,
reporting, etc)
• Try to focus on what gives you most value and automate the repetitive
tasks
Automation
The cost of bugs
Code Complete, Steve McConnell, 2004
• The cost of fixing bugs grows exponentially depending on the phase in which
they are detected
• The fix cost also depends on the stage where bugs are initially introduced
=> Automated testing to the rescue!
Phase in which a Defect is
introduced
Phase in which a Defect is detected
Supported formats
• Xray JSON
• Cucumber
• Behave
• JUnit
• Nunit
• Robot framework
• Calabash
• … more to come
Automation in mind…
Integrating with automated test frameworks
Enabling Automated Tests
Fitting all together
3. Automation on workflows
Xray for JIRA
Possible scenarios
• Disallow executions with workflow statuses
• For Test Executions in specific
status
• In progress Test Execution workflow status
• After the first run
• Resolved Test Execution workflow status
• When all runs are in final status
• Resolution for Resolved Test Execution
Workflow automation example for Test Executions
Manage execution life-cyle
3. “Automation” on reporting
Xray for JIRA
Real status of requirements with in-context information
With Xray:
• Real-time information about the coverage status of the requirement for a given version
• Real-time information about the associated test results, for a given version
• A ”requirement” may be any issue type you may have; test coverage can be made in any issue type
Provides a quick way of evaluating the current (coverage) status of your project's
requirements, so you will be able to see if they are ready to be or not.
JIRA Dasboards: Requirement Coverage Gadgets
Useful, yet lack quality related information.
Standard Agile Boards
Xray gives you visibility of your testing results and its progress.
Enhanced Agile Boards with Xray
Use Xporter to generate fully customizable Word, Excel or PDF files with your testing
reports to give to your management, colleagues or to your customers
(e.g. Test specification, Test Execution progress and respective results, Test Plan details).
Reports as deliverable assets
5. Live showcase
Xray for JIRA
1. Integrating with Junit automated tests
• Automatic report sent to email using Xporter
2. Automated testing using BDD with Cucumber
3. Consolidated results in Test Plan
Live showcase
• Cucumber supported natively
• BDD – Specify tests in a business-readable domain-specific language
• Test definition serves as documentation
• Automated test steps may be implemented in Ruby, Java, .Net, etc
• Export specification and execute it during Continuous Integration
Specifying “Automated Cucumber Tests”
6. Wrap-up
Xray for JIRA
1. Use JIRA with Xray for managing the complete lifecycle of your software projects
2. Xray is the perfect tool for Test Management inside JIRA, enabling automation features
3. Xporter complements Xray, enabling advanced reports in Word, Excel, PDF with custom layouts
Deliver faster and better releases with JIRA and Xray
Xray for JIRA empowers test teams to manage and deliver rock solid software solutions
