The Four Essential Elements of LSEG QA Solutions
Exactpro11 November 2015
Quality Assurance & Related Software Development for Innovative Trading SystemsTel: +7 495 640 2460, +1 415 830 38 49www.exactpro.com
2
FrAgile Process
Crowd-sourced Testing
Formal Verification Methodologies
Cognitive Technology
Quality Assurance Trends
Quality Assurance & Related Software Development for Innovative Trading Systems Tel: +7 495 640 24 60 , +1 415 830 38 49 www.exactpro.com
3
FrAgile Process
Test is DeadIdeas before ProductsHappy Software DevelopersSoftware Engineer in Test
Quality Assurance & Related Software Development for Innovative Trading Systems Tel: +7 495 640 24 60 , +1 415 830 38 49 www.exactpro.com
4
Crowd-Sourced Testing
Immediate Feedback from Diverse User BaseInstrumentation is Required to Process Data
Quality Assurance & Related Software Development for Innovative Trading Systems Tel: +7 495 640 24 60 , +1 415 830 38 49 www.exactpro.com
5
Formal Methods
Model CheckingTheorem ProvingStatic AnalysisVerification
http://nssdc.gsfc.nasa.gov/nmc/spacecraftDisplay.do?id=2006-001A
Quality Assurance & Related Software Development for Innovative Trading Systems Tel: +7 495 640 24 60 , +1 415 830 38 49 www.exactpro.com
6
What’s Next?
Can We Learn from Other Industries?
Be Both Faster and Safe
Who Had the Most Severe Problems with Technology?
Quality Assurance & Related Software Development for Innovative Trading Systems Tel: +7 495 640 24 60 , +1 415 830 38 49 www.exactpro.com
7
Proposed Approach
Build Software to Test Software
Test Tool Sophistication should Match Platform’s Complexity
Testability is Required
Parallel Stream for Test Harness
The Software will Break Anyway
A Good Robot is Required to Survive in Robot Apocalypse
Summer Glau – The Sarah Connor ChroniclesGrace Park - Battlestar Galactica
Quality Assurance & Related Software Development for Innovative Trading Systems Tel: +7 495 640 24 60 , +1 415 830 38 49 www.exactpro.com
Active Testing Tool to Simulate Transaction Flow
Orders
Trades
Market Data
• Tibco• IBM MQ• jDBC• TCP• HTTP• SOAP• FTP• FTSE• Reuters• Fidessa• EMAPI• QuantHouse• MillenniumIT• SOLA• ASTS• GATElab
• FIX and dialects, • including 4.2, 4.3, 4.4, 5.0• FIXML• ITCH• FAST• ISO SWIFT
Configurable Multi-Protocol Test Connectivity
Clear and Simple CSV-based Test Case Format
Drop by Drop Turns into a Mighty Regression Library
Keyword Driven Testing
Automated Test ExecutionBig Button Framework
Unattended Test Runs for Continuous Integration
User Friendly Web Front-End
Report reflects the Difference Between an Expected Outcome and an Actual
Expected vs. Actual
Purifying & Cleansing
Sailfish is like WATER
Foundation of the Electronic Trading Architecture
Complex Operational Schedules
Identify and Exterminate Pests
Built-in Schedule Support
Step by Step Testing
Industry-Standard Solutions
• SWIFT• HTTP• SOAP• FTP• MQ• ISO 20022• etc.
ClearTH is like EARTH
Simulate Algo Traders’ Behaviour
Subscribe to Market Data
Use Trading Systems to Test Trading Systems
Simulate Low-Latency Execution Environment
• Powerful• Scalable• Realistic• Multi-Threaded• Java Agents
Dashboard to Monitor Trading Algorithms
Gather Execution Efficiency Stats
Run your Platform alongside with Test Algos
Reference Test Harness for Trading Algorithms
Will Your Platform Melt at the Confluence of Functional and Non-Functional Testing?
Trigger Minirobots and Illuminate the Hidden Defects
Minirobots are like FIRE
• Passive testing is a software testing technique that observes the system without interaction.
• Passive testing tool doesn't generate any messages itself. It captures the traffic and stores it for analysis.
• Shsha is a tool that can gather all the evidence you need. Invisible to the system under test, it raises testing efficiency to a different level.
• Post-transactional tool• Analyzes clients' activity • Parses and displays logs in a user-friendly way• Parses messages and then puts each to a data base table where each column corresponds to each message field• Allows making summarized reports, etc.• Easy to understand GUI
Incoming signals FIX and dialects: FAST, SWIFT, ITCH, HTTP, SOAP
Use of Shsha:• Load results analysis, NFT metrics• Toxic issues investigation• On-boarding client certification• Market Surveillance
Target SUT:• Trading Platforms,• Market Data Delivery• Post-Trade Systems• Surveillance systems• Audit and regulatory requirements
Client Onboarding
Fast, Clear, and Weightless
Shsha is like AIR
Build Software to Test Software