michael kass [email protected]@nist.gov han kim ngo...
TRANSCRIPT
Michael Kass [email protected]
Han Kim Ngo [email protected]
Jacques Durand [email protected]
IIC Test Framework :illustrated on ebXML Conformance Testing
• V1.0 May 2003, V1.1 October 2004
• An architecture that defines Test Components that work together
• Test Driver
• Test Service
The IIC [ebXML] Test Framework
• XML schemas for defining Test Suites• Test Requirements• executable Test Suites (set of Test Cases)
• Interoperability needs to be Maintained between Business Partners
• Threatened by continuous, non synchronized systems upgrades
• eBusiness Interoperability is an integration problem: has to be tested “live”, in production
Challenges eBusiness / eGov Testing:
upgrading
Vision for eBusiness / eGov Testing:
• The Role of Test Centers
• Provide testing services at all phases of eBusiness product life cycle
• Early conformance tests• Pre-release Interop tests• Business guidelines tests (vertical) • Interop Maintenance testing
Conformance to Business Guidelines
Application ContentInteroperability (A2A)
Conformance to Technical Specifications
Protocol-levelInteroperability
Infrastructure
System in Production
Testing for the “Interoperability Stack”
Vision for eBusiness / eGov Testing:
• Testing Technology evolving toward:
• Automation and [XML] scripting
• Versatile frameworks
• various formats/standards,
• evolve with them,
• ease of customization
• Support for Testing will become a product feature, not just a QA thing
• NIST (US)
• Test Driver & Test Service. Intended for local testing. 1.1 Available for beta-testing end of year.
Test Framework: Implementations
• KorBIT (Korea)
• 1.0 Test Driver & Test Service. Used remotely at ETSI test event 2004 (ebMS 2.0).
• DrakeCertivo (US)
• Test Driver. Used for ebMS conformance , and also OAG BODs testing
• KWareSoft (Korea)
ebXMLMessageHandler
Test Service
Host 2
ebXML Message
Testsuite
Conformance/Interoperabilityreport
Test Driver
Host 1 (or test center)
Test Frameworkcomponent
Test target
Testing ebXML MS Conformance
Testing MS Interoperability: point-to-point
ebXML Message (HTTP / SMTP) ebXMLMessageHandler
ebXMLMessageHandler
Test Driver
Test Service
Testsuite
Test Service
Host 2Host 1
Test Frameworkcomponent
Test target
•Provide expertise in conformance testing to OASIS IIC•Help develop the OASIS IIC ebXML Testing Framework specification for all ebXML specifications•Prototype a Test Framework implementation as proof of concept•Assist in writing conformance tests for Messaging, Registry, and Business Process specifications
NIST’s Role
•Flexible testing architecture •Provide simple XML scripting •Promote test suite re-use
Design Goals
•Testing Requirements
•Executable Test Cases
•Testing Profile
•Associated Message Content
Test Suite
•Reference Conformance Clause in Specification
•Reference the Normative Specification
•Broken down into concise Functional (Semantic) Requirements expressed as a Test Assertion Clause
Conformance Test Requirements
“For conformance to this specification, all the version attributes of any SOAP extension elements defined in this specification MUST have a value of “2.0”
Demo
ebXML Messaging Services 2.0 Conformance Test Suite
•Message Packaging
–- # 2 ebXML Message is in root part of MIME Envelope–- #28 MessageHeader version attribute is ‘2.0’
NIST Test Framework Implementation free for download in December at http://ebxmltesting.nist.gov
• NIST Test Driver and Test Service (source/binary)• OASIS IIC ebXML MS 2.0 Conformance Test Suite• NIST ebXML RS 2.1 Conformance Test Suite
Download