integrated software environments to streamline the development process, from design to test

7/28/2019 Integrated software environments to streamline the development process, from design to test.

1/20

ni.com

Enrico Mancin

Rational Systems Engineering SolutionsTigerTeam IOT EuropeIBM Software, Rational

Luigi Magni

Pragma EngineeringATS System EngineerNI - Certified TestStand Architect

Integrated software environments tostreamline the development process,from design to test

Enabling a systems approach to productdevelopment & testing


2/20

2ni.com

The make up of products and systems

has changed Shift from predominately mechanical products

to most innovation being delivered by software

and electronics

Increased complexity of these smarter products

and systems A strengthened need for a systems approach to

product development

Systems Design Challenges

Source: Aberdeen Group, August 2012


3/20

3ni.com

Better systems engineering =

more successful product development

Best-in-ClassTop 20%

of aggregate

performance

scorers

Adopting best-in-class systems engineering practicesresults in superior business outcomes

Source: Building a Business Case for Systems Engineering: The 2012 SE Effectiveness Study, SEI, NDIA & AESS.

Strong correlation between better SE capabilities and higher performance

Source: The Systems Development Journey of Smart Products, Aberdeen Group, December 2012.

85% of product launch dates met

12% reduction in length of development

cycle over the last two years

88% of product quality targets met

85% of product revenue targets met

% of Programsreporting HigherPerformance

Higher Program Performance vs. Systems Engineering Capability

Total Systems Engineering Capability (SEC)

100%

75%

50%

25%

0% 15% 24%56%

Lower SEC Middle SEC Higher SEC


4/20

4ni.com

Investment in embedded software

development is essential

Source: Managing Systems Design Complexity, Aberdeen Group, October 2012.

Top Pressure to Incorporate Embedded SoftwarePercentage of Respondents (n=142)

Innovations from software createnew revenue opportunitiesCustomers demand the tailored experienceachieved with software

Need to accelerate time to marketand software is fasterSoftware technological advances offercustomers value added experiences

Need to competitivelydifferentiate products

40%

31%

30%

25%

21%


5/20

5ni.com

Three imperatives for a systems approach

to product development

Open Lifecycle and Service Management Integration Platform

1. Traceability across the lifecycle

Electrical/ElectronicsDesignMechanical DesignEmbeddedSoftwareDevelopment

3. Collaboration across engineering disciplines

Market

Assessment

System

Verification

and Validation

System

Test

System

Requirements

System

Design

Deployment/

Release to Mfg.

Customer

Requirements

Operations and

Maintenance

2. Access to all engineering information


6/20

6ni.com

Transform the development of smarter

products and systems

Whats new1. Traceability across the lifecycle

Full Jazz based solution with the addition

of DOORS Next Generation Continued investment in DOORS 9.x

2. Access to all engineering information Expanded IBM and third-party data sources in

Rational Engineering Lifecycle Manager

Public SDK for Tracked Resource Set adapters3. Collaboration across engineering disciplines

Public SDK for design management

Integration with National Instruments test

management and execution capabilities

ENHANCEDIBM Rational Solution for Systems and Software EngineeringRational DOORS 9.5.1 / DOORS NG 4.0.3Rational Rhapsody 8.0.3 and Rhapsody Design Manager 4.0.3

Rational Quality Manager 4.0.3

Product and SystemsDevelopment

IBM solutions for product and systems development

Rational Team Concert 4.0.3 Rational Engineering Lifecycle Manager 4.0.3

Rational ClearCase 8.0.1


7/20

7ni.com


Whats new Use DOORS NG as an integrated capability in the Rational

Solution for Systems and Software Engineering

Extract key metrics from your requirements data: Enhancedintegration of DOORS 9.5.1 with Rational Insight

ENHANCED IBM Rational DOORS 9.5.1 IBM Rational DOORS Next Generation 4.0.3

Enhanced capabilities in both DOORS 9.x and DOORS Next Generation (NG)

Work with DOORS 9.x and DOORS NG alongside each other:

both tools support linking of information between both

databases

Work with other projects/suppliers by exchanging

requirements through the standard exchange format of ReqIF

Jumpstart projects with data from DOORS 9.x

Options for co-existence / migration



8/20

8ni.com



Whats new Visualize, analyze and organize data from new sources:

Latest versions of Rational DOORS 9.x, Rhapsody DesignManager, Team Concert and Quality Manager

National Instruments: Hardware and software test results

Mathworks Simulink: Dynamic systems models

Rational DOORS Next Generation

Rational Asset Manager: Business and technical assets

Rational Focal Point: Product and portfolio managementdata

Client-specific integrations to PLM and ERP tools

Tracked Resource Set specification released to OSLC(OASIS) and SDK to Eclipse Lyo

More help available for integrations and deployment

IBM & Business Partner Services,

ENHANCED IBM Rational Engineering Lifecycle Manager 4.0.3

IBM Rational Engineering Lifecycle Manager

RELM extended to new IBM and 3

rd

party data sources

Index of Linked Lifecycle Data

Visualize Analyze OrganizeCross discipline views

and navigationQuery, reporting,

and impact analysisLogical organizationof product artifacts

Open Lifecycle and Service Managem entIntegration Platform


9/20

9ni.com

3. Collaboration across engineering

disciplinesDesign management extended to third-party and in-house tools

Collaborative Design Management


OSLC

ENHANCED Rational Rhapsody 8.0.3 Rational Rhapsody Design Manager 4.0.3

Whats new? Improve design collaboration and traceability

through extended lifecycle workflowcapabilities for actively managed designs

Enhanced workflow between requirements

analysis and design via improved OSLC

integration and workflow with DOORS andDOORS NG

Manage design information from multiple

sources with new support for designmanagement of additional third-party

and in-house design tools



10/20

10ni.com

Collaborate across product

development and testWhats new? Rational Quality Manager and NI TestStand

integration

IBM Rational Solution for AutomotiveEngineering to be enhanced with National

Instruments Test and Quality elements for

functional safety with ISO26262

Aerospace and Defense

New DO-178 Templates for RationalDOORS and Rational Team Concert

New Rational Rhapsody kit to support

DO-178 compliance

New practice guidance to supportDefense Architecture Frameworks

(DoDAF)

NEW Rational Quality Manager National Instruments TestStand integration Rational Solution for Automotive Engineering to be enhanced with NI capabilities


OSLC



11/20

11ni.com

Facing with test of complex systems

Test system design more difficult toimplement, realize and maintain

Increased test systems delivery time

Higher occurrence of test system flaws(obvious and hidden)

Increased overall cost of testing withhigh DTC and severe impact on product

cost

Increased device complexity leads to more complex test systems

How to manage test process and dominate test costs?

Apollococ

kpit&D

SKY

Shuttle

cockpit

ATO 2013Test Economics

SW Centric

Ecosystems

Test SW Quality


12/20

12ni.com

Defining a new testing approach from

reactive to proactive

Insert test earlier into device design process: Design for Testability & Prototype

verification

Change from unstructured to well structured test design process: HW/SW test

architecture

ModuleLayer

Subsystem

Layer

SystemLayer

Milestones

RequirementsAnalysis

SystemDesign

IntegrationTest

SystemTest

SubsystemDesign

ModuleDesign

ModuleTest

FunctionalTest

DesignReview

DesignReview

ModuleImplementation


13/20

13ni.com

Next-Gen test systems design

SW architecture based on Test Manager and user-defined measurements

HW architecture based on COTS components: Virtual Instruments

Software centric test approach using modular instrumentation

Frost and Sulli van 2006 World Synthetic Instrumentation Test Equipment Report

Define a standardized test platform


14/20

14ni.com

Next-Gen SW architecture

NI Vision: TestStand and ADEs (LabVIEW, LabWindows)

Modular software architecture with distinctive layers


15/20

15ni.com

Next-Gen SW architecture

NI Vision: TestStand and ADEs (LabVIEW, LabWindows)

Modular software architecture with distinctive layers

Instrument Specific Drivers

Low levelDriver Layer

SoftwareLayers

IVI SwitchExecutive

NI TestStand

CustomHAL

CodeModules DLL ActiveX...

LabWindowsCVI

LabVIEWVI


16/20

17ni.com

Test Systems Quality

Requirements analysis,

coverage andtraceability are

essential tasks in order

to improves the quality

of the developmentprocess.

NI Requirements Gateway basic approach

Dedicated Interfaces

Requirements

Capture

Traceability

Navigation

Dedicated Interfaces

NI Requirements Gateway

TestStand LabVIEW LabWindows MATRIXxLabVIEW UTF

DOORS

Specification sources

Working code

Device compliance relies even more on test quality this leads to an accurate

management of test requirements FDA 21 CFR Part 11DO-178CISO26262CMMI


17/20

18ni.com

Test Systems Standard

Many different formats are used to describe test information (UUT, Test

sequence, Report), these formats change between different companies

as well as between business units.

NASC has led to the establishment of a working group in order to define

a standard: a common language for test information.

Automatic Test Markup Language (ATML) is a collection of XML Schemasthat allows ATS to exchange test information in a common format adheringto the XML standard.

Family of Standards managed by IEEE (SCC20) as Std 1671 .1 to .6

When a myth becomes reality

1671 ATML Overview and Architecture

1671.1 Test Description & Test Result1671.2 Instrument Description & instance

1671.3 UUT Description & instance

1671.4 Test Configuration

1671.5 Interface Description & instance1671.6 Test System Description & instance


18/20

19ni.com


For every standard a corresponding set of XML schema has been defined.

ATML standards increase test systems quality and reduce costs

TD documentdescribes:

test conditions,

limits, and

execution flow

of

a test sequence

TR documentincludes:

measurements

data, pass/fail values

and other properties

test operator andstation

information

http://grouper.ieee.org/groups/scc20/tii


19/20

20ni.com


NI was a pioneer in ATML adoption by 2004 with the ATML test report supported in

TestStand.

The ATML Toolkit extend the ATML support to TD & last version of TR in TestStand.

Performs an automatic code generation based on the input of ATML TD document.

Test Sequence as well as code modules skeleton are automatically generated.

NI ATML Toolkit for TestStand

NI TestStand

Sequence Editor

Test

Sequence

Code

Modules

Benefits Faster coding time

Less data error Increased consistency

Traceable

Standardized


20/20

21ni.com

Test Systems Future Evolution

Realization of a complete SW

ecosystem in order to support the

entire test development processintegrated into product development

with a complete ALM. (IBM Rational)

Adoption of system/software engineering practice

Design Develop Deploy

Increased support of ATML standards

with the integration of toolkits for

editing, traceability and advancedautomated code generation.

IBM Rational

NI ATMLToolkit

ATML Editor

NI

TestStandVeristand

integrated software environments to streamline the development process, from design to test

Documents