© fraunhofer iff mixed reality and digital engineering solutions and their promotion in the baltic...

© Fraunhofer IFF

Mixed Reality and Digital Engineering Solutions and Their Promotion in the Baltic States

Eberhard Blümel1, Leonids Novickis2 , Marco Schumann3, Stefan Leye4

1,3,4 Fraunhofer Institute for Factory Operation and Automation IFF, Magdeburg, Germany 2 Riga Technical University, Riga, Latvia

3nd International Workshop on Intelligent Educational Systems and Technology-enhanced Learning (INTEL-EDU 2012)

Riga, October 10, 2012

© Fraunhofer IFF

2

Outline

1. Global Challenges & Innovative Technologies

2. Digital Engineering & Digital Factory

3. Mixed Reality Platforms

4. Center of Digital Engineering (CDE)

5. Technology Transfer & Baltic States

6. Conclusions

© Fraunhofer IFF

3

Health and nutrition Affordable healthcare

Challenges – ”The Markets Beyond Tomorrow”

Safety and security Disaster prediction and management

Information and communication

Mobility and transportation Low-emission, reliable mobility in urban areas

Energy and living Low-loss generation, distribution and use of electricity

Production and environment Life-cycle production

Fotos © Fraunhofer

© Fraunhofer IFF

4

PRODUCTION AND ENVIRONMENT

We conduct research in the following areas:

Production that saves energy & raw materials

Product development

Manufacturing technologies/methods

Measurement and test engineering

Automobile and plant engineering, robotics

Production processes

Materials and surfaces

Imag

es

© F

rau

nh

ofe

r; ist

ock

ph

oto

Digital Engineering

© Fraunhofer IFF

5

INFORMATION AND COMMUNICATION

We conduct research in the following areas:

Image processing

Broadband communications

Cloud computing / grid computing

Embedded systems

eGovernment

eBusiness

eLearning, edutainment & games

Software engineering

Green IT und green through IT

Usability

Imag

es

© F

rau

nh

ofe

r; M

EV

; is

tock

photo

© Fraunhofer IFF

6

Outline

1 Global Challenges & Innovative Technologies

2 Digital Engineering & Digital Factory

2 Mixed Reality Platforms

3 Center of Digital Engineering (CDE)

4 Technology Transfer & Baltic States

5 Conclusions

© Fraunhofer IFF

7

Product Development vs. Production PlanningVirtual Reality to close the Gap

Digitalisation

1980 1990 2000 2010

Concurrent

Engineering

2D-CAD

3D-CAD

DigitalGeometryModel

Virtual Product

ProductionPlanning

ProductDevelop-ment

Cooperation&

Communication

Virtu

al

Reality

alpha-num.Planning

Stand alloneSimulation

© Fraunhofer IFF

8

Digital Factory - Definition

Quelle: SiemensPictures Of the Future2/2007

Sourcle: VDI-Arbeitskreis „Digitale Fabrik“

The digital factory is the superordinate concept for a comprehensive network of digital models and methods, amongst others, of the simulation and 3-D-Visualization.

Their purpose is the comprehensive planning, realization, control and continuously improvement of all essential factory processes and factory resources in connection with the product.

The digital factory is no for sale product - but a strategy!

© Fraunhofer IFF

9

Product Constitution ProcessProduct

developmentProduction planning Production

Methods

Tools

UserInterfaces

Simultaneous/Concurrent Engineering

Business Pprocess ManagementProduct/Simulation Data Management

Tolerance Management/-simulationCAP/PPR

CAO: Office, Project-/Knowledge Management, GroupwareCAQ

Material Flow SimulationVIBN

PPS/ERPFEM-Simulation

CAD/Factory Layout Planning

MKS/3D-Kinematicsi SimulationCAM/NC

BDE/MESRFID

Virtual RealityAugmented Reality

Telepresence

Techniques of the Digital Factory

Source : in Anlehnung an: Zäh und Schack (2006); Zäh u.a. (2005)

© Fraunhofer IFF

10

Degree of Integration of Tools in the Product Creation Process

No Computer Aided Support

FEM CADCAMCAQCAP

Rob

oti

cs a

nd

NC

-Sim

ula

tion

Erg

on

om

ics-S

imu

lati

on

Mate

rial

Flo

w

Sim

ula

tion

Layou

t P

lan

un

g

Virtual Reality (VR) + Digital Mock-Up (DMU)

Digital Factory

Offi

ce

Pro

ject

Man

ag

em

en

tG

rou

pw

are

Kn

ow

led

ge M

an

ag

em

en

t

Product Development

Production Planning

Deg

ree o

f In

teg

rati

on

of

Tools

in

th

e

Dig

ital

Facto

ry

Production

…

© Fraunhofer IFF

11

Central challenges to the digital factory of the next generation

Progressive data integration-> future scenario “product life cycle management” (PLM)

3D visualization as a communication and interaction medium-> means to the control of the complexity of information

Closing of control circuits between the development and production-> new methods of Digital Engineering

Personnel qualification-> new requirement profile of Digital Engineering

© Fraunhofer IFF

12

Digital Engineering

Digital Engineering is the universal use of digital methods and tools over the product development and production process and is aimed at an improved planning quality as well as at the process control over the whole product life cycle.

physically correct transformation of all problem relevant characteristics - also of the software-technical qualities (e.g., embedded systems)

Interoperability of the used tools (technically, semantically, organizationally)

Application in interactive experience rooms to the inclusion of the person in the digital chain

© Fraunhofer IFF

13

Outline






5 Conclusions

© Fraunhofer IFF

14

Virtual RealityVirtual reality is a high-end user-computer interface that involves real-time simulation and interactions through multiple sensorial channels. These sensorial modalities are visual, auditory, tactile, smell, and taste). [Burdea and Coiffet, 2003]

Reality-Virtuality Continuum (Milgram)

Comprehenses the transition from the real World into the virtual World and vice versa.

Augmented RealityAugmented Virtuality

Mixed Reality

Reality-Mixed Reality-Virtuality Continuum

© Fraunhofer IFF

15

Virtual Knowledge

Base

Factory Planning• Layout planning• Process

planning

Education and Training• Technical staff• Operation

service• Assembly

service

Maintenance• Assistant systems

• Visual interactive repair instructions

Mixed Reality Supports the Entire Product Life Cycle

Design Review• Engineering•

Manufacturing• Assembly• Maintenance

Functional Test• Mechanics• Electronics• Control

systemsTechnical Documentation• Visual

interactive catalogs• Electronic

manualsJob Preparation• Work scheduling• Resource

optimization• Logistics functions

© Fraunhofer IFF

16

Fraunhofer IFF VDT Platform

Data Base• CAD data• Scenario data

file

(XWS)• Texture, sounds,

text,

configurations, etc.

Plugins

Extension by coupling new function to defined interfaces

Scene Graph• Version 1.8

GUI:• Plugin• .NET Framework

3.5.

Runtime system

Authoring tool

Scenario concept

Platform: Core

© Fraunhofer IFF

17

Development and planning of factory processes

Assessment and validation using simulation Rapid generation of information about

feasibility and cost

Benefits

Time savings when preparing quotes Planning support Early error detection Decision making support Reduced cost and effort

Virtual Layout and Production Planning

© Fraunhofer IFF

18

Mobile Augmented RealityAssistance of picking processes

Investigation of psychological and working-medical factors in environments close to production (-> exemplary workplace)

Optimization of mobile AR systems; requirement catalog Transferability on different real scenarios Allow in the medium term industrial application mobile

AR

© Fraunhofer IFF

19

Stationary Augmented RealityAssistance of Assembly Procedures

Camera

Image Display

Workplace

VirtualityReality

MixedReality

© Fraunhofer IFF

20

Coupling of virtual models with real control

Interactive 3-D-Model

Software »VDT-Platform«

Real Operator Panel

- Siemens 840D inclusive maschine-specific NC-cycles

Simulation Tools

- SINUMERIK Machine Simulator

- WinMOD- Fraunhofer RTI

© Fraunhofer IFF

21

• Product Presentation (Marketing)• Development and Testing of machine specific NC-programs• Operator Training

Coupling of virtual models with real control

© Fraunhofer IFF

22

Aviation Maintenance Training

interactive training scenarios for service staff or pilots

Benefits better learning of procedure steps more understandable instructions through

interactive visualization customized learning systems sustainable learning outcomes

© Fraunhofer IFF

23

Outline






5 Conclusions

© Fraunhofer IFF

24

Center for Digital EngineeringBranch-covering transfer of Digital Engineering methods

Medicine/ Medicine Technics

Surgery-Simulation & Visualization

Automotive

Multi physical simulationof vehicles

Dynamicsof Complex Systems

Coupling of process-technical simulation

Neuro-Science

Stimulation by Virtual Models

© Fraunhofer IFF

25

Aims of the Master Degree Course Digital Engineering

Graduates are engineers with competent informatics knowledge for development, construction and operation of complicated, technical products and systems

Knowledge of methods for usage of modern IT solutions in application and research fields of Engineer's sciences

Course contains above-average percentage in Project work, which is partly in cooperation with partners of applied research offered (in collaboration with industrial partners)

Focus on interdisciplinarity in special Lectures, in project work and within the preparation of the master thesis

© Fraunhofer IFF

26

Structure of the Master Degree Course Digital Engineering

Semester 1

Semester 2

Semester 3

Methods of Digital

Engineering (12)

Interdisziplinäres Team-

Project (6)

Semester 4

Master Thesis (30)

Engineer's Basics

(18 oder 6)

Informatik-Basics

(18 oder 6)

Digital Engineering-

Project (12)

Technical specialization

(18)Methods of Informatics

(12)

Human Factors

(6)

© Fraunhofer IFF

27

Lack of Experts

The branch automobile industry lacks in 2012 about 11,000 engineers

(Pricewater / Coopers, publication on 22.09.2010)

Not only demographic reasons, but: Rising need in specialist knowledge and research capacities on

the basis of innovation offensives (e.g. alternative drives, trend to extend the model range)

Rising research budget of the branch estimated from topically 20.9 billions Euros / year by about 3.4 billions / year within two years

© Fraunhofer IFF

28

Outline






5 Conclusions

© Fraunhofer IFF

29

The INTERREG 4b Project: BONITA

16 partners from 10 countries 8 universities, 4 science parks 3 technology transfer organisations 1 ICT association share best practice examples for

Scientific Transfer of Technologies improve the role of universities

for regional transfer of research set up a network of showrooms to

promote scientific innovation within a region – share within the network

set up a common organisation for sustainable operation

Baltic Organisation and Network of Innovation Transfer Associations

© Fraunhofer IFF

30

Forms of Technology / Knowledge Transfer

transfer through direct research assignments from industry

transfer through cooperation projects, also with

third party funding

transfer through cooperation projects in the teaching field

transfer of highly qualified people (students, PhD, manager, …)

small and specialized exhibitions (showrooms) run by research

institutions as windows to scientific innovation.

physical showroom is for demonstrating cutting edge-technologies in

a tangible and accessible fashion

virtual showrooms have centralized access to exhibits located in

different places

© Fraunhofer IFF

31

BONITA-ShowRoom at RTU

Showroom at RTU aims to: Promote innovative ICT solutions Create a link between product’s/service or idea’s author and

industry, especially SMEs Network with the other technology transfer centers

Showroom at RTU is a place for: demonstration of existing products and solutions; creation of new products’ and solutions’ ideas.

Showroom at RTU includes three inter-related components (parts): Physical exhibition located at RTU premises; multimedia demonstration (exhibit) outside the Showroom’s

premises; Web-based infrastructure: web-portal.

© Fraunhofer IFF

German-Baltic Competence Network for Mixed Reality

Bundling, developing and interlinking of the competencies of the partners

Development of new cooperation forms on the basis of VR-Technologies

Support of SME of the processing industry for the entire application of high technologies

VTT Technical Research Centre of Finland Tampere

Forum for Intelligent Machines

(Finland) Customer Driven

Design

German-Baltic Competence Network for VR/AR-supported development of innovative products und services

Virtual and Augmented Reality

FASA e.V. SME-Networks

(Germany)

Vidzeme University Valmiera

Riga Technical University

Baltic Regional Competence Centre

(Latvia)Socio-technical

engineering

© Fraunhofer IFF

34

Raising SMEs’ awareness

to identify the potentials for applications of virtual reality technologies

Performing an operational potential analysis

to specify companies’ needs and structure operational problems

Qualifying skilled labor and management

to impart basic knowledge about virtual reality and test new effective forms of basic and advanced training (combining real and virtual methods in qualification)

Developing VR tools

to test and evaluate concrete VR applications in companies

Methodological approach of knowledge transfer to SMEs

© Fraunhofer IFF

35

FP7-Project eINTERASIA

ICT Transfer Concept for Adaptation, Dissemination and Local Exploitation of European Research Results in Central Asia Countries

Co-ordinator: Prof. Leonid Novickis, Riga Technical University

S & T Objectives:

The major purpose of eINTERASIA is to support international cooperation with Central Asia’s countries by creating a Technology Transfer Concept for adaptation, piloting, diffusion and local exploitation of EU research results. The application of TTC will be demonstrated in the field of eLogistics.

© Fraunhofer IFF

36

eINTERASIA – Technology Transfer Approach

eINTERASIA Showrooms

Capability Maturity Transfer Model

eINTERASIA

showrooms to promote scientific innovation within a region – share within the network

share best practice examples for Scientific Transfer of Technologies according to a standard based transfer model

improve the effectiveness of science industry

collaboration and regional transfer of research

investment

Virtual Reality

Technology

Virtual Reality

Technology

© Fraunhofer IFF

37

VR-based Technology Transfer Processes

Education & Training

Web - Based Framework

Source: Workshop at RWE premises

Show Rooms Enterprise applications

Customized VR-Platforms

Capability

Maturity

TransferModel

Technology

Domaines:• Logistics• Mechanics• Electronics• etc.

Source: Bonita Showroom RTU Source: Fraunhofer IFF (2)

Process

Product

© Fraunhofer IFF

39

Digital EngineeringNew quality of Product Lifecycle Management

Digital Engineering enhanced the Digital Factory by a new concept of systems interoperability and the integration of the Humans in the digital process chain

Knowledge transfer becomes to an integrating prozess in Digital Engineering

Mixed Reality is becoming a cross-domain communication platform in collaborative corporate processes

Technology based Qualification enables sustainable human resource development and supports innovative didactic approaches

Technology based Qualification provide digital platforms for Education and training in industrial application areas Education and training for digital technologies and

processes

© Fraunhofer IFF

40

Folie

40

Global Trends 2025- Requirements for Technology Transfer

Increasing Energy Consumption

Globalization and increasing transport volumes

Digital Networking and Technology Development

Demographic Development

New solutions for mobility

Growth of Mega-Cities

Economic structural changes

Global Migration

Shanghai

© Fraunhofer IFF

41

Contact

Virtual Development and Training Centre VDTC of the Fraunhofer Institute for Factory Operation and AutomationSandtorstr. 2239106 Magdeburg

Dr. Eberhard Bluemel

Head of Fraunhofer IFF EU OfficeTel. + 49 391 - 4090 110Fax + 49 391 - 4090 115email [email protected]

© fraunhofer iff mixed reality and digital engineering solutions and their promotion in the baltic...

Documents

digital engineering

fraunhofer iff mixed

fraunhofer institute

plant engineering

automation iff

sale product

factory resources

factory operation