grid enabled pattern matching within the dame e-science pilot project jim austin computer science...
Post on 19-Dec-2015
214 views
TRANSCRIPT
Grid Enabled Pattern Matching within the DAME
e-Science Pilot Project
Jim Austin
Computer Science
University of York
All hands 2002 2
Rolls-Royce
University of Oxford, Lionel Tarassenko.
University of Leeds, Peter Dew, Alison McKay.
York, J Austin, J McDermid, A Wellings.
University of Sheffield, P Fleming.
Rolls-Royce, Derby.
Data Systems and Solutions.
Cybula Ltd.
All hands 2002 3
Introduction• Objectives of DAME
• Diagnostics issues
• How AURA fits in
• AURA-G – GRID enabled AURA
• Where are we now?
All hands 2002 4
DAME Objectives• DAME: Distributed Aircraft Maintenance
Environment.
• Demonstrate diagnostic capability on the GRID
• Examine timeliness properties of the GRID
• Demonstrate on the RR Aeroengine diagnostic problem
All hands 2002 5
Engine flight data
Airline office
Maintenance Centre
European data center
London Airport
New York Airport
American data center
GridDiagnostics centre
All hands 2002 6
Diagnostic issues• The system must analyse and report
– Novel engine operation– Identify any cause of events– Do this quickly
• Data– Large (many Tb)
All hands 2002 8
Proposed pattern matchingprocess
QuoteNovelty indication
Data used to identify novelty
Data reductionprocesses
Features
Data stores/data warehouse
Diagnostic stationEngine data
Data to be searched for
Match requests
AURA-G
Diagnosis
All hands 2002 9
How does AURA contribute• Search technology for multi-media data
• Parallel pattern match engine based on neural networks.
• Built on Correlation Matrix Memories.
• High performance Beowulf and dedicated hardware implementations.
• Commercially sold by Cybula Ltd.
All hands 2002 10
AURA parallel implementation 28 dedicated PCI based processors
Beowulf configuration3.5Gb memory size
Cortex-1
All hands 2002 12
Data sample DM coding CMM
Matching previous events
Simple example of processing chain
All hands 2002 13
Typical pre-processing
DM coding01101111011110111
(1 up 0 down)
FastPreserves informationProduces a binary vector
Time
Fre
quen
cy
All hands 2002 14
QuoteNovelty indication
Data used to identify novelty
Data reductionprocesses
Features
Data stores/data warehouse
Diagnostic stationEngine data
Data to be searched for Pattern match
results
Match requests
AURA-G
GRID
Diagnosis
All hands 2002 15
AURA-G
• This is a Globus enabled AURA implementation.
• Developed under DAME
• Will be available end of 2002 for use in other problems.
All hands 2002 16
AURA-G
• Support of scalable pattern matching
• Supports distributed search, across multiple CMM engines at different sites
• OGSA compliant
17 All hands 2002
Conclusions• AURA-G enabling fast access to large, complex
data.• Available for other applications• Diagnostic framework in DAME applicable
elsewhere.• DAME web site: www.cs.york.ac.uk/dame• AURA website:
– www.cs.york.ac.uk/arch/nn/aura.html– www.cybula.com