an automated image processing system for rpi data ivan galkin, bodo reinisch, grigori khmyrov,...

20
An Automated Image Processing System for RPI Data Ivan Galkin, Bodo Reinisch, Grigori Khmyrov, Alexander Kozlov, Xueqin Huang, Robert Benson, Shing Fung IMAGE Science Working Group Meeting Lowell, Massachusetts June 5, 2003

Upload: joseph-parsons

Post on 18-Jan-2018

220 views

Category:

Documents


0 download

DESCRIPTION

IMAGE Team Meeting Lowell, June 5, RPI Dataset 700,000 plasmagrams collected by June 2003 At 2 sec/image ~ 400 hrs to just glance at each image

TRANSCRIPT

Page 1: An Automated Image Processing System for RPI Data Ivan Galkin, Bodo Reinisch, Grigori Khmyrov, Alexander Kozlov, Xueqin Huang, Robert Benson, Shing Fung

An Automated Image Processing System for RPI Data

Ivan Galkin, Bodo Reinisch, Grigori Khmyrov, Alexander Kozlov, Xueqin Huang,

Robert Benson, Shing Fung

IMAGE Science Working Group Meeting Lowell, Massachusetts June 5, 2003

Page 2: An Automated Image Processing System for RPI Data Ivan Galkin, Bodo Reinisch, Grigori Khmyrov, Alexander Kozlov, Xueqin Huang, Robert Benson, Shing Fung

2

IMA

GE

Tea m

Mee

ti ng

Low

e ll,

J une

5, 2

0 03

Outline• RPI Dataset and Intelligent Systems for

Automated Data Exploration• CORPRAL Development

– Resonance matching– Trace selection

• CORPRAL Results– RPI Database for Level-2 data products– Recent statistics– Future work

Page 3: An Automated Image Processing System for RPI Data Ivan Galkin, Bodo Reinisch, Grigori Khmyrov, Alexander Kozlov, Xueqin Huang, Robert Benson, Shing Fung

3

IMA

GE

Tea m

Mee

ti ng

Low

e ll,

J une

5, 2

0 03

RPI Dataset

• 700,000 plasmagrams collected by June 2003• At 2 sec/image ~ 400 hrs to just glance at

each image

Page 4: An Automated Image Processing System for RPI Data Ivan Galkin, Bodo Reinisch, Grigori Khmyrov, Alexander Kozlov, Xueqin Huang, Robert Benson, Shing Fung

4

IMA

GE

Tea m

Mee

ti ng

Low

e ll,

J une

5, 2

0 03

CORPRALVenku 1 Bill 1 Robert 1 Alexander 2 Vance 5 Bodo 5 Cindy 12 Patrick 20 Shing 40 Gary 60 Don 62 Marie 63 Ivan 69 Maria 119 Grigori 167 Christopher 477 Qiang 506 CORPRAL V1 97733 Total 97985

CognitiveOnlineRpiPlasmagramRankingALgorithm

Level 2 dataset, rated plasmagrams

Page 5: An Automated Image Processing System for RPI Data Ivan Galkin, Bodo Reinisch, Grigori Khmyrov, Alexander Kozlov, Xueqin Huang, Robert Benson, Shing Fung

5

IMA

GE

Tea m

Mee

ti ng

Low

e ll,

J une

5, 2

0 03

Access to CORPRAL Data

Lowelldatabase

SMOC

Processing logs

CORPRAL ratings

Plasmagram of the day

http://umlcar.uml.eduResonance processing in BinBrowser

Page 6: An Automated Image Processing System for RPI Data Ivan Galkin, Bodo Reinisch, Grigori Khmyrov, Alexander Kozlov, Xueqin Huang, Robert Benson, Shing Fung

6

IMA

GE

Tea m

Mee

ti ng

Low

e ll,

J une

5, 2

0 03

New in CORPRAL

• Resonance matching• Improvements in the vision model

– Zones of facilitation pattern– Perceptual grouping

Page 7: An Automated Image Processing System for RPI Data Ivan Galkin, Bodo Reinisch, Grigori Khmyrov, Alexander Kozlov, Xueqin Huang, Robert Benson, Shing Fung

7

IMA

GE

Tea m

Mee

ti ng

Low

e ll,

J une

5, 2

0 03

RPI Plasmagram

Page 8: An Automated Image Processing System for RPI Data Ivan Galkin, Bodo Reinisch, Grigori Khmyrov, Alexander Kozlov, Xueqin Huang, Robert Benson, Shing Fung

8

IMA

GE

Tea m

Mee

ti ng

Low

e ll,

J une

5, 2

0 03

Resonance Model1. Gyrofrequency fce and

its harmonics nfce

2. Plasma frequency fpe

3. Upper Hybrid resonance, fT

4. Q-type and its harmonics, fQn (a.k.a. Bernstein mode resonances)

5. D-type and its harmonics, fDn

22cepeT fff

2

2

2

46.0

ce

peceQn f

fn

nff

22

22

95.0

ceDnDn

ceDnDn

cepeDn

fff

fff

nfff

fpe and fce drive all other frequencies

Page 9: An Automated Image Processing System for RPI Data Ivan Galkin, Bodo Reinisch, Grigori Khmyrov, Alexander Kozlov, Xueqin Huang, Robert Benson, Shing Fung

9

IMA

GE

Tea m

Mee

ti ng

Low

e ll,

J une

5, 2

0 03

Previous Approach• Superimpose a comb template on the

plasmagram and seek the best quality of fit for varying drivers fpe and fce

• Used for ISIS/Alouette, ISS-B, ISEE-1• Discouraging results with RPI data

– Tremendous variety of conditions– Frequency coverage not always optimal– Accuracy vs precision issues

• 0.7% accuracy is required for model self-consistency… often means subpixel accuracy

– Noise environment

Page 10: An Automated Image Processing System for RPI Data Ivan Galkin, Bodo Reinisch, Grigori Khmyrov, Alexander Kozlov, Xueqin Huang, Robert Benson, Shing Fung

10

IMA

GE

Tea m

Mee

ti ng

Low

e ll,

J une

5, 2

0 03

Improvements

A. Image filter to highlight resonance signatures.

B. Resonance signature detection and contrast evaluation. Use signature contrasts to calculate fit quality.

C. Account for changes in the medium within measurement time.

Page 11: An Automated Image Processing System for RPI Data Ivan Galkin, Bodo Reinisch, Grigori Khmyrov, Alexander Kozlov, Xueqin Huang, Robert Benson, Shing Fung

11

IMA

GE

Tea m

Mee

ti ng

Low

e ll,

J une

5, 2

0 03

A. Signature FilterF(Ai) = median{Aj}, j = (1, i)(“cumulative” median filter)

Filter response to a falling envelope

0

10

20

30

40

50

60

70

80

90

100 InputOutput

0

10

20

30

40

50

60

70

80

90

100 InputOutput

Filter response to a rising envelope

Page 12: An Automated Image Processing System for RPI Data Ivan Galkin, Bodo Reinisch, Grigori Khmyrov, Alexander Kozlov, Xueqin Huang, Robert Benson, Shing Fung

12

IMA

GE

Tea m

Mee

ti ng

Low

e ll,

J une

5, 2

0 03

A. Filter Example

Page 13: An Automated Image Processing System for RPI Data Ivan Galkin, Bodo Reinisch, Grigori Khmyrov, Alexander Kozlov, Xueqin Huang, Robert Benson, Shing Fung

13

IMA

GE

Tea m

Mee

ti ng

Low

e ll,

J une

5, 2

0 03

B. Signature Detector

Page 14: An Automated Image Processing System for RPI Data Ivan Galkin, Bodo Reinisch, Grigori Khmyrov, Alexander Kozlov, Xueqin Huang, Robert Benson, Shing Fung

14

IMA

GE

Tea m

Mee

ti ng

Low

e ll,

J une

5, 2

0 03

C. Change of Medium

fce(t1) fpe (t2) fT (t3)

)()()(

)()()(

32

32

3

12

22

3

tftftf

tftftf

cepeT

cepeT

• Driving fce and fpe are taken at the plasmagram start.• Template frequencies are corrected for the

gradients of the driving fce and fpe .

• Iterative scheme is used to find self-consistent set of all involved resonance frequencies.

Time, frequency

Page 15: An Automated Image Processing System for RPI Data Ivan Galkin, Bodo Reinisch, Grigori Khmyrov, Alexander Kozlov, Xueqin Huang, Robert Benson, Shing Fung

15

IMA

GE

Tea m

Mee

ti ng

Low

e ll,

J une

5, 2

0 03

Resonances in BinBrowser

Page 16: An Automated Image Processing System for RPI Data Ivan Galkin, Bodo Reinisch, Grigori Khmyrov, Alexander Kozlov, Xueqin Huang, Robert Benson, Shing Fung

16

IMA

GE

Tea m

Mee

ti ng

Low

e ll,

J une

5, 2

0 03

Confidence Level• Confidence of automated

resonance scaling = Nu, number of signatures remained unmatched to their theoretical counterparts

• Nu is written as “expert rating” to the RPI Level 2 database

• Queries of Nu and Nu datamining

Page 17: An Automated Image Processing System for RPI Data Ivan Galkin, Bodo Reinisch, Grigori Khmyrov, Alexander Kozlov, Xueqin Huang, Robert Benson, Shing Fung

17

IMA

GE

Tea m

Mee

ti ng

Low

e ll,

J une

5, 2

0 03

Plasmagram Processing

Raw ImageEchoes

TracesClassified Traces

Decisions

RotorsSaliency Map

(Mar

r’s P

arad

igm

)

Page 18: An Automated Image Processing System for RPI Data Ivan Galkin, Bodo Reinisch, Grigori Khmyrov, Alexander Kozlov, Xueqin Huang, Robert Benson, Shing Fung

18

IMA

GE

Tea m

Mee

ti ng

Low

e ll,

J une

5, 2

0 03

Raw Image Echoes

RAW IMAGE

LABELING (NO THRESHOLDING)

LABELING (AFTER THRESHOLDING)

Page 19: An Automated Image Processing System for RPI Data Ivan Galkin, Bodo Reinisch, Grigori Khmyrov, Alexander Kozlov, Xueqin Huang, Robert Benson, Shing Fung

19

IMA

GE

Tea m

Mee

ti ng

Low

e ll,

J une

5, 2

0 03

Echoes Rotors

• Rotors – contour direction at each labeled pixel

• Original estimate of the direction is local, subject to errors

• Hough Transform for initial rotor directions

Page 20: An Automated Image Processing System for RPI Data Ivan Galkin, Bodo Reinisch, Grigori Khmyrov, Alexander Kozlov, Xueqin Huang, Robert Benson, Shing Fung

20

IMA

GE

Tea m

Mee

ti ng

Low

e ll,

J une

5, 2

0 03

Rotors Saliency Map• Energy minimization algorithm to find optimal

rotor orientations in a dynamic system of collectively interacting rotors

• Hopfield neural network with simulated annealing scheme to find the optimal state of rotors