voeventnet.caltech.edu neat pipeline for transients ashish mahabal, joshua dickerson, george...

35
voeventnet.caltech.edu NEAT pipeline for transients Ashish Mahabal, Joshua Dickerson, George Djorgovski and the Caltech group

Upload: lily-sinclair

Post on 27-Mar-2015

225 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Voeventnet.caltech.edu NEAT pipeline for transients Ashish Mahabal, Joshua Dickerson, George Djorgovski and the Caltech group

voeventnet.caltech.edu

NEAT pipeline for transients

Ashish Mahabal, Joshua Dickerson, George Djorgovski and the Caltech group

Page 2: Voeventnet.caltech.edu NEAT pipeline for transients Ashish Mahabal, Joshua Dickerson, George Djorgovski and the Caltech group

• Transients from NEAT data

• Extensible: PQ (+ other surveys)• Complimentary to other approaches (e.g. catalog domain)

• Brief update on Solar System objects/Variables associated with VOEvent error ellipses

Page 3: Voeventnet.caltech.edu NEAT pipeline for transients Ashish Mahabal, Joshua Dickerson, George Djorgovski and the Caltech group

NEAT

NEAT is a program to look for Near Earth Asteroids(Mike Brown et al.)

o Palomar observatoryo 48-inch Oschin Schmidt telescopeo Palomar-QUEST camera - 112 CCDso Point and shoot mode

Page 4: Voeventnet.caltech.edu NEAT pipeline for transients Ashish Mahabal, Joshua Dickerson, George Djorgovski and the Caltech group

The Palomar-Quest (PQ) and NEAT Surveys

P48

done with the Yale/IU Quest-2 112-CCD camera at the Palomar 48” Oschin Schmidt

telescope

Page 5: Voeventnet.caltech.edu NEAT pipeline for transients Ashish Mahabal, Joshua Dickerson, George Djorgovski and the Caltech group

The NEAT mode

o Triplets 20 or 90 minutes aparto Single filter (R) usedo Subroutine looks for possible

transientso Lot of junk ensuring real candidates

are retainedo Several tens per night

Page 6: Voeventnet.caltech.edu NEAT pipeline for transients Ashish Mahabal, Joshua Dickerson, George Djorgovski and the Caltech group

Process flow A NEAT tar file arrives nightly Script detects new arrival - springs in to

action Valid candidates identified and transformed

on to a web page - tentatively it is: http://www.astro.caltech.edu/~dposs/NEAT

Alerts sent off for most promising ones

Page 7: Voeventnet.caltech.edu NEAT pipeline for transients Ashish Mahabal, Joshua Dickerson, George Djorgovski and the Caltech group

First attempt

o Take a tripleto Obtain catalogs using sextractoro Throw out extended objectso Compare seeing based object

numberso Check if central object shows big

magnitude swing

Page 8: Voeventnet.caltech.edu NEAT pipeline for transients Ashish Mahabal, Joshua Dickerson, George Djorgovski and the Caltech group

Data Flow

NEAT.tar Files

MEFs Images

IRAF

SExtractorCatalog

Matching

Possible Transien

t?

FITS Files 1, 2 & 3

Catalogs 1, 2 & 3

Filter Against Documented Sources, etc.

Generate Report, Send

Alerts.

Database

Figure 1. Transient Discovery Flowchart

History Extraction(010)…

Filter against Seeing

Page 9: Voeventnet.caltech.edu NEAT pipeline for transients Ashish Mahabal, Joshua Dickerson, George Djorgovski and the Caltech group

Transient Criteria

Object history, hi

Visibility/seeing, vi

Stellarity, si

Detected? Dj

jth Candidate is ranked by probability, pj

Image 1 Image 2 Image 3 Possible Transient

0 0 0 0

0 0 1 1

0 1 0 1 (Best case)

0 1 1 1

1 0 0 1

1 0 1 0

1 1 0 1

1 1 1 0

{ ( )ji

hshvj dp ii

ii ⎥⎦

⎤⎢⎣

⎡= ∏

=

==

3

1

1,0,

Page 10: Voeventnet.caltech.edu NEAT pipeline for transients Ashish Mahabal, Joshua Dickerson, George Djorgovski and the Caltech group

Complicating Factors

Faint stars near detection threshold CCD defects Satellites, airplanes Crowded fields

Asteroids Known variables

Page 11: Voeventnet.caltech.edu NEAT pipeline for transients Ashish Mahabal, Joshua Dickerson, George Djorgovski and the Caltech group

Example artifactso CCD defectso Reflectionso Grazing CRso Partially

uncorrected bad columns

o unknowns

Page 12: Voeventnet.caltech.edu NEAT pipeline for transients Ashish Mahabal, Joshua Dickerson, George Djorgovski and the Caltech group

More artifacts

Page 13: Voeventnet.caltech.edu NEAT pipeline for transients Ashish Mahabal, Joshua Dickerson, George Djorgovski and the Caltech group
Page 14: Voeventnet.caltech.edu NEAT pipeline for transients Ashish Mahabal, Joshua Dickerson, George Djorgovski and the Caltech group

Some reasons

o Sextractor’s S/G classification is not the best

o In crowded areas and with variable seeing sextractor gets easily confused

Page 15: Voeventnet.caltech.edu NEAT pipeline for transients Ashish Mahabal, Joshua Dickerson, George Djorgovski and the Caltech group

Modifications

o Better statistics - sigma clipping to determine typical variation (non-intrinsic)

o Use checkimage and the extent of object it defines to better estimate the magnitude

o Obtain stellarity measure independently

Page 16: Voeventnet.caltech.edu NEAT pipeline for transients Ashish Mahabal, Joshua Dickerson, George Djorgovski and the Caltech group

Result

o Much better clean-upo A very small fraction of possibly real

candidates get thrown outo Smaller proportion of contaminantso Script now ready as a blackbox to

unleash transientso Advanced cog-sci still needed to

assign significance values to events

Page 17: Voeventnet.caltech.edu NEAT pipeline for transients Ashish Mahabal, Joshua Dickerson, George Djorgovski and the Caltech group

Specimen

Page 18: Voeventnet.caltech.edu NEAT pipeline for transients Ashish Mahabal, Joshua Dickerson, George Djorgovski and the Caltech group

And couple more

Page 19: Voeventnet.caltech.edu NEAT pipeline for transients Ashish Mahabal, Joshua Dickerson, George Djorgovski and the Caltech group

Complimentary work

Current work is clearly extensible to other surveys, and especially our own Drift Scan data from the Palomar-QUEST survey.

o Basic work based on mosaicing carried out for the Griffith Observatory picture has been started

o Being extended using HyperAtlaso To be “real time” in the near future

Page 20: Voeventnet.caltech.edu NEAT pipeline for transients Ashish Mahabal, Joshua Dickerson, George Djorgovski and the Caltech group
Page 21: Voeventnet.caltech.edu NEAT pipeline for transients Ashish Mahabal, Joshua Dickerson, George Djorgovski and the Caltech group

Asteroids in the Big Picture

Tile b07

740 Cantabia

Page 22: Voeventnet.caltech.edu NEAT pipeline for transients Ashish Mahabal, Joshua Dickerson, George Djorgovski and the Caltech group

The Big Picture A 152 ft 20 ft mural produced for Griffith Observatory

from PQ survey BRI images A swath of 15.2 2.0 swath through the center of the

Virgo cluster, sampled at 0.4 arcsec/pixel, giving a 136,800 18,000 pixel image

Computed at CACR using HyperAtlas and a custom data cleaning pipeline

Reproduced on 114 steel-backed porcellain plates, expected to last many decades

Will be seen by millions of visitors Associated website will include NVO outreach

Page 23: Voeventnet.caltech.edu NEAT pipeline for transients Ashish Mahabal, Joshua Dickerson, George Djorgovski and the Caltech group

The Big Picture:Tile C12 (M87)Zoom-in

Page 24: Voeventnet.caltech.edu NEAT pipeline for transients Ashish Mahabal, Joshua Dickerson, George Djorgovski and the Caltech group

Big Picture - Detail

Page 25: Voeventnet.caltech.edu NEAT pipeline for transients Ashish Mahabal, Joshua Dickerson, George Djorgovski and the Caltech group

Catalog domain

Another complimentary area is the catalog domain

o Started a basic program using single epoch catalogs from the Yale pipeline

o Awaiting new and improved catalogs from Caltech pipeline which is now up and running

o This is “next day” stuff …

Page 26: Voeventnet.caltech.edu NEAT pipeline for transients Ashish Mahabal, Joshua Dickerson, George Djorgovski and the Caltech group

Examples (Priya Kollipara)

Page 27: Voeventnet.caltech.edu NEAT pipeline for transients Ashish Mahabal, Joshua Dickerson, George Djorgovski and the Caltech group
Page 28: Voeventnet.caltech.edu NEAT pipeline for transients Ashish Mahabal, Joshua Dickerson, George Djorgovski and the Caltech group

Conclusions for part I

We are ready to start producing events.Lots of them.

It is now important to have ways toAttach significance values to differentEvents. (Entities like aggregators will

not be intelligent unless we make them so)

Page 29: Voeventnet.caltech.edu NEAT pipeline for transients Ashish Mahabal, Joshua Dickerson, George Djorgovski and the Caltech group

Event Synthesis Engine

Pairitel

Palomar 60”

Raptor

PQ next-daypipelines

catalog

Palomar-Quest

knownVariables

knownasteroids

SDSS2MASS

PQ Event Factory

remote archives

baselinesky

eStar

VOEventNet

VOEventNet: a Rapid-Response Telescope Grid

VOEventdatabase

Page 30: Voeventnet.caltech.edu NEAT pipeline for transients Ashish Mahabal, Joshua Dickerson, George Djorgovski and the Caltech group

Solar system objects/Variables

Known asteroids and variables can masquerade as transients. These can easily be eliminated by overplotting the error ellipse with solar system objects and variables.

o Get epoch, coordinates, error ellipseo Get solar system objects, variables and a

sky survey imageo Allow overplotting of other possibly

interesting source types like X-ray and radio sources.

Page 31: Voeventnet.caltech.edu NEAT pipeline for transients Ashish Mahabal, Joshua Dickerson, George Djorgovski and the Caltech group

http://avyakta.caltech.edu:8080/cgi-bin/grand_aladin3.cgiCurrently uses aladin. Images from

DPOSS for northern sky and DSS for southern sky could be used

http://avyakta.caltech.edu:8080/nvoevent/

has the collective list

Page 32: Voeventnet.caltech.edu NEAT pipeline for transients Ashish Mahabal, Joshua Dickerson, George Djorgovski and the Caltech group

GUI (RESTful) String

DateTime

SIAP like

Page 33: Voeventnet.caltech.edu NEAT pipeline for transients Ashish Mahabal, Joshua Dickerson, George Djorgovski and the Caltech group

Output

Page 34: Voeventnet.caltech.edu NEAT pipeline for transients Ashish Mahabal, Joshua Dickerson, George Djorgovski and the Caltech group

Currently as cgiDirectly callable

Can consume feeds directlyEvents stored as an HTML page

Page 35: Voeventnet.caltech.edu NEAT pipeline for transients Ashish Mahabal, Joshua Dickerson, George Djorgovski and the Caltech group

Current tentative URLs

NEAT VOEvents: http://www.astro.caltech.edu/~dposs/NEAT

Solar System objects/Variables:

http://avyakta.caltech.edu:8080/cgi-bin/grand_aladin3.cgi

http://avyakta.caltech.edu:8080/nvoevent/