a probabilistic catalogue of unresolved high latitude fermi lat … · 2017-10-03 · people make...

35
Probabilistic Cataloguing Stephen K N PORTILLO with Benjamin C G LEE, Tansu DAYLAN and Douglas P FINKBEINER 29 September 2017 INPA Seminar

Upload: others

Post on 08-Jun-2020

1 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: A Probabilistic Catalogue of Unresolved High Latitude Fermi LAT … · 2017-10-03 · People make catalogues Catalogue and color-magnitude diagram: An et al. ApJS 179, 328 (2008)

Probabilistic CataloguingStephen K N PORTILLO

with Benjamin C G LEE, Tansu DAYLAN andDouglas P FINKBEINER

29 September 2017INPA Seminar

Page 2: A Probabilistic Catalogue of Unresolved High Latitude Fermi LAT … · 2017-10-03 · People make catalogues Catalogue and color-magnitude diagram: An et al. ApJS 179, 328 (2008)

Outline• Why use probabilistic cataloging?

• What is probabilistic cataloging?

• Application to faint source populations

• Application to crowded stellar fields

• Extending probabilistic cataloging to star + galaxy fields

Page 3: A Probabilistic Catalogue of Unresolved High Latitude Fermi LAT … · 2017-10-03 · People make catalogues Catalogue and color-magnitude diagram: An et al. ApJS 179, 328 (2008)

Why use probabilistic cataloging?

Page 4: A Probabilistic Catalogue of Unresolved High Latitude Fermi LAT … · 2017-10-03 · People make catalogues Catalogue and color-magnitude diagram: An et al. ApJS 179, 328 (2008)

Telescopes don’t make catalogues!

Slide title stolen from Hogg and Lang, EAS Publication Series 45, 351 (2011)

Image: SDSS DR 12

Page 5: A Probabilistic Catalogue of Unresolved High Latitude Fermi LAT … · 2017-10-03 · People make catalogues Catalogue and color-magnitude diagram: An et al. ApJS 179, 328 (2008)

Peoplemake catalogues

Catalogue and color-magnitude diagram: An et al. ApJS 179, 328 (2008)

RA (J2000) DEC (J2000) g r

229.4351 2.010923 19.344 19.114

229.4353 1.990166 23.070 21.441

229.4358 2.033374 21.809 21.252

229.4361 2.070269 20.107 19.737

229.4362 1.997957 22.894 21.365

229.4364 2.048578 22.386 21.656

229.4366 2.053515 20.853 20.418

229.4369 2.103516 21.827 21.066

229.4369 2.043476 23.067 21.700

229.4370 2.051732 19.960 19.610

229.4371 2.102266 20.813 20.331

229.4373 2.052342 20.785 20.33

229.4374 1.996688 21.161 20.642

229.4376 2.133210 22.476 21.616

229.4378 2.039289 20.883 20.410

229.4380 2.077996 22.682 21.850

229.4380 2.043483 22.884 21.680

229.4381 2.045585 20.111 19.719

229.4382 2.011463 22.069 21.316

229.4382 2.029807 19.625 19.399

229.4382 2.030182 17.835 17.245

229.4385 2.157053 22.193 21.877

229.4385 2.147021 22.492 21.546

… … … …

images catalogues science

Page 6: A Probabilistic Catalogue of Unresolved High Latitude Fermi LAT … · 2017-10-03 · People make catalogues Catalogue and color-magnitude diagram: An et al. ApJS 179, 328 (2008)

Faint Source Populationsincreasing 𝐹𝑚𝑖𝑛, 𝐼𝑖𝑠𝑜constant 𝐼 𝑑Ω

infi

nit

e c

ou

nts

fin

ite c

ou

nts

Counting statistics introduce a point source detection threshold

But even sources fainter than this threshold can affect image

𝐹𝑚𝑖𝑛 = 1 ph 𝐹𝑚𝑖𝑛 = 4 ph 𝐹𝑚𝑖𝑛 = 16 ph 𝐹𝑚𝑖𝑛 = 64 ph

Page 7: A Probabilistic Catalogue of Unresolved High Latitude Fermi LAT … · 2017-10-03 · People make catalogues Catalogue and color-magnitude diagram: An et al. ApJS 179, 328 (2008)

Crowded Field Cataloguing

Data: SDSS DR12

Catalog: An et al. ApJS 179, 328 (2008)

Page 8: A Probabilistic Catalogue of Unresolved High Latitude Fermi LAT … · 2017-10-03 · People make catalogues Catalogue and color-magnitude diagram: An et al. ApJS 179, 328 (2008)

Traditional Catalogue Issues

Deblending ambiguities

Source-source covariance

These issues will become more relevant as we build

more sensitive ground-based telescopes

Page 9: A Probabilistic Catalogue of Unresolved High Latitude Fermi LAT … · 2017-10-03 · People make catalogues Catalogue and color-magnitude diagram: An et al. ApJS 179, 328 (2008)

What is probabilistic cataloging?

Page 10: A Probabilistic Catalogue of Unresolved High Latitude Fermi LAT … · 2017-10-03 · People make catalogues Catalogue and color-magnitude diagram: An et al. ApJS 179, 328 (2008)

Probabilistic Cataloguing• Infer an ensemble of catalogues

• Reflects populations of faint sources that are compatible with the data, without overfitting

Page 11: A Probabilistic Catalogue of Unresolved High Latitude Fermi LAT … · 2017-10-03 · People make catalogues Catalogue and color-magnitude diagram: An et al. ApJS 179, 328 (2008)

Probabilistic Cataloguing• Infer an ensemble of catalogues

• Naturally handles deblending ambiguities andsource-source covariance in crowded fields

• Ensemble samples Bayesian posterior distribution of catalogues

𝑃 Catalogue Image ∝ 𝜋 Catalogue ℒ Image Catalogue• Explore catalogue space with Markov Chain Monte Carlo

Page 12: A Probabilistic Catalogue of Unresolved High Latitude Fermi LAT … · 2017-10-03 · People make catalogues Catalogue and color-magnitude diagram: An et al. ApJS 179, 328 (2008)

Bayesian Framework• Likelihood

Calculate the model image based on the catalogue

Compare the model image to the data and calculate likelihood

• Prior

Set priors for nuisance parameters like sky level

Set population distributions for source parameters

Set prior on the number of sources

Flat prior, no minimum flux: image will be overfit

Physical prior above some minimum flux

Parsimony prior to penalize unimportant sources

Page 13: A Probabilistic Catalogue of Unresolved High Latitude Fermi LAT … · 2017-10-03 · People make catalogues Catalogue and color-magnitude diagram: An et al. ApJS 179, 328 (2008)

Transdimensional Proposals• Birth

Propose new source, drawing from prior population distributions

• Death

Choose a source at random to remove

• Split

Choose a source at random to split

Split it into two, conserving flux and centre of flux and separate them according to some kick distribution

• Merge

For all pairs, use the value of the kick distribution for their separation as weights

Choose a pair using these weights and merge them, conserving flux and centre of mass

𝑟~𝐾 𝑟

𝑤 = 𝐾 𝑟

Page 14: A Probabilistic Catalogue of Unresolved High Latitude Fermi LAT … · 2017-10-03 · People make catalogues Catalogue and color-magnitude diagram: An et al. ApJS 179, 328 (2008)

Application to faint source populationsDaylan, Portillo, & Finkbeiner, 2017, ApJ, 839, 4

Image: Fermi

Page 15: A Probabilistic Catalogue of Unresolved High Latitude Fermi LAT … · 2017-10-03 · People make catalogues Catalogue and color-magnitude diagram: An et al. ApJS 179, 328 (2008)

Probabilistic Catalogue

Page 16: A Probabilistic Catalogue of Unresolved High Latitude Fermi LAT … · 2017-10-03 · People make catalogues Catalogue and color-magnitude diagram: An et al. ApJS 179, 328 (2008)

Population Constraints

Page 17: A Probabilistic Catalogue of Unresolved High Latitude Fermi LAT … · 2017-10-03 · People make catalogues Catalogue and color-magnitude diagram: An et al. ApJS 179, 328 (2008)

Flux and Colour Distributions

Page 18: A Probabilistic Catalogue of Unresolved High Latitude Fermi LAT … · 2017-10-03 · People make catalogues Catalogue and color-magnitude diagram: An et al. ApJS 179, 328 (2008)

Comparison with Traditional Catalogue

Page 19: A Probabilistic Catalogue of Unresolved High Latitude Fermi LAT … · 2017-10-03 · People make catalogues Catalogue and color-magnitude diagram: An et al. ApJS 179, 328 (2008)

Application to crowded stellar fieldsPortillo, Lee, Daylan, & Finkbeiner, 2017, AJ, 154, 4

Page 20: A Probabilistic Catalogue of Unresolved High Latitude Fermi LAT … · 2017-10-03 · People make catalogues Catalogue and color-magnitude diagram: An et al. ApJS 179, 328 (2008)

Traditional CatalogueDAOPhot

Page 21: A Probabilistic Catalogue of Unresolved High Latitude Fermi LAT … · 2017-10-03 · People make catalogues Catalogue and color-magnitude diagram: An et al. ApJS 179, 328 (2008)

Compared to HubbleDAOPhot

HST

Page 22: A Probabilistic Catalogue of Unresolved High Latitude Fermi LAT … · 2017-10-03 · People make catalogues Catalogue and color-magnitude diagram: An et al. ApJS 179, 328 (2008)

Probabilistic CatalogueDAOPhot

HST

PCat

Page 23: A Probabilistic Catalogue of Unresolved High Latitude Fermi LAT … · 2017-10-03 · People make catalogues Catalogue and color-magnitude diagram: An et al. ApJS 179, 328 (2008)

Completeness

>1 mag deeper

Page 24: A Probabilistic Catalogue of Unresolved High Latitude Fermi LAT … · 2017-10-03 · People make catalogues Catalogue and color-magnitude diagram: An et al. ApJS 179, 328 (2008)

False Discovery Rate

lower false

discovery rate

high false

discovery rate

from blending

faint sources

Page 25: A Probabilistic Catalogue of Unresolved High Latitude Fermi LAT … · 2017-10-03 · People make catalogues Catalogue and color-magnitude diagram: An et al. ApJS 179, 328 (2008)

Stacked Catalogue EnsembleDAOPhot

HST

PCat

Page 26: A Probabilistic Catalogue of Unresolved High Latitude Fermi LAT … · 2017-10-03 · People make catalogues Catalogue and color-magnitude diagram: An et al. ApJS 179, 328 (2008)

Condensed CatalogueDAOPhot

HST

PCat(condensed)

Page 27: A Probabilistic Catalogue of Unresolved High Latitude Fermi LAT … · 2017-10-03 · People make catalogues Catalogue and color-magnitude diagram: An et al. ApJS 179, 328 (2008)

Completeness(Condensed Catalogue)

Page 28: A Probabilistic Catalogue of Unresolved High Latitude Fermi LAT … · 2017-10-03 · People make catalogues Catalogue and color-magnitude diagram: An et al. ApJS 179, 328 (2008)

False Discovery Rate (Condensed Catalogue)

Page 29: A Probabilistic Catalogue of Unresolved High Latitude Fermi LAT … · 2017-10-03 · People make catalogues Catalogue and color-magnitude diagram: An et al. ApJS 179, 328 (2008)

Extending probabilistic cataloging tostar + galaxy fields

Image: Princeton/Hyper Suprime Cam Project

Page 30: A Probabilistic Catalogue of Unresolved High Latitude Fermi LAT … · 2017-10-03 · People make catalogues Catalogue and color-magnitude diagram: An et al. ApJS 179, 328 (2008)

Bayesian Framework• Likelihood

Calculate the model image based on the catalogue

Compare the model image to the data and calculate likelihood

• Prior Set priors for nuisance parameters

Set population distributions for source parameters

Set prior on the number of sources

• Need to parameterize sources

• Galaxies are often fit with Sérsic profiles

𝐼 𝑟; 𝐼𝑒 , 𝑛, 𝑟𝑒 = 𝐼𝑒 exp −𝑏𝑛𝑟

𝑟𝑒

1 𝑛

− 1

• Profile is approximate – most useful when detailed structure is not discernable

Page 31: A Probabilistic Catalogue of Unresolved High Latitude Fermi LAT … · 2017-10-03 · People make catalogues Catalogue and color-magnitude diagram: An et al. ApJS 179, 328 (2008)

Transdimensional Proposals• Birth

Star

Galaxy

• Death

Star

Galaxy

• Star Galaxy

• Galaxy Star

• Split

Star 2 Stars

Galaxy 2 Galaxies

Galaxy Galaxy + Star

• Merge

2 Stars Star

2 Galaxies Galaxy

Galaxy + Star Galaxy

Page 32: A Probabilistic Catalogue of Unresolved High Latitude Fermi LAT … · 2017-10-03 · People make catalogues Catalogue and color-magnitude diagram: An et al. ApJS 179, 328 (2008)

Galaxy Model Images• Calculating model image is

the slowest part for stars –even more so for galaxies

• We sped up our point source model image calculation

• So approximate galaxy profiles with a collection of point sources?

Page 33: A Probabilistic Catalogue of Unresolved High Latitude Fermi LAT … · 2017-10-03 · People make catalogues Catalogue and color-magnitude diagram: An et al. ApJS 179, 328 (2008)

Deblending Stars + Galaxies

star

galaxyfaint

galaxy

Page 34: A Probabilistic Catalogue of Unresolved High Latitude Fermi LAT … · 2017-10-03 · People make catalogues Catalogue and color-magnitude diagram: An et al. ApJS 179, 328 (2008)

Deblending Stars + Galaxies

star

galaxyfaint

galaxy

Page 35: A Probabilistic Catalogue of Unresolved High Latitude Fermi LAT … · 2017-10-03 · People make catalogues Catalogue and color-magnitude diagram: An et al. ApJS 179, 328 (2008)

Conclusion• Traditional cataloguing loses information on faint source

populations and does not capture deblendingambiguities and source-source covariance

• Probabilistic cataloguing infers an ensemble of catalogues and captures the information lost by traditional catalogues

• Probabilistic cataloguing performs better in crowded stellar fields than traditional cataloguing

• The problem of crowded field photometry will be very relevant in the LSST era

• We are working on speed improvements and extending the method to star + galaxy fields