surrogate modelingsolutions - nasa · nasa machine learning workshop august 30th, 2017. overview 1....
TRANSCRIPT
![Page 1: Surrogate ModelingSolutions - NASA · NASA Machine Learning Workshop August 30th, 2017. Overview 1. Science Radio intensity mappingof cosmic hydrogen and the quest to detect the Epoch](https://reader034.vdocuments.site/reader034/viewer/2022052103/603dbb22bb45f378fa456485/html5/thumbnails/1.jpg)
Surrogate Modeling Solutionsfor Cosmological Parameter Inference
of Hydrogen Intensity Mapping Surveys
Nick KernUC Berkeley
NASA Machine Learning WorkshopAugust 30th, 2017
![Page 2: Surrogate ModelingSolutions - NASA · NASA Machine Learning Workshop August 30th, 2017. Overview 1. Science Radio intensity mappingof cosmic hydrogen and the quest to detect the Epoch](https://reader034.vdocuments.site/reader034/viewer/2022052103/603dbb22bb45f378fa456485/html5/thumbnails/2.jpg)
Overview
1. ScienceRadio intensity mapping of cosmic hydrogen and the quest to
detect the Epoch of Reionization (EoR)
Nick Kern NASA ML Workshop 8/30/2017
2. Machine LearningCosmological parameter inference and how surrogate modeling
enables for more robust constraints
3. ApplicationForecast of future constraints from the Hydrogen Epoch of
Reionization Array1 (HERA), a $15M international project to build a radio telescope capable of detecting the EoR
1reionization.orgKern et al. 2017
arXiv:1705.04688
![Page 3: Surrogate ModelingSolutions - NASA · NASA Machine Learning Workshop August 30th, 2017. Overview 1. Science Radio intensity mappingof cosmic hydrogen and the quest to detect the Epoch](https://reader034.vdocuments.site/reader034/viewer/2022052103/603dbb22bb45f378fa456485/html5/thumbnails/3.jpg)
Science
Nick Kern NASA ML Workshop 8/30/2017
![Page 4: Surrogate ModelingSolutions - NASA · NASA Machine Learning Workshop August 30th, 2017. Overview 1. Science Radio intensity mappingof cosmic hydrogen and the quest to detect the Epoch](https://reader034.vdocuments.site/reader034/viewer/2022052103/603dbb22bb45f378fa456485/html5/thumbnails/4.jpg)
Cosmic History Timeline
Nick Kern NASA ML Workshop 8/30/2017
13.7 Gyr
![Page 5: Surrogate ModelingSolutions - NASA · NASA Machine Learning Workshop August 30th, 2017. Overview 1. Science Radio intensity mappingof cosmic hydrogen and the quest to detect the Epoch](https://reader034.vdocuments.site/reader034/viewer/2022052103/603dbb22bb45f378fa456485/html5/thumbnails/5.jpg)
Cosmic History Timeline
Nick Kern NASA ML Workshop 8/30/2017
Cosmic Microwave Background
Sloan Digital Sky Survey
what happened here?
13.7 Gyr
![Page 6: Surrogate ModelingSolutions - NASA · NASA Machine Learning Workshop August 30th, 2017. Overview 1. Science Radio intensity mappingof cosmic hydrogen and the quest to detect the Epoch](https://reader034.vdocuments.site/reader034/viewer/2022052103/603dbb22bb45f378fa456485/html5/thumbnails/6.jpg)
Cosmic History Timeline
Nick Kern NASA ML Workshop 8/30/2017
Cosmic Microwave Background
Sloan Digital Sky Survey
what happened here?
13.7 GyrAlvarez et al. 2009
![Page 7: Surrogate ModelingSolutions - NASA · NASA Machine Learning Workshop August 30th, 2017. Overview 1. Science Radio intensity mappingof cosmic hydrogen and the quest to detect the Epoch](https://reader034.vdocuments.site/reader034/viewer/2022052103/603dbb22bb45f378fa456485/html5/thumbnails/7.jpg)
Hydrogen’s 21cm “Spin Flip” Transition
Nick Kern NASA ML Workshop 8/30/2017
![Page 8: Surrogate ModelingSolutions - NASA · NASA Machine Learning Workshop August 30th, 2017. Overview 1. Science Radio intensity mappingof cosmic hydrogen and the quest to detect the Epoch](https://reader034.vdocuments.site/reader034/viewer/2022052103/603dbb22bb45f378fa456485/html5/thumbnails/8.jpg)
Nick Kern NASA ML Workshop 8/30/2017
21cm “Spin Flip” Transition for 3D Tomographic Mapping
![Page 9: Surrogate ModelingSolutions - NASA · NASA Machine Learning Workshop August 30th, 2017. Overview 1. Science Radio intensity mappingof cosmic hydrogen and the quest to detect the Epoch](https://reader034.vdocuments.site/reader034/viewer/2022052103/603dbb22bb45f378fa456485/html5/thumbnails/9.jpg)
Nick Kern NASA ML Workshop 8/30/2017
21cm “Spin Flip” Transition for 3D Tomographic Mapping
![Page 10: Surrogate ModelingSolutions - NASA · NASA Machine Learning Workshop August 30th, 2017. Overview 1. Science Radio intensity mappingof cosmic hydrogen and the quest to detect the Epoch](https://reader034.vdocuments.site/reader034/viewer/2022052103/603dbb22bb45f378fa456485/html5/thumbnails/10.jpg)
Nick Kern NASA ML Workshop 8/30/2017
21cm “Spin Flip” Transition for 3D Tomographic Mapping
![Page 11: Surrogate ModelingSolutions - NASA · NASA Machine Learning Workshop August 30th, 2017. Overview 1. Science Radio intensity mappingof cosmic hydrogen and the quest to detect the Epoch](https://reader034.vdocuments.site/reader034/viewer/2022052103/603dbb22bb45f378fa456485/html5/thumbnails/11.jpg)
Nick Kern NASA ML Workshop 8/30/2017
21cm “Spin Flip” Transition for 3D Tomographic Mapping
![Page 12: Surrogate ModelingSolutions - NASA · NASA Machine Learning Workshop August 30th, 2017. Overview 1. Science Radio intensity mappingof cosmic hydrogen and the quest to detect the Epoch](https://reader034.vdocuments.site/reader034/viewer/2022052103/603dbb22bb45f378fa456485/html5/thumbnails/12.jpg)
21cm “Spin Flip” Transition for 3D Tomographic Mapping
Nick Kern NASA ML Workshop 8/30/2017
redshift
frequency
z = 7z = 9z = 11
![Page 13: Surrogate ModelingSolutions - NASA · NASA Machine Learning Workshop August 30th, 2017. Overview 1. Science Radio intensity mappingof cosmic hydrogen and the quest to detect the Epoch](https://reader034.vdocuments.site/reader034/viewer/2022052103/603dbb22bb45f378fa456485/html5/thumbnails/13.jpg)
Radio Intensity Mapping Experiments
Nick Kern NASA ML Workshop 8/30/2017
21cm power spectrum
![Page 14: Surrogate ModelingSolutions - NASA · NASA Machine Learning Workshop August 30th, 2017. Overview 1. Science Radio intensity mappingof cosmic hydrogen and the quest to detect the Epoch](https://reader034.vdocuments.site/reader034/viewer/2022052103/603dbb22bb45f378fa456485/html5/thumbnails/14.jpg)
Machine Learning
Nick Kern NASA ML Workshop 8/30/2017
![Page 15: Surrogate ModelingSolutions - NASA · NASA Machine Learning Workshop August 30th, 2017. Overview 1. Science Radio intensity mappingof cosmic hydrogen and the quest to detect the Epoch](https://reader034.vdocuments.site/reader034/viewer/2022052103/603dbb22bb45f378fa456485/html5/thumbnails/15.jpg)
The last step: How do we interpret our data?• We want to constrain cosmological models:
Nick Kern NASA ML Workshop 8/30/2017
data
Ali et al. 2015
![Page 16: Surrogate ModelingSolutions - NASA · NASA Machine Learning Workshop August 30th, 2017. Overview 1. Science Radio intensity mappingof cosmic hydrogen and the quest to detect the Epoch](https://reader034.vdocuments.site/reader034/viewer/2022052103/603dbb22bb45f378fa456485/html5/thumbnails/16.jpg)
The last step: How do we interpret our data?• We want to constrain cosmological models:
Nick Kern NASA ML Workshop 8/30/2017
data model
Ali et al. 2015
![Page 17: Surrogate ModelingSolutions - NASA · NASA Machine Learning Workshop August 30th, 2017. Overview 1. Science Radio intensity mappingof cosmic hydrogen and the quest to detect the Epoch](https://reader034.vdocuments.site/reader034/viewer/2022052103/603dbb22bb45f378fa456485/html5/thumbnails/17.jpg)
The last step: How do we interpret our data?• We want to constrain cosmological models:
Nick Kern NASA ML Workshop 8/30/2017
data model
Ali et al. 2015
![Page 18: Surrogate ModelingSolutions - NASA · NASA Machine Learning Workshop August 30th, 2017. Overview 1. Science Radio intensity mappingof cosmic hydrogen and the quest to detect the Epoch](https://reader034.vdocuments.site/reader034/viewer/2022052103/603dbb22bb45f378fa456485/html5/thumbnails/18.jpg)
The last step: How do we interpret our data?• Maximize likelihood for parameter constraints
Nick Kern NASA ML Workshop 8/30/2017
data
model
observational error
Problem: what if our models are sophisticated & expensive simulations?— performing MCMC directly with the simulation is not practical (or even feasible) with limited time and resources
Solution:— use surrogate models to describe the simulation output over the space of its input parameters
— example: tRUN ~ 24 hours, NRUN ~ 104, tMCMC > 6 years on 100-core cluster
![Page 19: Surrogate ModelingSolutions - NASA · NASA Machine Learning Workshop August 30th, 2017. Overview 1. Science Radio intensity mappingof cosmic hydrogen and the quest to detect the Epoch](https://reader034.vdocuments.site/reader034/viewer/2022052103/603dbb22bb45f378fa456485/html5/thumbnails/19.jpg)
Surrogate Modeling aka Emulation
Nick Kern NASA ML Workshop 8/30/2017
![Page 20: Surrogate ModelingSolutions - NASA · NASA Machine Learning Workshop August 30th, 2017. Overview 1. Science Radio intensity mappingof cosmic hydrogen and the quest to detect the Epoch](https://reader034.vdocuments.site/reader034/viewer/2022052103/603dbb22bb45f378fa456485/html5/thumbnails/20.jpg)
Surrogate Modeling aka Emulation
Nick Kern NASA ML Workshop 8/30/2017
![Page 21: Surrogate ModelingSolutions - NASA · NASA Machine Learning Workshop August 30th, 2017. Overview 1. Science Radio intensity mappingof cosmic hydrogen and the quest to detect the Epoch](https://reader034.vdocuments.site/reader034/viewer/2022052103/603dbb22bb45f378fa456485/html5/thumbnails/21.jpg)
Surrogate Modeling aka Emulation
Nick Kern NASA ML Workshop 8/30/2017
emulatorcross validation set
training set
![Page 22: Surrogate ModelingSolutions - NASA · NASA Machine Learning Workshop August 30th, 2017. Overview 1. Science Radio intensity mappingof cosmic hydrogen and the quest to detect the Epoch](https://reader034.vdocuments.site/reader034/viewer/2022052103/603dbb22bb45f378fa456485/html5/thumbnails/22.jpg)
Surrogate Modeling aka Emulation
Nick Kern NASA ML Workshop 8/30/2017
Considerations:• training set sampling• choice of regression model• cross validation• error propagation
Benefits:• parameter constraints
with complex simulations• orders of magnitude faster
Costs:• approximate• bound by training set
Kern et al. 2017arXiv:1705.04688
github.com/nkern/emupy
![Page 23: Surrogate ModelingSolutions - NASA · NASA Machine Learning Workshop August 30th, 2017. Overview 1. Science Radio intensity mappingof cosmic hydrogen and the quest to detect the Epoch](https://reader034.vdocuments.site/reader034/viewer/2022052103/603dbb22bb45f378fa456485/html5/thumbnails/23.jpg)
Gaussian Process Regression
Nick Kern NASA ML Workshop 8/30/2017
![Page 24: Surrogate ModelingSolutions - NASA · NASA Machine Learning Workshop August 30th, 2017. Overview 1. Science Radio intensity mappingof cosmic hydrogen and the quest to detect the Epoch](https://reader034.vdocuments.site/reader034/viewer/2022052103/603dbb22bb45f378fa456485/html5/thumbnails/24.jpg)
Forecasting HERA Constraints
Nick Kern NASA ML Workshop 8/30/2017
![Page 25: Surrogate ModelingSolutions - NASA · NASA Machine Learning Workshop August 30th, 2017. Overview 1. Science Radio intensity mappingof cosmic hydrogen and the quest to detect the Epoch](https://reader034.vdocuments.site/reader034/viewer/2022052103/603dbb22bb45f378fa456485/html5/thumbnails/25.jpg)
Hydrogen Epoch of Reionization Array (HERA)
Nick Kern NASA ML Workshop 8/30/2017
PI: Parsons
![Page 26: Surrogate ModelingSolutions - NASA · NASA Machine Learning Workshop August 30th, 2017. Overview 1. Science Radio intensity mappingof cosmic hydrogen and the quest to detect the Epoch](https://reader034.vdocuments.site/reader034/viewer/2022052103/603dbb22bb45f378fa456485/html5/thumbnails/26.jpg)
Training an Emulator on an EoR Simulation
Nick Kern NASA ML Workshop 8/30/2017
Mesinger et al. 2011
• start with an eleven parameter model- six astrophysical : flat priors- five cosmological : Planck CMB priors
![Page 27: Surrogate ModelingSolutions - NASA · NASA Machine Learning Workshop August 30th, 2017. Overview 1. Science Radio intensity mappingof cosmic hydrogen and the quest to detect the Epoch](https://reader034.vdocuments.site/reader034/viewer/2022052103/603dbb22bb45f378fa456485/html5/thumbnails/27.jpg)
Training an Emulator on an EoR Simulation
Nick Kern NASA ML Workshop 8/30/2017
• generate Gaussian training set
• emulate 21cm power spectra
• cross validate
• HERA instrumental simulation
![Page 28: Surrogate ModelingSolutions - NASA · NASA Machine Learning Workshop August 30th, 2017. Overview 1. Science Radio intensity mappingof cosmic hydrogen and the quest to detect the Epoch](https://reader034.vdocuments.site/reader034/viewer/2022052103/603dbb22bb45f378fa456485/html5/thumbnails/28.jpg)
Joint Posterior Distribution
Nick Kern NASA ML Workshop 8/30/2017
![Page 29: Surrogate ModelingSolutions - NASA · NASA Machine Learning Workshop August 30th, 2017. Overview 1. Science Radio intensity mappingof cosmic hydrogen and the quest to detect the Epoch](https://reader034.vdocuments.site/reader034/viewer/2022052103/603dbb22bb45f378fa456485/html5/thumbnails/29.jpg)
Marginalized Posterior Distribution
Nick Kern NASA ML Workshop 8/30/2017
cosmologicalparameters
astrophysicalparameters
![Page 30: Surrogate ModelingSolutions - NASA · NASA Machine Learning Workshop August 30th, 2017. Overview 1. Science Radio intensity mappingof cosmic hydrogen and the quest to detect the Epoch](https://reader034.vdocuments.site/reader034/viewer/2022052103/603dbb22bb45f378fa456485/html5/thumbnails/30.jpg)
Summary
• Radio intensity mapping surveys are poised to make a first detection of primordial hydrogen at the EoR and subsequently produce strong
constraints on astrophysical parameters
• Challenges of MCMC with complex numerical simulations can be overcome by developing surrogate models that approximate the input-
output mapping of the simulation, which can then be used to accelerate MCMC sampling
• Surrogate modeling can be used to extract information from the data (i.e., parameter constraints) but, viewed the other way, can also be
used to extract information from the simulation (i.e., model calibration)
Nick Kern NASA ML Workshop 8/30/2017
![Page 31: Surrogate ModelingSolutions - NASA · NASA Machine Learning Workshop August 30th, 2017. Overview 1. Science Radio intensity mappingof cosmic hydrogen and the quest to detect the Epoch](https://reader034.vdocuments.site/reader034/viewer/2022052103/603dbb22bb45f378fa456485/html5/thumbnails/31.jpg)
Comparison against brute-force MCMC
Nick Kern NASA ML Workshop 8/30/2017