gravitational wave open data workshop ligoltech/gwodw2011/ 2011 october 27/28
DESCRIPTION
Gravitational Wave Open Data Workshop http://www.ligo.caltech.edu/gwodw2011/ 2011 October 27/28 Organized by Steve Groom, Christian Ott, Roy Williams and the LOC at LIGO Livingston Observatory, Louisiana Operated by LIGO Lab (Caltech, MIT) On behalf of the LIGO Scientific Consortium - PowerPoint PPT PresentationTRANSCRIPT
![Page 1: Gravitational Wave Open Data Workshop ligoltech/gwodw2011/ 2011 October 27/28](https://reader036.vdocuments.site/reader036/viewer/2022062806/56814f35550346895dbcd02d/html5/thumbnails/1.jpg)
LAAAP April 2011 LIGO-G1101181
Gravitational WaveOpen Data Workshop
http://www.ligo.caltech.edu/gwodw2011/2011 October 27/28
Organized by Steve Groom, Christian Ott, Roy Williams and the LOC
atLIGO Livingston Observatory, Louisiana
Operated by LIGO Lab (Caltech, MIT)On behalf of the LIGO Scientific ConsortiumSupported by National Science Foundation
![Page 2: Gravitational Wave Open Data Workshop ligoltech/gwodw2011/ 2011 October 27/28](https://reader036.vdocuments.site/reader036/viewer/2022062806/56814f35550346895dbcd02d/html5/thumbnails/2.jpg)
LAAAP April 2011 LIGO-G1101181
Why are we here?
![Page 3: Gravitational Wave Open Data Workshop ligoltech/gwodw2011/ 2011 October 27/28](https://reader036.vdocuments.site/reader036/viewer/2022062806/56814f35550346895dbcd02d/html5/thumbnails/3.jpg)
LIGO-G1101181 slide 3
LIGO ObservatoryLIGO ObservatoryLivingston, LouisianaLivingston, Louisiana
![Page 4: Gravitational Wave Open Data Workshop ligoltech/gwodw2011/ 2011 October 27/28](https://reader036.vdocuments.site/reader036/viewer/2022062806/56814f35550346895dbcd02d/html5/thumbnails/4.jpg)
LIGO-G1101181 slide 4
GWODW workshop
Advanced LIGO First science run in 2015 (we hope!) Multiple GW detections in 2015 (we hope!) Global observatory with VIRGO, Indigo (we hope!)
We are here to find out: “What do astronomers want from LIGO Open Data?”
![Page 5: Gravitational Wave Open Data Workshop ligoltech/gwodw2011/ 2011 October 27/28](https://reader036.vdocuments.site/reader036/viewer/2022062806/56814f35550346895dbcd02d/html5/thumbnails/5.jpg)
LIGO-G1101181 slide 5
GWODW workshop
Community input Report Implementation Science
= Science Program
+ “Breakout Groups”
![Page 6: Gravitational Wave Open Data Workshop ligoltech/gwodw2011/ 2011 October 27/28](https://reader036.vdocuments.site/reader036/viewer/2022062806/56814f35550346895dbcd02d/html5/thumbnails/6.jpg)
LIGO-G1101181 slide 6
ho
wstu
ffwo
rks.c
om
So here is some
CANDY …
We want to know what is in YOUR heads …
![Page 7: Gravitational Wave Open Data Workshop ligoltech/gwodw2011/ 2011 October 27/28](https://reader036.vdocuments.site/reader036/viewer/2022062806/56814f35550346895dbcd02d/html5/thumbnails/7.jpg)
LIGO-G1101181 slide 7
Breakout groups
A: Information Technology B: Smoking Gun: finding the flash or afterglow
C: Full Data: science from the strain channel
D: New searches: new science, fresh ideas
![Page 8: Gravitational Wave Open Data Workshop ligoltech/gwodw2011/ 2011 October 27/28](https://reader036.vdocuments.site/reader036/viewer/2022062806/56814f35550346895dbcd02d/html5/thumbnails/8.jpg)
LAAAP April 2011 LIGO-G1101181
LIGO Open Data Plans
![Page 9: Gravitational Wave Open Data Workshop ligoltech/gwodw2011/ 2011 October 27/28](https://reader036.vdocuments.site/reader036/viewer/2022062806/56814f35550346895dbcd02d/html5/thumbnails/9.jpg)
LIGO-G1101181 slide 9
“The top 10” benefits of data sharing in astronomy1) Early data releases greatly improve the final product
2) Early data releases enable coeval science
3) More science is extracted from the same dataset
4) Enables reproducibility of science results
5) Synergy between different datasets
6) Cross-disciplinary science
7) Sometimes the only way to secure scarce resources
8) More citations and prestige to the team
9) Education and public outreach
10) Ethics and broader impact
EM Smoking Gun
Coincidence and multi-messenger
Need broad support
Eg Astronomy and data-mining
Jobs for LIGO Postdocs
![Page 10: Gravitational Wave Open Data Workshop ligoltech/gwodw2011/ 2011 October 27/28](https://reader036.vdocuments.site/reader036/viewer/2022062806/56814f35550346895dbcd02d/html5/thumbnails/10.jpg)
LIGO-G1101181 slide 10
Data sharing is not free: comes with costs and risks:1) requires higher standards than for internal use, including publications describing data formats, provenance and metadata (insiders’ "know-how")2) the cost of curation (servers, help desk, etc.)3) risk of being “scooped” (larger for very focused/specialized data streams, more likely for an experiment than for a survey)
But: “Does releasing data weaken collaboration?” Not really, indeed Steve Ritz: “The Fermi collaboration became even stronger after the public data release.” and a lot of additional evidence from other surveys.
![Page 11: Gravitational Wave Open Data Workshop ligoltech/gwodw2011/ 2011 October 27/28](https://reader036.vdocuments.site/reader036/viewer/2022062806/56814f35550346895dbcd02d/html5/thumbnails/11.jpg)
LIGO-G1101181 slide 11
Timeline
2011
2013
2012
2014
2015
2016
2017
2018
2019
L1 H2 H1
S7
Phase 1: First Detections (early date)
Phase 2A: Immediate Triggers (early date)
Phase 2B: Full Data (early date)
2.5 years
For greater details:See LIGO Data Management Plan, Jan 2011, LIGO-M1000066https://dcc.ligo.org/cgi-bin/DocDB/RetrieveFile?docid=9967
Now
Community Engagement
![Page 12: Gravitational Wave Open Data Workshop ligoltech/gwodw2011/ 2011 October 27/28](https://reader036.vdocuments.site/reader036/viewer/2022062806/56814f35550346895dbcd02d/html5/thumbnails/12.jpg)
LIGO-G1101181 slide 12
Open Data Phase 1
1: LIGO will release detection data Optimizing instruments, few detections
All data meaningless without expert knowledge with published detections and important non-detections real-time alerts distributed privately via MOU Whole LSC writes 800-author papers
![Page 13: Gravitational Wave Open Data Workshop ligoltech/gwodw2011/ 2011 October 27/28](https://reader036.vdocuments.site/reader036/viewer/2022062806/56814f35550346895dbcd02d/html5/thumbnails/13.jpg)
LIGO-G1101181 slide 13
Open Data Phase 2
2A: Immediate triggers Interoperable with other event streams Follow-up of external triggers Observer decides using LIGO tools Trigger repository for cross-correlation study
Uniform among multi-mission data Can publish with or without LSC review
2B: Release all h[t] with catalog of past events 24 month after Release 2A, proprietary period, 6 month
releases
![Page 14: Gravitational Wave Open Data Workshop ligoltech/gwodw2011/ 2011 October 27/28](https://reader036.vdocuments.site/reader036/viewer/2022062806/56814f35550346895dbcd02d/html5/thumbnails/14.jpg)
LIGO-G1101181 slide 14
TransitionWhen Detections Become Ordinary
Transition to Phase 2 triggered by first of: Volume trigger
Based on rate estimates (LIGO-T1000414) 3x10^7 Mpc^3-yr space-time-volume searched for coalescing
double neutron-star systems at a specified false alarm level. Translates to 0.9 years of running at aLIGO design sensitivity.
Detection trigger Plentiful detections: LIGO decides it’s time
Calendar trigger Transition would occur a fixed amount of time after official
aLIGO acceptance of all 3 interferometers. Current proposal results in first bulk release ≥ 2018.
![Page 15: Gravitational Wave Open Data Workshop ligoltech/gwodw2011/ 2011 October 27/28](https://reader036.vdocuments.site/reader036/viewer/2022062806/56814f35550346895dbcd02d/html5/thumbnails/15.jpg)
LAAAP April 2011 LIGO-G1101181
Sketches for LIGO open data
![Page 16: Gravitational Wave Open Data Workshop ligoltech/gwodw2011/ 2011 October 27/28](https://reader036.vdocuments.site/reader036/viewer/2022062806/56814f35550346895dbcd02d/html5/thumbnails/16.jpg)
LIGO-G1101181 slide 16
Machine status
![Page 17: Gravitational Wave Open Data Workshop ligoltech/gwodw2011/ 2011 October 27/28](https://reader036.vdocuments.site/reader036/viewer/2022062806/56814f35550346895dbcd02d/html5/thumbnails/17.jpg)
LIGO-G1101181 slide 17
When were the machines operating?
![Page 18: Gravitational Wave Open Data Workshop ligoltech/gwodw2011/ 2011 October 27/28](https://reader036.vdocuments.site/reader036/viewer/2022062806/56814f35550346895dbcd02d/html5/thumbnails/18.jpg)
LIGO-G1101181 slide 18
Mock data for one eventhttp://www.ligo.org/science/GW100916/
![Page 19: Gravitational Wave Open Data Workshop ligoltech/gwodw2011/ 2011 October 27/28](https://reader036.vdocuments.site/reader036/viewer/2022062806/56814f35550346895dbcd02d/html5/thumbnails/19.jpg)
LIGO-G1101181 slide 19
• Likely galaxies shown in Green
• Dashed line 95% confidence
• Dog shape is Canis Major
• This plot was ready in 30 min
Mock data for one eventhttp://www.ligo.org/science/GW100916/
![Page 20: Gravitational Wave Open Data Workshop ligoltech/gwodw2011/ 2011 October 27/28](https://reader036.vdocuments.site/reader036/viewer/2022062806/56814f35550346895dbcd02d/html5/thumbnails/20.jpg)
LIGO-G1101181 slide 20
LSC Confidential. Please do not forward or copy.
Mock data for one eventhttp://www.ligo.org/science/GW100916/
![Page 21: Gravitational Wave Open Data Workshop ligoltech/gwodw2011/ 2011 October 27/28](https://reader036.vdocuments.site/reader036/viewer/2022062806/56814f35550346895dbcd02d/html5/thumbnails/21.jpg)
LIGO-G1101181 slide 21
AladinSkymap + WMAP + Optical + Simbad + Veron QSO catalog
![Page 22: Gravitational Wave Open Data Workshop ligoltech/gwodw2011/ 2011 October 27/28](https://reader036.vdocuments.site/reader036/viewer/2022062806/56814f35550346895dbcd02d/html5/thumbnails/22.jpg)
LIGO-G1101181 slide 22
Microsoft WorldWide TelescopeSkymap over Fermi sky and constellations
Canis Major
Vela SNR
![Page 23: Gravitational Wave Open Data Workshop ligoltech/gwodw2011/ 2011 October 27/28](https://reader036.vdocuments.site/reader036/viewer/2022062806/56814f35550346895dbcd02d/html5/thumbnails/23.jpg)
LIGO-G1101181 slide 23
Event timeline
click event for drilldown
![Page 24: Gravitational Wave Open Data Workshop ligoltech/gwodw2011/ 2011 October 27/28](https://reader036.vdocuments.site/reader036/viewer/2022062806/56814f35550346895dbcd02d/html5/thumbnails/24.jpg)
LIGO-G1101181
Outreach
![Page 25: Gravitational Wave Open Data Workshop ligoltech/gwodw2011/ 2011 October 27/28](https://reader036.vdocuments.site/reader036/viewer/2022062806/56814f35550346895dbcd02d/html5/thumbnails/25.jpg)
LIGO-G1101181 slide 25
Monitoring, Triggers, Follow-upsAtom and RSS feed technology
25
![Page 26: Gravitational Wave Open Data Workshop ligoltech/gwodw2011/ 2011 October 27/28](https://reader036.vdocuments.site/reader036/viewer/2022062806/56814f35550346895dbcd02d/html5/thumbnails/26.jpg)
LIGO-G1101181
Phone Apps
LSST-funded Transient Events App for iPhoneRuns from Skyalert reports of CRTS optical transients
![Page 27: Gravitational Wave Open Data Workshop ligoltech/gwodw2011/ 2011 October 27/28](https://reader036.vdocuments.site/reader036/viewer/2022062806/56814f35550346895dbcd02d/html5/thumbnails/27.jpg)
LIGO-G1101181 slide 27
Science Gateways:Ordering data and computing over the web
![Page 28: Gravitational Wave Open Data Workshop ligoltech/gwodw2011/ 2011 October 27/28](https://reader036.vdocuments.site/reader036/viewer/2022062806/56814f35550346895dbcd02d/html5/thumbnails/28.jpg)
LIGO-G1101181 slide 28
Citizen Science
Galaxy ZooLintott, Szalay, lots more
![Page 29: Gravitational Wave Open Data Workshop ligoltech/gwodw2011/ 2011 October 27/28](https://reader036.vdocuments.site/reader036/viewer/2022062806/56814f35550346895dbcd02d/html5/thumbnails/29.jpg)
LIGO-G1101181 slide 29
Open Data Survey
Please fill in the survey if you haven’t already
![Page 30: Gravitational Wave Open Data Workshop ligoltech/gwodw2011/ 2011 October 27/28](https://reader036.vdocuments.site/reader036/viewer/2022062806/56814f35550346895dbcd02d/html5/thumbnails/30.jpg)
LAAAP April 2011 LIGO-G1101181
Charge to the Breakouts
![Page 31: Gravitational Wave Open Data Workshop ligoltech/gwodw2011/ 2011 October 27/28](https://reader036.vdocuments.site/reader036/viewer/2022062806/56814f35550346895dbcd02d/html5/thumbnails/31.jpg)
LIGO-G1101181 slide 31
Breakout Group Constitution
Leader controls the floor
Scribe takes notes of group dicussion Make your scribe public?
Leader presents results in plenary Friday am
If you must float, keep quiet
![Page 32: Gravitational Wave Open Data Workshop ligoltech/gwodw2011/ 2011 October 27/28](https://reader036.vdocuments.site/reader036/viewer/2022062806/56814f35550346895dbcd02d/html5/thumbnails/32.jpg)
LIGO-G1101181 slide 32
Charge to each Breakout Group
Summary of what is there now More GW science results Technical objectives and difficulties How LIGO open/interoperable data can help Relevant present/future collaborations/groups
“Broader Community”
Relevant cites/URLs
![Page 33: Gravitational Wave Open Data Workshop ligoltech/gwodw2011/ 2011 October 27/28](https://reader036.vdocuments.site/reader036/viewer/2022062806/56814f35550346895dbcd02d/html5/thumbnails/33.jpg)
LIGO-G1101181 slide 33
A. Information Technology
For: rapid alerts, source catalog, full data For data discovery, interoperability,
accessibility, preservation
![Page 34: Gravitational Wave Open Data Workshop ligoltech/gwodw2011/ 2011 October 27/28](https://reader036.vdocuments.site/reader036/viewer/2022062806/56814f35550346895dbcd02d/html5/thumbnails/34.jpg)
LIGO-G1101181 slide 34
A. Information Technology
What infrastructure for real-time astronomy with GW triggers? What protocols to push selected triggers to the right places?
What are the right places? Socket, Jabber, email, VOEvent, Skyalert, GCN, ATEL, CBAT ….?
What data formats, software, metadata for GW waveform (strain data)?
How do we share uncertainties in calibration and features in data? Triggers, catalog, full waveform
How can LIGO provide mock data in advance so the broader community can prepare?
What software should LIGO provide with the data release? Find. Read. Metadata. Visualize. Analyze.
How can we achieve data curation and long-term data preservation?
![Page 35: Gravitational Wave Open Data Workshop ligoltech/gwodw2011/ 2011 October 27/28](https://reader036.vdocuments.site/reader036/viewer/2022062806/56814f35550346895dbcd02d/html5/thumbnails/35.jpg)
LIGO-G1101181 slide 35
Multi-messenger before, at, after the event Gamma, X, Optical, Radio, neutrino …
B. Smoking Gunfinding the flash or afterglow
![Page 36: Gravitational Wave Open Data Workshop ligoltech/gwodw2011/ 2011 October 27/28](https://reader036.vdocuments.site/reader036/viewer/2022062806/56814f35550346895dbcd02d/html5/thumbnails/36.jpg)
LIGO-G1101181 slide 36
B. Smoking Gunfinding the flash or afterglow
What do observers want from LIGO low-latency triggers besides timing, significance, and sky location?
Detailed data analysis and parameter estimation? Auxiliary channels & their meaning?
How do requirements differ between radio, optical, Xray follow-up observers? Coordinated follow up?
Should there be a coordinated network? If so, should LIGO organize it? How can LIGO encourage the broader community to share their results rapidly? How will GW data be used in concert with other transient surveys?
Figures of Merit for follow up? What criteria will observers use to select the triggers to observe? Multiple trigger quality categories?
Should LIGO provide mock data in advance? If so, what? What software should LIGO provide with the data release?
Where to point the telescope? Submitting follow-ups?
What protocols to push selected triggers to the right places? What are the right places? Socket, Jabber, email, VOEvent, Skyalert, GCN, ATEL, CBAT ….?
Broader community What role for medium/small telescopes? How can we utilize an army of citizen scientists? How can the first detections be used to excite and educate the public/K-12 community?
![Page 37: Gravitational Wave Open Data Workshop ligoltech/gwodw2011/ 2011 October 27/28](https://reader036.vdocuments.site/reader036/viewer/2022062806/56814f35550346895dbcd02d/html5/thumbnails/37.jpg)
LIGO-G1101181 slide 37
Access to all h(t) and data quality (whole enchilada)
The detected signals (source catalog) Compare to other signal catalogs: numerical relativity
The “might be” signals (trigger catalog)
C. Full Datascience from the strain channel
![Page 38: Gravitational Wave Open Data Workshop ligoltech/gwodw2011/ 2011 October 27/28](https://reader036.vdocuments.site/reader036/viewer/2022062806/56814f35550346895dbcd02d/html5/thumbnails/38.jpg)
LIGO-G1101181 slide 38
C. Full Datascience from the strain channel
What would a LIGO source catalog look like? Astronomy Numerical Relativity Detailed data analysis and parameter estimation? How much continuous calibrated strain h(t) around an event is wanted? Auxiliary channels and their meaning?
What if the first detection is from a burst, continuous-wave, or stochastic? What science from mining the catalog of triggers? Full data release
Who wants to do intensive searches of 2-year old data to avoid joining the LSC? How can LIGO communicate known glitches and data quality?
Should LIGO provide mock data in advance? Is http://www.ligo.org/science/GW100916/ enough?
What software should LIGO provide with the data release? Find. Read. Metadata. Visualize. Analyze.
Broader Community How can the first detections be used to excite and educate the public/K-12 community? How can we utilize an army of citizen scientists?
![Page 39: Gravitational Wave Open Data Workshop ligoltech/gwodw2011/ 2011 October 27/28](https://reader036.vdocuments.site/reader036/viewer/2022062806/56814f35550346895dbcd02d/html5/thumbnails/39.jpg)
LIGO-G1101181 slide 39
New ideas in physics astronomy etc New combinations of data, computing, citizens Good web interfaces for GW science Avoiding false “discoveries”
D. New searches, New sciencefresh ideas
![Page 40: Gravitational Wave Open Data Workshop ligoltech/gwodw2011/ 2011 October 27/28](https://reader036.vdocuments.site/reader036/viewer/2022062806/56814f35550346895dbcd02d/html5/thumbnails/40.jpg)
LIGO-G1101181 slide 40
D. New searches, New sciencefresh ideas
What new searches can be done? Post-Einstein gravity, dark matter, topological universe, high freq
from SMBH, NS glitches, ‘special’ SN, ???
Combined LISA, IceCube, Optical searches Web-based portal for casual searches
Just want to check something …
Broader Who wants to do full searches of 2-year old data to avoid joining
the LSC? How can we utilize an army of citizen scientists? How to avoid finding glitches and claiming GW?
![Page 41: Gravitational Wave Open Data Workshop ligoltech/gwodw2011/ 2011 October 27/28](https://reader036.vdocuments.site/reader036/viewer/2022062806/56814f35550346895dbcd02d/html5/thumbnails/41.jpg)
LIGO-G1101181 slide 41
Finally
Take an insert A,B,C,D Have lunch with your group