eötvös university budapest in the network. seniors: istván csabai (node coordinator):...

13
Eötvös University Budapest in the Network

Upload: ashton-gray

Post on 31-Mar-2015

215 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Eötvös University Budapest in the Network.  Seniors: István Csabai (node coordinator): »Photometric redshift estimation, virtual observatories, science

Eötvös UniversityBudapest

in the

Network

Page 2: Eötvös University Budapest in the Network.  Seniors: István Csabai (node coordinator): »Photometric redshift estimation, virtual observatories, science

Seniors:• István Csabai (node coordinator):

» Photometric redshift estimation, virtual observatories, science database technology, SDSS

• Zsolt Frei: » Galaxy morphology, galaxy mergers, gravitational waves

Students:• Norbert Purger, Bence Kocsis, Merse Gáspár,• Márton Trencséni, László Dobos, Dávid Koronczay

» Working on SDSS related topics

Network student: • Oliver Vince (Belgrade)

The Team

Page 3: Eötvös University Budapest in the Network.  Seniors: István Csabai (node coordinator): »Photometric redshift estimation, virtual observatories, science

Focus themes

Development of datamining and visualization techniques – SDSS ‘color space’

Improving photometric redshift estimation Estimation of physical parameters of

galaxies from photometry Bulge/disk separation of large SDSS

galaxies Virtual Observatory, Spectrum Services

Page 4: Eötvös University Budapest in the Network.  Seniors: István Csabai (node coordinator): »Photometric redshift estimation, virtual observatories, science

Collaboration with other nodes

JHU:• Alex Szalay, Tamas Budavari, Ani Thakar … • Virtual observatories, SDSS database, photometric redshift

estimation• Regular visits for seniors ad students

Paris: • Stephane Charlot• Spectral synthesis models for photo-z, spectral models in VO• Oliver Vince visited Paris, and will visit next year • New joint topic involving several nodes: „Optical attenuation

law of nearby galaxies”

Page 5: Eötvös University Budapest in the Network.  Seniors: István Csabai (node coordinator): »Photometric redshift estimation, virtual observatories, science

u g r i z

300 million points in 5+ dimensions

300 million points in 5+ dimensions

Datamining: The Color Space

Page 6: Eötvös University Budapest in the Network.  Seniors: István Csabai (node coordinator): »Photometric redshift estimation, virtual observatories, science

Datamining: Spatial Indexing

Page 7: Eötvös University Budapest in the Network.  Seniors: István Csabai (node coordinator): »Photometric redshift estimation, virtual observatories, science

Datamining: Speed Up Queries

0

20000

40000

60000

80000

0 0.05 0.1 0.15 0.2 0.25 0.3 0.35

ratio of rows returned

du

rati

on

(m

sec)

kd-tree

SQL0

20000

40000

60000

80000

0 0.05 0.1 0.15 0.2 0.25 0.3 0.35

ratio of rows returned

du

rati

on

(m

sec)

kd-tree

SQL

Page 8: Eötvös University Budapest in the Network.  Seniors: István Csabai (node coordinator): »Photometric redshift estimation, virtual observatories, science

Datamining: Visualization

Adaptively fetch data from database

Page 9: Eötvös University Budapest in the Network.  Seniors: István Csabai (node coordinator): »Photometric redshift estimation, virtual observatories, science

Datamining:Integration with DatabaseTRADITIONAL APPROACHFlat files, Fortran, C code+ Complex manipulation of data- Sequential slow access

TRADITIONAL APPROACHFlat files, Fortran, C code+ Complex manipulation of data- Sequential slow access

SQL DATABASESOracle, MS SQL Server, …+ Organize, efficiently access data- Hard to implement complex algorithms- Multidimensional indexing (OLAP) is limited to categorical data

SQL DATABASESOracle, MS SQL Server, …+ Organize, efficiently access data- Hard to implement complex algorithms- Multidimensional indexing (OLAP) is limited to categorical data

MULTIDIMENSIONAL INDEXINGB-tree, R-tree, K-d tree, BSP-tree …+ Many for low D, some for high D+ Fast, tuned for various problems- Implemented mostly as memory algorithms, maybe suboptimal in databases

MULTIDIMENSIONAL INDEXINGB-tree, R-tree, K-d tree, BSP-tree …+ Many for low D, some for high D+ Fast, tuned for various problems- Implemented mostly as memory algorithms, maybe suboptimal in databases

VISUALIZATIONTools using OpenGL, DirectX+ Fast- Using files, some tools access database, but not interactive

VISUALIZATIONTools using OpenGL, DirectX+ Fast- Using files, some tools access database, but not interactive

INTEGRATE •Implement in SQL Server•use for astronomical data-mining•and for fast interactive visualization

INTEGRATE •Implement in SQL Server•use for astronomical data-mining•and for fast interactive visualization

• Joint Eötvös & JHU publication at the Conference on Innovative Data Systems Research

Page 10: Eötvös University Budapest in the Network.  Seniors: István Csabai (node coordinator): »Photometric redshift estimation, virtual observatories, science

Photometric redshift estimation

•Find k nearest neighbors•Use polinomial regression•Estimate redshift

1M galaxies with known photometry and redshift

100M galaxies with known ugriz photometry, but no redshift

ugriz

redshift

Page 11: Eötvös University Budapest in the Network.  Seniors: István Csabai (node coordinator): »Photometric redshift estimation, virtual observatories, science

Joint work between JHU & Eötvös Photometric redshift calculated for 300M

SDSS objects Included in SDSS DR5 Catalog and Data

Release paper Application: targeting MgII absorbers

collaboration between MPA & Eötvös network postdoc Vivienne Wild involved

Photometric redshift estimation

Page 12: Eötvös University Budapest in the Network.  Seniors: István Csabai (node coordinator): »Photometric redshift estimation, virtual observatories, science

Virtual Observatory: Spectrum & Filter Services

Developed by Eötvös student Laszlo Dobos & JHU researcher Tamas Budavari

Several joint publications Collaboration with IAP

researcher Stephane Charlot to include spectral synthesis models

Page 13: Eötvös University Budapest in the Network.  Seniors: István Csabai (node coordinator): »Photometric redshift estimation, virtual observatories, science

Network events

MAGPOP Virtual Observatory Workshop - Budapest, Hungary, 2005. April 25-26

MAGPOP Summer School - Budapest, Hungary, 2006. August 23-25

Hosting the webpage