Survey
* Your assessment is very important for improving the work of artificial intelligence, which forms the content of this project
* Your assessment is very important for improving the work of artificial intelligence, which forms the content of this project
Millennium Data Dissemination possible extensions how ambitious can/should we be? 2012-11-26 MPA institute seminar 1 FOF groups and Subhalos Raw data: Particles Mock images Density fields Subhalo merger trees Synthetic galaxies (SAM) Mock catalogues 2012-12-17 Millennium Workshop 2 MRObs Simulation Particles Gadget FOF Groups Scaling (Sub-)Halos Halo Merger Trees FOF Group Finder Tree Builder SUBFIND SAM SSP SExtractor SExtractor Catalogues 2012-12-17 SkyMaker’ MoMaF’ Synthetic Images Light-cone Galaxies PSF, Noise, Background IGM Millennium Workshop SAM Galaxies 3 Raw data • Serve particles from Millennium simulations – 10 billion/snapshot, ~25TB • from database? – with spatial queries – links to halos/FOF groups • through JobRunner services – cutout – gridding + FFTs etc 2012-11-26 MPA institute seminar 4 Other simulations? • Hydro Example: – http://gavo.mpa-garching.mpg.de/HydroClusters – online visualisation: http://galformod.mpa-garching.mpg.de/phoxybrowser • Others – Millennium+gas? – Eagle –… • How? – In DB ok for objects – Visualisation support for “fluffy things” 2012-11-26 MPA institute seminar 5 6 MRObs Simulation Particles Gadget FOF Groups Scaling (Sub-)Halos Halo Merger Trees FOF Group Finder Tree Builder SUBFIND SAM SSP SExtractor SExtractor Catalogues 2012-12-17 SkyMaker’ MoMaF’ Synthetic Images Light-cone Galaxies PSF, Noise, Background IGM Millennium Workshop SAM Galaxies 7 Group catalogs • Have – – – – FOF SUBFIND subhalos Mhalo merger trees Dhalo merger trees • More properties – shapes, density profiles (ala AIP, or ala MR-XXL): good for lensing – others? • More? – BDM, NEXUS, ORIGAMI, … – All of Knebe etal • LSS objects? – Voids, filaments, walls in the DB – “more precise” environmental queries possible – per grid cell or as object (“stacking voids”) 2012-11-26 MPA institute seminar 8 MRObs Simulation Particles Gadget FOF Groups Scaling (Sub-)Halos Halo Merger Trees FOF Group Finder Tree Builder SUBFIND SAM SSP SExtractor SExtractor Catalogues 2012-12-17 SkyMaker’ MoMaF’ Synthetic Images Light-cone Galaxies PSF, Noise, Background IGM Millennium Workshop SAM Galaxies 9 SAM catalogues • More models – Durham, MPA • Complete MR-XXL? – ~200x Millennium, 80TB • Extensions 2012-11-26 MPA institute seminar 10 SFH-s • Allows SEDs from post-processing • how to store? – rows vs arrays (in SQLServer) – functions (easy in SQLServer): • create spectra – “exact” observer frame bands • PCA amplitudes in the database – find nearby galaxies for given observed spectrum 2012-11-26 MPA institute seminar 11 SAM online • GALFORM online !!! – http://galformod.mpa-garching.mpg.de/dev/jobrunner/ – on millimil • Do we want others? – Galacticus? • Need constraints, validated models. – How afraid should we be of “bad science”? • SAM online on Millennium? – input to MRObs pipeline 2012-11-26 MPA institute seminar 12 MRObs Simulation Particles Gadget FOF Groups Scaling (Sub-)Halos Halo Merger Trees FOF Group Finder Tree Builder SUBFIND SAM SSP SkyMaker’ SExtractor SExtractor Catalogues 2012-12-17 MoMaF’ Synthetic Images Light-cone Galaxies PSF, Noise, Background IGM Millennium Workshop SAM Galaxies 13 Light cones • In Database: not just from MPA! – common model – linked to SAMs • More – deep: new code for Millennium-II – all sky: MR-XXL – with scaling! • What properties needed? – who wants them? – what for (lensing?)? • Light cone building online – Will soon make our MoMaF available on JobRunner – new code in preparation (for MR-II etc) 2012-11-26 MPA institute seminar 14 MRObs Simulation Particles FOF Groups (Sub-)Halos Halo Merger Trees FOF Group Finder Gadget Scaling Tree Builder SUBFIND SAM SSP SExtractor SExtractor Catalogues Light-cone Galaxies Synthetic Images PSF, Noise, Background 2012-12-17 MoMaF’ SkyMaker’ SAM Galaxies IGM Millennium Workshop 15 MRObs • Store of images will keep growing – Overzier! • Create images on demand – telescope models custom? • Post processing as well? – Sextractor – other? • Improvement galaxy images – realistic structure (weak lensing systematics, strong lensing structure) – from simulations ? – form observations? 2012-11-26 MPA institute seminar 16 MRObs Simulation Particles FOF Groups (Sub-)Halos Halo Merger Trees FOF Group Finder Gadget Scaling Tree Builder SUBFIND SAM SSP Lensing SExtractor MoMaF’ SkyMaker’ SExtractor Catalogues Light-cone Galaxies Synthetic Images PSF, Noise, Background 2012-12-17 SAM Galaxies IGM Millennium Workshop 17 Lensing • Under construction – with Ben Metcalf • Online? – Why not, JobRunner will handle it. • How much? – what is required for weak lensing? 2012-11-26 MPA institute seminar 18 Even more • L-Galaxies online++ – updating physics modules? – MCMC mode? • Dark matter light cones? – for lensing – what do we need? particles, fields? • Interface – dashboard (M.Egger) – improve SQL interface (Roys talk) 2012-11-26 MPA institute seminar 19 Galformod infrastructure • Currently – 12+1 12-core nodes – 180 TB raw storage – 20TB DB storage • What do others have? – AIP ~500TB – JHU ~5PB (?) • What do we want? 2012-11-26 MPA institute seminar 20 What do we want need? • Depends on answers to all previous questions • What can we afford? – Where can we get the money? • Where do we put “it”? – RZG? • Pool our resources together? – beyond mirror – distributed over Virgo nodes? • Larger scale collaborations (EUDat)? – see Hermann’s talk 2012-11-26 MPA institute seminar 21