Download pptx

Survey
yes no Was this document useful for you?
   Thank you for your participation!

* Your assessment is very important for improving the work of artificial intelligence, which forms the content of this project

Document related concepts
no text concepts found
Transcript
Millennium Data Dissemination
possible extensions
how ambitious can/should we be?
2012-11-26
MPA institute seminar
1
FOF groups and Subhalos
Raw data:
Particles
Mock images
Density fields
Subhalo merger trees
Synthetic galaxies (SAM)
Mock catalogues
2012-12-17
Millennium Workshop
2
MRObs
Simulation
Particles
Gadget
FOF Groups
Scaling
(Sub-)Halos
Halo Merger
Trees
FOF Group
Finder
Tree
Builder
SUBFIND
SAM
SSP
SExtractor
SExtractor
Catalogues
2012-12-17
SkyMaker’
MoMaF’
Synthetic
Images
Light-cone
Galaxies
PSF, Noise,
Background
IGM
Millennium Workshop
SAM
Galaxies
3
Raw data
• Serve particles from Millennium simulations
– 10 billion/snapshot, ~25TB
• from database?
– with spatial queries
– links to halos/FOF groups
• through JobRunner services
– cutout
– gridding + FFTs etc
2012-11-26
MPA institute seminar
4
Other simulations?
• Hydro Example:
– http://gavo.mpa-garching.mpg.de/HydroClusters
– online visualisation:
http://galformod.mpa-garching.mpg.de/phoxybrowser
• Others
– Millennium+gas?
– Eagle
–…
• How?
– In DB ok for objects
– Visualisation support for “fluffy things”
2012-11-26
MPA institute seminar
5
6
MRObs
Simulation
Particles
Gadget
FOF Groups
Scaling
(Sub-)Halos
Halo Merger
Trees
FOF Group
Finder
Tree
Builder
SUBFIND
SAM
SSP
SExtractor
SExtractor
Catalogues
2012-12-17
SkyMaker’
MoMaF’
Synthetic
Images
Light-cone
Galaxies
PSF, Noise,
Background
IGM
Millennium Workshop
SAM
Galaxies
7
Group catalogs
• Have
–
–
–
–
FOF
SUBFIND subhalos
Mhalo merger trees
Dhalo merger trees
• More properties
– shapes, density profiles (ala AIP, or ala MR-XXL): good for lensing
– others?
• More?
– BDM, NEXUS, ORIGAMI, …
– All of Knebe etal
• LSS objects?
– Voids, filaments, walls in the DB
– “more precise” environmental queries possible
– per grid cell or as object (“stacking voids”)
2012-11-26
MPA institute seminar
8
MRObs
Simulation
Particles
Gadget
FOF Groups
Scaling
(Sub-)Halos
Halo Merger
Trees
FOF Group
Finder
Tree
Builder
SUBFIND
SAM
SSP
SExtractor
SExtractor
Catalogues
2012-12-17
SkyMaker’
MoMaF’
Synthetic
Images
Light-cone
Galaxies
PSF, Noise,
Background
IGM
Millennium Workshop
SAM
Galaxies
9
SAM catalogues
• More models
– Durham, MPA
• Complete MR-XXL?
– ~200x Millennium, 80TB
• Extensions
2012-11-26
MPA institute seminar
10
SFH-s
• Allows SEDs from post-processing
• how to store?
– rows vs arrays (in SQLServer)
– functions (easy in SQLServer):
• create spectra
– “exact” observer frame bands
• PCA amplitudes in the database
– find nearby galaxies for given observed spectrum
2012-11-26
MPA institute seminar
11
SAM online
• GALFORM online !!!
– http://galformod.mpa-garching.mpg.de/dev/jobrunner/
– on millimil
• Do we want others?
– Galacticus?
• Need constraints, validated models.
– How afraid should we be of “bad science”?
• SAM online on Millennium?
– input to MRObs pipeline
2012-11-26
MPA institute seminar
12
MRObs
Simulation
Particles
Gadget
FOF Groups
Scaling
(Sub-)Halos
Halo Merger
Trees
FOF Group
Finder
Tree
Builder
SUBFIND
SAM
SSP
SkyMaker’
SExtractor
SExtractor
Catalogues
2012-12-17
MoMaF’
Synthetic
Images
Light-cone
Galaxies
PSF, Noise,
Background
IGM
Millennium Workshop
SAM
Galaxies
13
Light cones
• In Database: not just from MPA!
– common model
– linked to SAMs
• More
– deep: new code for Millennium-II
– all sky: MR-XXL
– with scaling!
• What properties needed?
– who wants them?
– what for (lensing?)?
• Light cone building online
– Will soon make our MoMaF available on JobRunner
– new code in preparation (for MR-II etc)
2012-11-26
MPA institute seminar
14
MRObs
Simulation
Particles
FOF Groups
(Sub-)Halos
Halo Merger
Trees
FOF Group
Finder
Gadget
Scaling
Tree
Builder
SUBFIND
SAM
SSP
SExtractor
SExtractor
Catalogues
Light-cone
Galaxies
Synthetic
Images
PSF, Noise,
Background
2012-12-17
MoMaF’
SkyMaker’
SAM
Galaxies
IGM
Millennium Workshop
15
MRObs
• Store of images will keep growing
– Overzier!
• Create images on demand
– telescope models custom?
• Post processing as well?
– Sextractor
– other?
• Improvement galaxy images
– realistic structure (weak lensing systematics, strong lensing
structure)
– from simulations ?
– form observations?
2012-11-26
MPA institute seminar
16
MRObs
Simulation
Particles
FOF Groups
(Sub-)Halos
Halo Merger
Trees
FOF Group
Finder
Gadget
Scaling
Tree
Builder
SUBFIND
SAM
SSP
Lensing
SExtractor
MoMaF’
SkyMaker’
SExtractor
Catalogues
Light-cone
Galaxies
Synthetic
Images
PSF, Noise,
Background
2012-12-17
SAM
Galaxies
IGM
Millennium Workshop
17
Lensing
• Under construction
– with Ben Metcalf
• Online?
– Why not, JobRunner will handle it.
• How much?
– what is required for weak lensing?
2012-11-26
MPA institute seminar
18
Even more
• L-Galaxies online++
– updating physics modules?
– MCMC mode?
• Dark matter light cones?
– for lensing
– what do we need? particles, fields?
• Interface
– dashboard (M.Egger)
– improve SQL interface (Roys talk)
2012-11-26
MPA institute seminar
19
Galformod infrastructure
• Currently
– 12+1 12-core nodes
– 180 TB raw storage
– 20TB DB storage
• What do others have?
– AIP ~500TB
– JHU ~5PB (?)
• What do we want?
2012-11-26
MPA institute seminar
20
What do we want need?
• Depends on answers to all previous questions
• What can we afford?
– Where can we get the money?
• Where do we put “it”?
– RZG?
• Pool our resources together?
– beyond mirror
– distributed over Virgo nodes?
• Larger scale collaborations (EUDat)?
– see Hermann’s talk
2012-11-26
MPA institute seminar
21
Related documents