Download Information fusion und integrity - AstroGrid-D

Lehrstuhl Informatik III: Datenbanksysteme
Informationsfusion und -Integrität:
Grid-Erweiterungen zum Datenmanagement
Project Leader:
Prof. Dr.-Ing. Erhard Rahm
Institut für Informatik, Universität Leipzig
Project Partners
 Infrastructure:
TU Dresden
Universität Leipzig
TU München
 Application:
AstroGrid-D
MediGrid
TextGrid
Forschungszentrum Rossendorf
AstroGrid-D Meeting Heidelberg, 2006-07-25
1
Lehrstuhl Informatik III: Datenbanksysteme
Main Goals:
Services for
1. Data Fusion
o
o
o
semantical correct Combination of Data Sources
Support of Analysis over distributed Data
Ontology-based Mapping of Data Sources
2. Data Integrity
o
o
Data Lineage
based on Grid Security Infrastructure (GSI)
3. Dynamic Data Distribution (see following slides)
o
o
Optimization of data intensive Queries
effective and efficient Usage of decentral Main Memory
Ressources
Augmenting Data Management in DGI
AstroGrid-D Meeting Heidelberg, 2006-07-25
2
Lehrstuhl Informatik III: Datenbanksysteme
Archive
g
Feedin
in
Feed
data
Archive
HiSbase: Main Memory P2P Database System
g data
y
quer
que
AstroGrid-D Meeting Heidelberg, 2006-07-25
ry
3
Lehrstuhl Informatik III: Datenbanksysteme
HiSbase – The Challenge





Histogram-based peer-to-peer main memory
database for locality-aware data processing
Example: distributed archives (astrophysics)
Correlation of different catalogs
Skewed data distribution
Region-based queries


Right ascension (longitude)
Declination (latitude)
AstroGrid-D Meeting Heidelberg, 2006-07-25
4
Lehrstuhl Informatik III: Datenbanksysteme
AstroGrid-D Meeting Heidelberg, 2006-07-25
5
Lehrstuhl Informatik III: Datenbanksysteme
“Distribute by Region – not by Archive!”

Highly distributed information management


High performance query processing


Distributed Hashtable peer-to-peer architecture
Main memory database
Semantic clustering, spatial locality

Equi-depth histograms
AstroGrid-D Meeting Heidelberg, 2006-07-25
6
Lehrstuhl Informatik III: Datenbanksysteme
AstroGrid-D Meeting Heidelberg, 2006-07-25
7