Download Distributed Systems and Algorithms (DSA From A to Z)

Distributed Systems and Algorithms
(DSA from A to Z)
Carey Williamson
iCORE Professor and NSERC IRC
Department of Computer Science
University of Calgary
Computer Science (CPSC)
Distributed
Systems &
Algorithms
Evolutionary Quantum
Visual &
Software
Computing & Interactive
Engineering Cryptography Computing
You are
here!
November 2005
Copyright © 2005 Department of Computer Science
2
Computer Science (CPSC)
Distributed
Systems &
Algorithms
Evolutionary Quantum
Visual &
Software
Computing & Interactive
Engineering Cryptography Computing
Databases Distributed
- Alhajj
Algorithms/
- Barbosa
Reliability
- Barker
- Hammad
- Higham
Multi-agent/
Biological
Systems
Networks
- Denzinger
- Jacob
November 2005
Copyright © 2005 Department of Computer Science
- Li
- Mahanti
- Williamson
Simulation/
Grid/HPC
- Simmonds
- Unger
3
ADSA: Yesterday to Today
 Bio-Informatics and Bio-Computing
 Cache Invalidation Schemes for Mobile Databases
 Keyword Search in Structured Databases
 Knowledge Discovery and Data Mining
 Multi-agent Systems
 Partitioning
 Replication in Grid Environment
 Web Databases
 XML and Data Reengineering
November 2005
Copyright © 2005 Department of Computer Science
4
ADSA: Today to Tomorrow
 Bio-Informatics and Bio-Computing
 Data Mining
 Distributed Systems
 Database Security
 Autonomic Systems
DBA
 Systems Integration
 XML Data Systems/Repositories
 Sensor Systems
 Stream Mining
November 2005
Copyright © 2005 Department of Computer Science
5
Computer Science (CPSC)
Distributed
Systems &
Algorithms
Evolutionary Quantum
Visual &
Software
Computing & Interactive
Engineering Cryptography Computing
Databases Distributed
- Alhajj
Algorithms/
- Barbosa
Reliability
- Barker
- Hammad
- Higham
Multi-agent/
Biological
Systems
Networks
- Denzinger
- Jacob
November 2005
Copyright © 2005 Department of Computer Science
- Li
- Mahanti
- Williamson
Simulation/
Grid/HPC
- Simmonds
- Unger
6
Distributed Algorithms (Higham)
• Did you know that...
–
–
–
–
many commercial multi-processors don’t work correctly?
Herlihy’s hierarchy collapses for hard real-time apps?
self-stabilizing algorithms matter in real-life?
sensor networks are the next big thing?
• Lisa Higham studies the theoretical side of
distributed computation, including fault-tolerance,
parallel algorithms, memory consistency models,
wait-free computation, and sensor networks
November 2005
Copyright © 2005 Department of Computer Science
7
Computer Science (CPSC)
Distributed
Systems &
Algorithms
Evolutionary Quantum
Visual &
Software
Computing & Interactive
Engineering Cryptography Computing
Databases Distributed
- Alhajj
Algorithms/
- Barbosa
Reliability
- Barker
- Hammad
- Higham
Multi-agent/
Biological
Systems
Networks
- Denzinger
- Jacob
November 2005
Copyright © 2005 Department of Computer Science
- Li
- Mahanti
- Williamson
Simulation/
Grid/HPC
- Simmonds
- Unger
8
Multi-Agent Systems (Denzinger)
• Application of advanced artificial intelligence (AI)
techniques to problems requiring learning,
cooperation, coordination, and negotiation
between and among multiple (software) agents
• Examples:
– Internet search
– software agent negotiation
– finding good/bad strategies in gaming applications
• See poster for details!
November 2005
Copyright © 2005 Department of Computer Science
9
Biological Computation (Jacob)
• One ant: dumb
• Lots of ants: smart
• Swarm intelligence!!
• The world of biology offers fascinating insights
into computational models, showing the power of
evolutionary algorithms and swarm intelligence
• See poster for details!
November 2005
Copyright © 2005 Department of Computer Science
10
Computer Science (CPSC)
Distributed
Systems &
Algorithms
Evolutionary Quantum
Visual &
Software
Computing & Interactive
Engineering Cryptography Computing
Databases Distributed
- Alhajj
Algorithms/
- Barbosa
Reliability
- Barker
- Hammad
- Higham
Multi-agent/
Biological
Systems
Networks
- Denzinger
- Jacob
November 2005
Copyright © 2005 Department of Computer Science
- Li
- Mahanti
- Williamson
Simulation/
Grid/HPC
- Simmonds
- Unger
11
Networks and Systems
Multiple Choice Quiz
• Which of the following statements is NOT true?
(a) Over 60% of U of C Internet traffic is P2P
(b) Microsoft IE browser violates TCP FIN rules
(c) In WLANs, “one bad apple spoils the batch”
(d) Web traffic workloads exhibit heavy tails
(e) Internet media streaming quality is often poor
(f) Network coding achieves optimal throughput
(g) There is $100 taped underneath your chair
Answer: (g)
November 2005
Copyright © 2005 Department of Computer Science
12
Network Coding Theory (Li)
BitTorrent: The Next Generation?
November 2005
Copyright © 2005 Department of Computer Science
13
Content Distribution Systems (Mahanti)
•
•
•
•
•
•
Multimedia streaming on wired networks
Multimedia streaming on wireless networks
Quality adaptation for streaming media
Scalable multicast streaming protocols
Internet traffic classification and modeling
Peer-to-peer (P2P) systems
• See poster for details!
November 2005
Copyright © 2005 Department of Computer Science
14
Network Performance (Williamson)
• “Make the Internet go faster”
• Research area?
– Wireless/cellular networks, Internet protocols,
computer systems performance evaluation
• Approach?
– Experimental, simulation, analytical
• Key challenges?
– Citius, Altius, Fortius!
– Performance, scalability, robustness
November 2005
Copyright © 2005 Department of Computer Science
15
Computer Science (CPSC)
Distributed
Systems &
Algorithms
Evolutionary Quantum
Visual &
Software
Computing & Interactive
Engineering Cryptography Computing
Databases Distributed
- Alhajj
Algorithms/
- Barbosa
Reliability
- Barker
- Hammad
- Higham
Multi-agent/
Biological
Systems
Networks
- Denzinger
- Jacob
November 2005
Copyright © 2005 Department of Computer Science
- Li
- Mahanti
- Williamson
Simulation/
Grid/HPC
- Simmonds
- Unger
16
Grid Computing (Simmonds, Unger)
• What?
– High performance computing for big science apps
– Service based architecture with user-level
authentication and credential delegation
– Enables creation of federated computing
environments spanning administrative domains
• How?
– Standard interfaces to HPC systems
– High performance data transfer tools (> 900 Mbps!!)
– Additional tools build on top of these services
• Where?
– U of C (and U of A, U of L, UBC, SFU, …)
November 2005
Copyright © 2005 Department of Computer Science
17
WestGrid
November 2005
Copyright © 2005 Department of Computer Science
18
Grid Research Activities
• Grid Monitoring
• Data Management
• Data Analysis
• http://www.westgrid.ca
• http://grid.ucalgary.ca
November 2005
Copyright © 2005 Department of Computer Science
19
Computer Science (CPSC)
Distributed
Systems &
Algorithms
Evolutionary Quantum
Visual &
Software
Computing & Interactive
Engineering Cryptography Computing
Databases Distributed
- Alhajj
Algorithms/
- Barbosa
Reliability
- Barker
- Hammad
- Higham
Multi-agent/
Biological
Systems
Networks
- Denzinger
- Jacob
November 2005
Copyright © 2005 Department of Computer Science
- Li
- Mahanti
- Williamson
Simulation/
Grid/HPC
- Simmonds
- Unger
20
DSA Posters on Display Today
• Multi-Objective Optimization to Produce the
Most Natural Clustering (Alhajj/Barker)
• VIREX: A Visual Tool for Querying Relational
DBs to Produce XML Documents (Alhajj/Barker)
• Managing Complex Data (Barbosa)
• System Testing by Learning Behavior (Denzinger)
• Evolutionary and Swarm Design (Jacob)
• Non-Traditional Data Management (Hammad)
• Content Distribution Systems (Mahanti)
November 2005
Copyright © 2005 Department of Computer Science
21
Summary: DSA Members
•
•
•
•
•
•
•
•
•
•
•
•
Reda Alhajj (Databases)
Denilson Barbosa (Databases)
Ken Barker (Databases)
Jörg Denzinger (Multi-Agent Systems)
Moustafa Hammad (Databases)
Lisa Higham (Distributed Algorithms)
Christian Jacob (Biological Computation)
Zongpeng Li (Network Coding Theory)
Anirban Mahanti (Content Distribution Systems)
Rob Simmonds (Grid Computing)
Brian Unger (Grid Computing)
Carey Williamson (Network Performance)
Questions?
November 2005
Copyright © 2005 Department of Computer Science
22