Download Development of Resource/Commander Agents

Spring 2005
Prepared By
Enoch Mak
Development of Resource/Commander Agents
For AgentTeamwork Grid Computing Middleware
Funded
By
Company
LOGO
What is AgentTeamwork ?
1. A grid-computing middleware system
2. Dispatch a collection of mobile agents
3. Coordinate user job in decentralized manner
4. No centralized server
5. Maintain high availability
6. Dynamic balancing of resource allocation
Mobile agents
Commander
Resource
Coordinating
other agents
Allocating
resource
Sentinel
Monitoring
job
execution
Bookkeeper
Maintaining
snapshots
AgentTeamwork System Overview
User A’s
Process
User A’s
Process
User B’s
Process
TCP
Communication
Snapshot
Methods
Results
GridTCP
User program wrapper
snapshot
GridTCP
Snapshot
Methods
User program wrapper
snapshot
GridTCP
User program wrapper
Results
snapshot
Sentinel
Agent
Sentinel
Agent
Commander
Agent
Snapshot
Methods
Sentinel
Agent
Resource
Agent
Resource
Agent
User
A
User
B
FTP
Server
Bookkeeper snapshots
Agent
snapshots
Bookkeeper
Agent
Commander
Agent
Resource Agent Tasks
1. Access to a central FTP server
2. Download new resource XML files
3. Maintains the XML files in local database
4. Query the local database with the user job requirements
5. Return a list of computing resource to Commander Agent
6. Perform periodic probing the remote computers
Implementation Time Schedule
Phase 0
1. Understanding and porting previous
assistant’s work onto medusa
cluster
2. Reinstall the local database
management system (eXist)
3. Prepare some dummy XML file
1. Im
da
2. Ab
3. Ab
XM
4. Te
fil
da
Resource Agent Workflow
Commander
Agent
FTP
server
Resource
agent
arguments
XML files
Resource
Request
Message
Resource
Agent
XPath
Query
Periodic-probing
remote
computing node
XCollection
(General
Database
Interface Class)
XUpdate
Query
Results
from the
remote
probing
List of
remote
computer’s
IP name
eXist
Database
Ftp Server
Remote FTP Server
XML file
XML file
XML file
XML file
XML file
eXist Database Server
Java
Java
Virtual
Virtual
Machine
Machine
Java
Java
Java
Virtual
Virtual
Virtual
Machine
Machine
Machine
First Application
First
Application
Java
Java
Virtual
Virtual
Machine
Machine
Stand-alone
Second
Application
eXist database
eXist database
XML:DB API
Resource
Agent
XML:DB API
XML:DB API
TCP Port
Distribution of remote computing node
No. of
nodes
required
Backup
multiplier
1
2
Agents that will be spawn
1.5
2
3
Sentinel
0
Bookkeeper
0
Sentinel
1
Bookkeeper
1
Remote Probing Workflow
Resource
Agent
Child
Resource
Agent
Remote
Probing
Results
Main Thread
Child
Resource
Agent
Receive Message
Remote
Thread
Probing
Results
Child
Resource
Agent
Remote
Probing
Results
Bandwidth Test
Server Process
Bandwidth Test
Scheduler Thread
Remote
Probing
Results
Remote Probing Bandwidth Test
Resource
Agent
Child
Resource
Agent
Remote
Test
Request
Probing
Message
Results
Main Thread
Child
Resource
Agent
Receive Message
Thread
Child
Resource
Agent
Remote
Test
Probing
Request
Results
Message
Bandwidth Test
Server Process
Bandwidth Test
Scheduler Thread
Ready
Message
Remote
Test
Probing
Request
Results
Message
Conclusion
Result
1. The first version of resource agent was
developed for the AgentTeamwork project
2. Commander agent was enhanced in order to
cooperate with Resource agent
3. AgentTeamwork is now able to perform a
complete sequence of job execution
Questions?