Download Field Server Agent Field Server Agent Box MetBroker

National Agricultural Research Center
National Agriculture and Food Research Organization
Updates:
Field Server Agent
Field Server Agent Box
MetBroker
Takuji Kiura
Tokihiro Fukatsu
Kei Tanaka
Masayuki Hirafuji
National Agricultural Research Center
National Agriculture & Food Research Organization
(JAPAN)
Data Mining and GRID Research Team
Takuji Kiura
National Agriculture and Food Research Organization
National Agricultural Research Center
State Transition of Profiles
steady state
Profile A
A
Next: A or B
Profile B
Next: A,B,C1,C2
energy
saving
Ｂ
Profile C1
Profile C2
Next: xx…
Next: yy…
warning
Ｃ1
choose best Profiles according
to the situation
Data Mining and GRID Research Team
Takuji Kiura
National Agriculture and Food Research Organization
National Agricultural Research Center
Web Interface for Managing Agent System
・ Web-based Interface assists Profile treatment.
Agent System
・ We can monitor and control agent status.
・ Target data can be retrieved directly.
Web interface
Profile Creation
Data Mining and GRID Research Team
→ Agent controls other Agents
Thread Management
Data Handling
Takuji Kiura
National Agriculture and Food Research Organization
National Agricultural Research Center
Integrated Application of Agent System
Image Data
Image analysis
difference
monitoring Data
animation of Image data
detected insects by Web
Corresponding
monitoring data
Collaborate with different nodes easily in Agent System
Data Mining and GRID Research Team
Takuji Kiura
National Agriculture and Food Research Organization
National Agricultural Research Center
Trial Management of Agent System
ZZZ..
?
×
!
×
Data Mining and GRID Research Team
Takuji Kiura
National Agriculture and Food Research Organization
National Agricultural Research Center
Field Server Agent Box (Type A)
Hightech System EES-3611
CUP: C3 (1GHz)
RAM: 512MB (up to 1GB)
HDD: 2.5inch (80GB)
LAN: 10/100
VGA, PS/2, USB2x4, etc.
OS: Vine Linux 3.2
JRE: Sun or IBM
68×223×153(mm)
Over 12 months at Florida
(< US$ 600-)
Data Mining and GRID Research Team
Takuji Kiura
National Agriculture and Food Research Organization
National Agricultural Research Center
Field Server Agent Box (Type B)
Kurouto Shikou Kuro-Box/HG
CPU: PowerPC (266MHz)
RAM: 128MB (Fixed)
HDD: 3.5inch (320GB)
LAN: 10/100/1000
USB2 x 2
60x173.5x185(mm)
OS: Vine Linux 3.1
JRE: IBM
Under Testing at NARC
(< US$ 250)
Data Mining and GRID Research Team
Takuji Kiura
National Agricultural Research Center
National Agriculture and Food Research Organization
Hierarchical Agent System with FSAB
Firewall
Firewall
Private network of Field servers
Global IP
Field Server Meta Agent
（Web crawler & controller）
Cellar
FSAB
PPTP
Private IP
Cable
FSAB
Global IP
PPTP/OpenVPN
Web Server
ADSL
PC-Cluster
Data Mining and GRID Research Team
FSAB
The Internet
Takuji Kiura
National Agricultural Research Center
National Agriculture and Food Research Organization
Hierarchical Agent System with FSAB
Firewall
Firewall
Private network of Field servers
Global IP
Field Server Meta Agent
（Web crawler & controller）
!!
!!
Cellar
FSAB
PPTP
Private IP
Cable
FSAB
Global IP
Web Server
ADSL
PC-Cluster
Data Mining and GRID Research Team
FSAB
The Internet
Takuji Kiura
National Agricultural Research Center
National Agriculture and Food Research Organization
Hierarchical Agent System with FSAB
Firewall
Firewall
Private network of Field servers
Global IP
Field Server Meta Agent
（Web crawler & controller）
Cellar
FSAB
Private IP
!!
Cable
FSAB
Global IP
Web Server
ADSL
PC-Cluster
Data Mining and GRID Research Team
FSAB
The Internet
Takuji Kiura
National Agriculture and Food Research Organization
National Agricultural Research Center
Field Server Network scalable?
How many Field Servers one FSAB can
support?
With/Without Network Restriction (Band Width,
Packet Loss)
How many FSAB a Meta Agent can support?
With/Without Network Restriction (Band Width,
Packet Loss, RTT)
Can we support 10,000 Field Servers ?
Data Mining and GRID Research Team
Takuji Kiura
National Agricultural Research Center
National Agriculture and Food Research Organization
Network Traffic and Load Average
Type A
100 FSs
DHCP
Server
Down!
Type B
25 FSs
Average CPU 25%
Data Mining and GRID Research Team
Takuji Kiura
National Agricultural Research Center
National Agriculture and Food Research Organization
Remaining Scalability Test
Firewall
Firewall
Private network of Field servers
Global IP
Field Server Meta Agent
（Web crawler & controller）
Cellar
FSAB
Private IP
Cable
FSAB
Global IP
Web Server
ADSL
PC-Cluster
Data Mining and GRID Research Team
FSAB
The Internet
Takuji Kiura
National Agricultural Research Center
National Agriculture and Food Research Organization
System Overview (New MetBroker)
Metadata database
DecisionDecision-Making Support Services
Operational Products
Simulation Models
Detailed Digital Forecast
2. Request
Item Definition
OWL
3. Request
Station metadata
RDF
1. Register
metadata
Meteorological databases
DB
Inference
Engine
Broker
4. Request
data
DB
DB
Change access method
using OWL and RDF
Data Mining and GRID Research Team
Takuji Kiura
National Agricultural Research Center
National Agriculture and Food Research Organization
MetBroker P2P
MetBroker =>
Large Middle
Layer
MetBroker
MetBroker
MetBroker
MetBroker
MetBroker
Data Mining and GRID Research Team
MetBroker P2P
has its own data
and share data
within P2P
Network
Takuji Kiura
National Agriculture and Food Research Organization
National Agricultural Research Center
Create Data Archive using
MetBroker
Problems
Special Access is slow.
Some Data Source is slow.
Data Mining and GRID Research Team
Takuji Kiura