Survey
* Your assessment is very important for improving the work of artificial intelligence, which forms the content of this project
* Your assessment is very important for improving the work of artificial intelligence, which forms the content of this project
May, 2004
A Short Course at Tamkang University
A Support System for
Research Activity Using
the Internet
Shigeichi HIRASAWA
Department of Industrial and Management Systems
Engineering,
School of Science and Engineering,
Waseda University
1
1. Introduction
Objectives
Research Activity Support System over
Universities and Industries for cooperative
research work
For : Technical Meeting, Seminars, Forums,
Conferences, Symposiums, Lectures, Private
Research Guide and Technical Advice, …
(1)
(2)
Transmission of multimedia data (voice, text,
video and image) via Internet
Database system for papers, documents,
books, figures, tables and experimental data.
2
Using Internet
Educational activity support systems
…distance learning system
Research activity support systems
…ARPANET
Support System for Research Activity “NetSemi”
System Configuration
(1) Network conference system “NetCon”
…Electronic conference
(2) Private database system and its information
retrieval system “PDB”
3
2. Configuration of Support System NetSemi
(K)Haunyan Univ.
(GB) Cambridge Univ.
Lee
Sakai
(USA) UCLA
W.W.Chu
Internet
(USA) U.Hawaii
Matsushima
Waseda Univ.
Osaka Electron &
Comm. Univ.
Kohnosu
Aizu Univ.
Nakazawa
Remote terminal of NetCon
PDB
Hirasawa Lab.
Matsushima Lab.
Waseda Univ.
Bizmate Server
Fig2.1 The support system for research
activity NetSemi
4
2.1 Network Conference System NetCon
Network Conference System NetCon
White Board
Tablet
Video Camera
Projector
Headset
Speaker
Microphone
Internet
Video Storage
HD
HUB
Gateway
Terminal (PC)
Fig2.2 The network conference system NetCon
5
Table 2.1 Devices used for NetCon
Device
Model (Maker)
Projector
White Board
Microphone/Speaker
Video Storage HD
Video Camera
Tablet
Headset
CCD Camera
PC
ELP-710 (EPSON)
Mimio (KOKUYO)
YAMAHA
536DX 100GB (Maxtor)
ViewcamVL-MR1 (Sharp)
Intuos i-600(Wacom)
MM-HS02 (SANWA SUPPLY)
WebCamPlus (Creative)
Dimension 4100 (DELL)
6
2.2 Private database system and its
information retrieval system PDB
HUB
Gateway
Private database system and its
information retrieval system PDB
VR Search
Engine
WWW Server
CBS Search Engine
(to be introduced)
OCR
Multimedia
DB
Fig2.3 Private database system and its information retrieval system PDB
7
Table2.2 Software and hardware used for PDB
Device
Model (Maker)
Direct search engine
Concept search engine
OCR
Visual Recall(Fuji Xerox)
Concept base search (Justsystem)
DocuCenter 400FS (Fuji Xerox)
PC (search server)
PC (VR database server)
PC (CBS database server)
Nonstop Power Supply
Compaq Proliant 1600 (Compaq)
Compaq Proliant 400 (Compaq)
Dell Dimension 8100 (DELL)
Compaq UPS T1500 (Compaq)
8
Information Retrieval System (Visual Recall)
Computer
Secondary
Information
Inverted file
Formatting
Boolean
operation
User
Boolean formula
Query
Reference No. list
Preprocessing
Reference file
Primary information
Retrieved results
Reference List
(Title/Abstract/Contents)
Fig2.4 Direct Retrieval System
(Visual Recall)
9
Information Retrieval System
(Concept base search)
Computer
Secondary
Information
Vector Space
model
Classification
Engine
Preprocessing
Reference file
Similarity
Computation
User
Psudo document
Query
Similarity
ranking list
Primary Information
Retrieved results
Ranking list
(Contents)
Fig2.5 Concept based retrieval system
(Concept base search)
10
Characteristics of Concept Base Search
Retrieval System by Natural Language
(Pseudo document)
Concept based Similarity Ranking
Automatic Generation of Related Index
Multi-document format acceptable
Multi-storaging platform acceptable
11
Vectorization of document
Document
Query
Numberising an importance
between terms
Importance
of 4WD
Outdoor 0.5
4WD 0.7
・・・
vectorizing of document by
importances between terms
Doc B
Doc A
Importance
of leisure
drive 0.7
family 0.5
・・・
Doc C
Query
searching document similar
to query by using vector
Fig2.6 Vectorization of document
12
3. Quality of Service for Internet
Internet : no assurance of the quality of
channel
•
•
•
•
packet loss
packet delay
jitter
through put
make clear the conditions that
NetCon can be satisfactorily held
13
delay time [ms]
1
10
100
1000 [ms]
1
loss rate [%]
10-3
Voice
Video
Image
10-6
Character
Diagram
10-9
Fig 3.1 QoS for ATM communication network
14
delay time on other voice communications
delay time on other communications
type
delay time
phone
smaller than 100ms
mobile phone
smaller than 150ms
IP phone
smaller than 200ms
with intolerable
larger than 400ms
15
Protocol
Layer 7 (Application layer)
MPEG
Multimedia document
communication protocol
JPEG
ODA
Layer 4 (Transport layer)
TCP
Layer 3 (Network layer)
IP
End-to-end
communication
…for data transmission
Layer 1 (Physical layer)
ATM
(IPo ATM)
performance for software process to movie and voice (VoIP)
→to hardware
16
Table 3.1 Mixed mode and processor mode for Telematics
Storage type media
contents Characters
Diagrams
Images
Drawings
Stream type media
Video signals
Voice signals
Subjects Papers(CD-ROM)
Discussion
Hand written documents, Real time communication
Graphs, Figures, Tables,
etc.
17
Table 3.2 The advantage for using Internet
Wide area network
Internet
Telephone network, Private line network,
Line switching network, Packet
switching network, ISDN, Mobile data
communication network, etc.
Data
1.2K-622M [bps]
signaling rate
No assurance
Line cost
medium-high
low
Usability
OSI reference model
Unified protocol
(TCP/IP)
Free software
Extendibility
Telematics communicaion (G4fax, video
fax, audio graphic conference,
telewriting, etc.)
Multimedia Communication System (TV
conference system)
self-propagated
network
Standardization
task for high
performance 18
Table 3.3 Multimedia communications
Network
N-ISDN(64K-1.5M[bps])
Satellite line(10K-1.2G[bps])
Private line(1.2K-156M[bps])
CATV-VOD(30M[bps])
B-ISDN(ATM) (156M[bps])
xDSL(32K-22M[bps])
FTTH(10M-156M[bps])
Standardization
MPEG
JPEG
H.261(ITU-T)
・・・for TV Conference System
TCP/IP
VoIP(IPv6)
MPEG-3
MPEG-7
Groupware
(ex)
Office MERMAID
NetMeeting
PictureTel, net gear
CU See Me
Centra symposium
ProShare
BizMate
Internet
19
3.1 Delay Time
End-to-End delay time
transmitter
• (3)codec (coding time)
• (2)time to make packets
receiver
• (2)buffer time with jitter
• (3)codec(decoding time)
•(1) network delay time
Fig 3.2 Delay time construction
20
packet loss rate
With intolerable
With patient
With satisfactory
packet delay
21
4. Experiments
4.1 Measurements of QoS
(1) Experiment for real communication links
we evaluate the QoS for real
communication links.
delay time and packet loss rate are
measured for links
22
Experimental data of QoS
Waseda Univ. (Japan) – Cambridge Univ.(GB)
64 byte
Packet Loss
1000
45.00
700
64byte
Packet Delay
600
500
1Kbyte
Packet Delay
400
40.00
35.00
30.00
25.00
20.00
22
9
15
3
21
9
15
3
21
9
15
3
21
9
15
3
21
9
15
3
21
9
15
0.00
3
0
21
5.00
9
15
100
3
10.00
21
200
9
15
15.00
3
300
Packet Loss [%]
1Kbyte
Packet Loss
800
Packet Delay ms
50.00
Packet Loss %
900
Packet Delay [ms]
Time {hour]
Time [Hour]
Fig. 4.1 QoS for Waseda Univ. – Cambridge Univ.(1)
23
Experimental data of QoS
Waseda Univ. (Japan) – Cambridge Univ. (GB)
5
350
4
300
3
250
2
64byte Packet
Loss
1Kbyte Packet
Loss
64byte Packet
Delay
200
1
1Kbyte Packet
Delay
0
150
Sun Mon Tue Wed Thu Fri
Sat
Fig. 4.1 QoS for Waseda Univ. – Cambridge Univ. (2)
24
Experimental data of QoS
Waseda Univ. (Japan) – Cambridge Univ.(GB)
10
350
8
300
6
250
4
Packet Loss[%]
Packet Delay [ms]
64byte Packet
Loss
1Kbyte Packet
Loss
200
2
64byte Packet
Delay
150
0
1Kbyte Packet
Delay
0
4
8
12
16
20
time[hour]
Fig. 4.1 QoS for Waseda Univ. – Cambridge Univ.(3)
25
Experimental data of QoS
Table 4.1 Waseda Univ. (Japan) – Cambridge Univ.(GB) Actual path
ホップ数
Router/Gateway
period [ms]
1
hirasa.mgmt.waseda.ac.jp
0.371
2
c751361b.cfi.waseda.ac.jp
0.609
3
c751361c.cfi.waseda.ac.jp
0.655
4
c751324c.cfi.waseda.ac.jp
0.823
5
toumon.cfi.waseda.ac.jp
2.154
6
im-tyx-01-fddi1-0.inoc.imnet.ad.jp
2.361
7
im-tyx-03-fe5-0-0.inoc.imnet.ad.jp
2.289
8
apan-fe-tpr2.inoc.imnet.ad.jp
3.415
9
abilene-tpr2.jp.apan.net
144.902
10
clev-ipls.abilene.ucaid.edu
153.635
11
nycm-clev.abilene.ucaid.edu
163.958
12
ny-pop.ja.net
163.722
13
us-gw.ja.net
253.673
14
london-bar1.ja.net
246.033
15
pos9-0.lond-scr.ja.net
265.398
16
cambridge-bar.ja.net
251.348
17
route-sj4.cam.ac.uk
250.556
18
route-down-3.cam.ac.uk
250.533
19
route-cent-8.cam.ac.uk
267.349
20
heathrow.cl.cam.ac.uk
267.777
21
visitor4.al.cl.cam.ac.uk
267.503
26
Experimental data of QoS
Waseda Univ. – Univ. of Hawaii
300
200
150
100
5
22
8
1
18
11
4
21
14
7
0
50
0
15
56Byte
1000Byte
17
packet delay (ms)
250
time [hour]
Fig. 4.2 QoS for Waseda Univ. – Univ. of Hawaii
27
Experimental data of QoS
Waseda Univ. – UCLA
250
150
100
56Byte
1000Byte
50
19
5
14
3
16
22
11
0
5
19
8
14
3
16
12
1
23
0
10
packet delay (ms)
200
time [hour]
Fig. 4.3 QoS for Waseda Univ. – UCLA.
28
Experimental data of QoS
: network delay time and packet loss rate
1)Waseda Univ. (Japan) –Cambridge Univ.(GB)
2)Waseda Univ. (Japan) – UCLA (USA)
3)Waseda Univ. (Japan) – University of Hawaii (USA)
4)Local area network in Waseda Univ.
Table 4.1 Typical values of network delay time tn and packet loss rate pt
Packet loss rate [%]
Packet delay [ms]
Through put [KB/s]
Size of packet
64 [Byte]
1K[Byte]
64[Byte]
1K[Byte]
WU - CU
0.270
0.763
278.089
284.074
WU - UCLA
0.000
0.003
144.4
148.5
WU-UH
0.000
0.000
177. 0
187.3
within LAN
0.000
0.000
0.945
2.806
248
30
29
(2)
Experiments for CPU and OS
: packet and buffer delay time
NetCon(1)
NetCon(2)
connection
without
Hub, Router
To measure the
delay time to
packet
by measuring
End-to-End delay
time
ideal channel
Performance of NetCon (1)
CPU : Pentium4 (1.2GHz)
OS : Windows XP
Performance of NetCon (2)
Case
Compared terms
Fixed terms
1
windows 98
windows 2000
Cerelon(400MHz)
2
windows XP
windows 2000
Pentium3(1GHz)
3
Pentium4(2GHz) Pentium3(1GHz)
Cerelon(400MHz) windows 2000
Fig. 4.4 Experimental Conditions
30
Delay
time with different CPU (Case3)
9
8
7
6
5
4
3
2
1
0
Pen4(2GHz)
Pen3(1GHz)
Cerelon(400MHz)
TCP (average)
0
2000
4000
6000
8000
Data Size(byte)
9
10000
ave. response time (ms)
ave. response time (ms)
UDP (average)
12000
8
7
6
5
Pen4(2GHz)
Pen3(1GHz)
Cerelon(400MHz)
4
3
2
1
0
0
2000
4000
6000
8000
10000
Data Size(byte)
Fig. 4.5 Average packet and buffer delay time for different CPU’s(1)
12000
31
Delay
time with different CPU (Case3)
Streaming
Actual Throughput (kbps)
1200
1000
800
Pen4(2G)
Pen3(1G)
Cerelon(400M)
600
400
200
0
0
200
400
600
800
1000
1200
Data Size(kbps)
Fig. 4.5 Average packet and buffer delay time for different CPU’s(2)
32
Delay
time for different OS (Case1)
UDP (average)
ave. response time (ms)
16
14
12
2K
98
10
8
6
4
TCP (average)
2
0
2000
4000
6000
8000
Data Size(byte)
10000
12
12000
ave. response time (ms)
0
10
8
6
2K
98
4
2
0
0
5000
10000
15000
Data Size (bytes)
Fig. 4.6 Average packet and buffer delay time for different OS’s(1)
33
Delay
time for different OS (Case2)
UDP (average)
7
6
5
4
2K
XP
3
2
TCP (average)
1
0
0
2000
4000
6000
8000
Data Size (byte)
10000
12000
8
ave. response time (ms)
max. response time (ms)
8
7
6
5
2K
XP
4
3
2
1
0
0
2000
4000
6000
8000
10000
12000
Data Size(byte)
Fig. 4.6 Average packet and buffer delay time for different OS’s(2)
34
Through
put with different OS (Case2)
Streaming
Actual Throughput (kbps)
1200
1000
800
2K
XP
600
400
200
0
0
200
400
600
800
1000
1200
Data Size(kbps)
Fig. 4.6 Average packet and buffer delay time for different OS’s(3)
35
Conclusion
of Experiment
: packet and buffer delay time
delay time with different OS
Windows98 > Windows2000
settings of MTU or RWIN
Windows XP > Windows2000
stability more than processing speed
similar results by benchmark tests with applications
delay time with different CPU
Cerelon(400MHz) > Pentium3(1GHz) = Pentium4(2GHz)
From the result on through put : it is important to prepare
terminals with adequate OS and CPU
36
(3)
codec ideal delay
Table 4.2 Recommendation of CODEC delay time
codec number
bit rate
(kbps)
ideal delay
(ms)
ITU-T G.711
64
0.125
ITU-T G.723.1
6.3
37.5
ideal delay
•delay with waiting for input sequence
•delay with analysis of input voice
• delay with filter processing
37
4.2 Evaluations of NetCon by
simulated communication link
preparing a test system by Internet
Simulator
evaluation by a questionnaire
38
Experimental System
Microsoft Netmeeting
Hirasawa Lab.
Matsushima Lab.
Remote terminal
of NetCon
Remote terminal
of NetCon
Network Simulator
Measurement = Packet Delay, Packet Loss
Evaluation
= a questionnaire survey
Repeatability …an effect of learning
Psychological factor・・・ a prejudice
Fig. 4.7 Method and conditions for experiment
39
Evaluation
method
parameters of QoS
terms of questionnaire
packet delay time 0 , 300, 500, 1000 (ms)
packet loss rate 0,
5,
8, 10 (%)
「with sufficiently - with patient - with intolerable」
5
1
evaluating by voide, video and total
examinee : 12 people (students in Hirasawa and
Matsushima Lab. )
setting of MS NetMeeting
size of video transmission : Large, quality : High
Fig. 4.8 Evaluation method
40
Degree
of Satisfaction for Netcon
Table 4.3 Degree of satisfaction for NetCon
Evaluation by Voice
Evaluation by Video
packet delay (ms)
packet delay (ms)
voice
video
0
300
500
1000
0
300 500 1000
100%
67%
5%
83%
27%
8%
73%
10%
54%
50%
55%
packet loss
rate (%)
packet loss
rate(%)
0%
0% 100%
89%
5% 100%
82%
92%
82%
8% 100%
10%
54%
Total Evaluation
packet delay (ms)
total
packet loss
rate (%)
0
300
500
1000
0%
100%
100%
92%
55%
5%
100%
45%
8%
92%
10%
62%
41
Degree
of Satisfaction for Netcon
Table 4.4 Degree of satisfaction for NetCon
phase
explanation
discussion
action
degree of
satisfaction
synchronous in pointing and
speaking
82%
synchronous in new page and
speaking
80%
Q&A
91%
synchronous in new page and
speaking
70%
•discussion is highly depending on voice
•delay on changing slides in discussion is the question
•Each speaks simultaneously, confusion has occurred by delay.
Each speaker should pay attention with that.
42
5. Discussion
5.1 Real communication links
Experimental data for the delay time and the packet loss rate
mainly in network show that:
There are many bad hours in the QoS to use NetCon dependent on the
business hours of each country. These hours should be avoided to hold
the electronic conference.
2. The QoS varies with time dependent on paths of the link and jobs
processed in routers on the path [Takano01].
3. The network delay time t_n is not necessarily dependent on its actual
distance. It may depend on the constructed path of the link (source to
destination).
1.
The other experimental data for the delay time in the PC show
that:
With respect to CPU’s, the performance of Celeron (400MHz) is inferior
than that of Pentium III (1GHz) whose performance is almost the same
as Pentium IV (2GHz).
2. With respect to the OS’s, the performance of Windows 2000 is better
than that of Windows 98 or Windows XP. This fact has been known by
benchmark test using application programs [IT03].
1.
43
5.2 Evaluation by simulated link
Table 4.3 shows that:
1.
2.
There is the region in the delay time and the packet loss rate
where the students are satisfied with NetCon.
There is a trade-off between the delay time and the packet loss
rate in the region.
Table 4.4 shows that if the students adapt themselves to
use NetCon, then the tolerable region becomes large.
The reasons are that:
a.
b.
Discussions are made mainly by voice (conversation) not by
images.
Q&A requires a small delay time. If they carefully start Q&A by
their experience, a larger delay time will be tolerable.
44
6. Concluding Remarks
1.
2.
3.
4.
5.
We have clarified by the experiment of the simulated link that there
are the conditions for which NetCon can be satisfactorily used, and
by that of the real communication link in the Internet that we can
attain these conditions by carefully and properly choosing the hours
in a day and the days in a week, even if we want to develop NetCon
to all over the world.
To do so, we must gather data of the QoS before beginning to hold
the electronic conference.
It is also shown that choosing CPU and the OS for the terminals are
important to keep the QoS.
It should be noted that experiences and trainings for users in
practical use of NetCon will help to enlarge the regions of the
conditions for the QoS.
Although detailed experiments and discussions will be necessary to
make clear the conditions for the QoS of the communication link (the
Internet) whether NetCon can be satisfactorily used, we can roughly
conclude the region of these conditions as shown in Fig. 6.1.
45
Required conditions for QoS of Internet for NetCon
packet loss rate (%)
10
8●
5●
with satisfactory
0
0
GB – Japan
●
300
●
500
packet delay (ms)
Fig 6.1 Required conditions for QoS of Internet for NetCon
46
sufficiency
mean opinion test
100
worse
average
bad
50
good
better
0
0
1
1.5
2
2.5
3
4
5
MOS(mean opinion score)
Fig.
MOS(mean opinion score)
47