Download Document

PERFORMANCE INDICATORS FOR SCIENCE
EVALUATION
The challenge of providing the Research Information Sytems (RIS) needed in the
ERA: Needs of the science community – a personal view
H. Rauch
Atominstitut der Österreichischen Universitäten
Stadionallee 2, 1020 Wien
SCIENTOMETRIC ANALYSIS
Pro´s:
soft method
unibased
capable of improvement
Contra´s:
flops counting
expert dependent
ISI dependent
Thomson Coop.
www.isinet.com
®
ISI Products & Services
ISI Web of KnowledgeSM
Citation Products
Web of Science®
Science Citation Index Expanded™
Social Sciences Citation Index®
Arts and Humanities Citation Index®
ISI Proceedings®
Derwent Innovations IndexSM
Current Awareness Products
Current Contents Connect®
ISI Discovery Agent SM
Specialized Content
ISI ChemistrySM
BIOSIS Previews®
INSPEC®
®
Institute for Science Information
Headquater: Philadelphia/US
Offices: US, UK, Irland, Japan,
Singapore
Employees: 850
Total journals covered: 8676
RANKING OF ...
Nations
Fields
Int. Cooperations
Institutions
Journals
Individuals
etc.
absolute and relatives measures
static and time-dependent measures
correlation measures
Austrian Physics Evaluation
F.Aumayr, TUWien, Nov.1999
Neutron Scattering Science
Neutron Scattering Methods
1800
1600
Number of Papers
1400
1200
total
1000
800
600
400
200
0
1985 1989
SC DIFF
S
RA AN A T
N
1992 1994
OP SE D/T S
1996 1998
R
OM
2000 2002UC EF T
N
Date
Neutron Activation and Therapy
alternative neutron research fields
General Comparison
160
120
100
80
Neutron activation
60
stat. various research fields
40
20
Neutron therapy
3000
2500
2000
1500
1000
SCA
T.TO
T
NMR
500
NA A
/
20
02
20
00
19
98
BEC
19
96
19
94
19
92
0
19
89
NA
A
Th
era
py
19
85
02
20
00
20
96
98
19
Date
19
94
19
92
3500
19
89
19
85
0
19
Number of papers
140
THE
R.
PHYSICS JOURNAL RANKING
Impact Factor
1.
2.
3.
4.
5.
6.
7.
8.
9.
10.
.
.
.
Rev. Mod. Physics
Solid State Physics
Advances Physics
Phys. Rev. Lett.
Phys. Reports
Ann. Rev. Nucl. Part. Sci.
Ann. Rev. Fluid Meth.
Mat. Sci. Eng. Res.
Adv. Atomic Mol. Opt. Phys.
Rep. Progr. Phys.
19.4
9.8
9.37
6.29
6.1
5.9
5.8
5.7
5.66
5.59
T1/2
>10 a
>10
>10
5.4
8.5
7.6
8.5
4.8
>10
8.4
Journal Ranking
1.
2.
3.
4.
Clin.Res.
Am.Rev.Immun.
Am.Rev.Biochem.
Cell
10. Nature
25. Rev.Mod.Phys.
Impact Factor
58.28
49.5
44.4
40.4
27.07
19.4
Publications versus Citations
W.Glänzel, A. Schubert, Scientometrics 56(2003)357
Ranking in GDP
per capita
Ranking in articles
per capita
Ranking in articles
per GDP
1.)
2.)
3.)
4.)
5.)
6.)
7.)
8.)
9.)
10.)
11.)
12.)
13.)
USA
Norway
Iceland
Switzerland
Canada
Denmark
Belgium
Ireland
Austria
Japan
Australia
Netherlands
Germany
Switzerland
Sweden
Israel
Denmark
Finland
U.K.
Netherlands
Canada
Australia
New Zealand
Norway
Singapore
USA
USA
India
China
UK
Russia
Japan
Germany
France
Brazil
Italy
Canada
Ukraine
Turkey
.
.
.
.
.
.
.
.
.
.
.
.
Different kinds of country ranking
World Region Publications
M.Batty, The Scientist 17(2003)16, 10
Citations per country
M.Batty, The Scientist 17(2003)16, 10
M.Batty, The Scientist
17(2003)16, 10
M.Batty, The Scientist 17(2003)16, 10
WORLD CITATIONS
Country Share of World papers (%)
US
UK
Japan
Germany
France
Canada
Italy
India
Australia
Netherlands
Sweden
Switzerland
P.R. China
Denmark
Finland
Norway
34.6
8.0
7.3
7.0
5.2
4.5
2.7
2.4
2.1
2.0
1.7
1.4
0.9
0.8
0.7
0.5
Share of world citations (%)
49
9.1
5.7
6.0
4.5
4.5
2.1
0.7
2.1
2.2
2.1
1.9
0.3
1.0
0.6
0.5
Self-Citations
D.W.Arkans, Scientometry 56(1962)235
The percentage of self-citations in different scientfic fields (NSI-categ.)
Field (NSI-category)
Clinical Medicine
Neuroscience
Ecology/Environment
Plant & Animal Science
Psychology/Psychiatry
Geosciences
Microbiology
Materials Science
Agricultural Sciences
Mathematics
Molec Biology & Genetics
Biology & Biochemistry
Engineering
Pharmacology
Multidisciplinary
Computer Science
Immunology
Physics
Chemistry
Astrophysics
Citation-rate % Self-cit
14.2
17%
22.6
18%
14.3
19%
12.0
20%
9.8
21%
12.4
21%
18.3
21%
6.2
22%
8.8
22%
7.9
22%
24.8
22%
19.5
23%
6.5
23%
11.1
23%
10.6
24%
4.9
24%
22.0
24%
10.9
26%
11.0
31%
15.6
31%
n (num. art.)
15,909
1,934
1,835
5,040
1,325
2,898
1,246
774
1,051
697
1,132
4,153
2,072
1,390
572
283
1,579
2,857
4,530
383
D.W.Arkans, Scientometry 56(1962)235
Proposal
Founding of a
European based
Initiative on Scientific Information
(in cooperation with ISI?)
1st Step:
ESF-Program
2nd Step:
EU-Network
CONCLUSION
Bibliometric methods contribute essentially to science
evaluation
Bibliometric methods can help to decide on large facility
issues
Bibliometric methods will become more important in future
Experts can do bibliometric analysis only
A European initiative could help