Survey
* Your assessment is very important for improving the workof artificial intelligence, which forms the content of this project
* Your assessment is very important for improving the workof artificial intelligence, which forms the content of this project
PERFORMANCE INDICATORS FOR SCIENCE EVALUATION The challenge of providing the Research Information Sytems (RIS) needed in the ERA: Needs of the science community – a personal view H. Rauch Atominstitut der Österreichischen Universitäten Stadionallee 2, 1020 Wien SCIENTOMETRIC ANALYSIS Pro´s: soft method unibased capable of improvement Contra´s: flops counting expert dependent ISI dependent Thomson Coop. www.isinet.com ® ISI Products & Services ISI Web of KnowledgeSM Citation Products Web of Science® Science Citation Index Expanded™ Social Sciences Citation Index® Arts and Humanities Citation Index® ISI Proceedings® Derwent Innovations IndexSM Current Awareness Products Current Contents Connect® ISI Discovery Agent SM Specialized Content ISI ChemistrySM BIOSIS Previews® INSPEC® ® Institute for Science Information Headquater: Philadelphia/US Offices: US, UK, Irland, Japan, Singapore Employees: 850 Total journals covered: 8676 RANKING OF ... Nations Fields Int. Cooperations Institutions Journals Individuals etc. absolute and relatives measures static and time-dependent measures correlation measures Austrian Physics Evaluation F.Aumayr, TUWien, Nov.1999 Neutron Scattering Science Neutron Scattering Methods 1800 1600 Number of Papers 1400 1200 total 1000 800 600 400 200 0 1985 1989 SC DIFF S RA AN A T N 1992 1994 OP SE D/T S 1996 1998 R OM 2000 2002UC EF T N Date Neutron Activation and Therapy alternative neutron research fields General Comparison 160 120 100 80 Neutron activation 60 stat. various research fields 40 20 Neutron therapy 3000 2500 2000 1500 1000 SCA T.TO T NMR 500 NA A / 20 02 20 00 19 98 BEC 19 96 19 94 19 92 0 19 89 NA A Th era py 19 85 02 20 00 20 96 98 19 Date 19 94 19 92 3500 19 89 19 85 0 19 Number of papers 140 THE R. PHYSICS JOURNAL RANKING Impact Factor 1. 2. 3. 4. 5. 6. 7. 8. 9. 10. . . . Rev. Mod. Physics Solid State Physics Advances Physics Phys. Rev. Lett. Phys. Reports Ann. Rev. Nucl. Part. Sci. Ann. Rev. Fluid Meth. Mat. Sci. Eng. Res. Adv. Atomic Mol. Opt. Phys. Rep. Progr. Phys. 19.4 9.8 9.37 6.29 6.1 5.9 5.8 5.7 5.66 5.59 T1/2 >10 a >10 >10 5.4 8.5 7.6 8.5 4.8 >10 8.4 Journal Ranking 1. 2. 3. 4. Clin.Res. Am.Rev.Immun. Am.Rev.Biochem. Cell 10. Nature 25. Rev.Mod.Phys. Impact Factor 58.28 49.5 44.4 40.4 27.07 19.4 Publications versus Citations W.Glänzel, A. Schubert, Scientometrics 56(2003)357 Ranking in GDP per capita Ranking in articles per capita Ranking in articles per GDP 1.) 2.) 3.) 4.) 5.) 6.) 7.) 8.) 9.) 10.) 11.) 12.) 13.) USA Norway Iceland Switzerland Canada Denmark Belgium Ireland Austria Japan Australia Netherlands Germany Switzerland Sweden Israel Denmark Finland U.K. Netherlands Canada Australia New Zealand Norway Singapore USA USA India China UK Russia Japan Germany France Brazil Italy Canada Ukraine Turkey . . . . . . . . . . . . Different kinds of country ranking World Region Publications M.Batty, The Scientist 17(2003)16, 10 Citations per country M.Batty, The Scientist 17(2003)16, 10 M.Batty, The Scientist 17(2003)16, 10 M.Batty, The Scientist 17(2003)16, 10 WORLD CITATIONS Country Share of World papers (%) US UK Japan Germany France Canada Italy India Australia Netherlands Sweden Switzerland P.R. China Denmark Finland Norway 34.6 8.0 7.3 7.0 5.2 4.5 2.7 2.4 2.1 2.0 1.7 1.4 0.9 0.8 0.7 0.5 Share of world citations (%) 49 9.1 5.7 6.0 4.5 4.5 2.1 0.7 2.1 2.2 2.1 1.9 0.3 1.0 0.6 0.5 Self-Citations D.W.Arkans, Scientometry 56(1962)235 The percentage of self-citations in different scientfic fields (NSI-categ.) Field (NSI-category) Clinical Medicine Neuroscience Ecology/Environment Plant & Animal Science Psychology/Psychiatry Geosciences Microbiology Materials Science Agricultural Sciences Mathematics Molec Biology & Genetics Biology & Biochemistry Engineering Pharmacology Multidisciplinary Computer Science Immunology Physics Chemistry Astrophysics Citation-rate % Self-cit 14.2 17% 22.6 18% 14.3 19% 12.0 20% 9.8 21% 12.4 21% 18.3 21% 6.2 22% 8.8 22% 7.9 22% 24.8 22% 19.5 23% 6.5 23% 11.1 23% 10.6 24% 4.9 24% 22.0 24% 10.9 26% 11.0 31% 15.6 31% n (num. art.) 15,909 1,934 1,835 5,040 1,325 2,898 1,246 774 1,051 697 1,132 4,153 2,072 1,390 572 283 1,579 2,857 4,530 383 D.W.Arkans, Scientometry 56(1962)235 Proposal Founding of a European based Initiative on Scientific Information (in cooperation with ISI?) 1st Step: ESF-Program 2nd Step: EU-Network CONCLUSION Bibliometric methods contribute essentially to science evaluation Bibliometric methods can help to decide on large facility issues Bibliometric methods will become more important in future Experts can do bibliometric analysis only A European initiative could help