Contact

Daria Pašalić
Editor-in-Chief
Department of Medical Chemistry, Biochemistry and Clinical Chemistry
Zagreb University School of Medicine
Šalata ul 2.
10 000 Zagreb, Croatia
Phone +385 (1) 4590 205; +385 (1) 4566 940
E-mail: dariapasalic [at] gmail [dot] com

Useful links

Editorial

 

Tomáš Zima. Impact factor and evaluation of scientific papers or teams. Biochemia Medica 2008;18(1):5-6. http://dx.doi.org/10.11613/BM.2008.001

Institute of Clinical Chemistry and Laboratory Medicine, The First Faculty of Medicine and General Teaching Hospital, Prague, Czech Republic

 

*Corresponding author: zimatom [at] cesnet [dot] cz

 

In 2005, the impact factor celebrated its 50th anniversary. Eugene Garfield published the paper “Citation index to science a new dimension in documentation through association of ideas” in Science. The phenomenon of impact factor is contradictory in these days, mostly in connection with the evaluation of the scientific degree of individuals or institutions.

The impact factor is a result of statistical operations determining the expectation of a publication to be cited based on two-year evaluation. It is the value of the journal and not of the publication or author. However, without doubts, prestigious journals with high impact factors publish papers of a high scientific level. This is tightly connected with the high impact factor of the journal.

The rate of citations can be related to the quality of paper, but in deep evaluation of this problem, we can find that many papers (around 20%) from prestigious journals are not cited. We can ask the following question: Are they really the top papers?

The impact factor represents simple quantification data for scientific production, but we cannot forget to relate the impact factor to the research area. There are very great differences, e.g., a top ranking journal in laboratory medicine is Clinical Chemistry (IF = 5.454), in nephrology Journal of American Society of Nephrology (IF = 7.371), in oncology the highest ranking journal is CA A Cancer Journal for Clinicians (IF = 63.342), and seven journals in total have an IF higher than 10. Cell (IF = 29) and Nature Review Molecular Cell Biology (IF = 31) are on top of the journals from basic cell science and another 16 journals have an IF higher than 10. The evaluation of IF must be done based on “weighted impact factor” to the research area.

The impact factors of journals are also one of the parameters relevant for research funding. There is a strong power of editors to choose the highly qualified reviewers for selection of papers. They have indirect influence on funding future research of different scientists and institutions.

Science citation index (SCI) is in tight connection with the impact factor. It is now based on the Web of Science organized and developed by E. Garfield. The first volume of the Science Citation Index was published in 1961. This parameter shows the number of citations of a paper from a selected database of journals. This database contains around 8,000 journals. The monopoly of this database was finished in 2004 and nowadays the Scopus is a real alternative that includes around 14,000 journals. The Scopus database is organized by Elsevier and focuses more on the European region.

These two databases take neither monographs, which are basic resources of information, nor educational textbooks or student manuals in consideration.

Publishing of papers in web journals or on web pages, and e-learning courses and textbooks and their evaluation are still open and we should expect new scientometric techniques for these platforms.

National journals are important for national scientific community. They should have more educational character with brief information for scientific community; of course, they should also publish some original articles. The aim of the publisher and scientific society should be to fill in the journal to international databases, mainly to Scopus or Web of Science.

There are also new scientometric techniques for evaluation of journals and scientists – citation density, citation half-life, Erdoss number (most used by mathematicians), or h index. All these new instruments use sophisticated statistical and mathematical processes.

The h-index (Hirsch index) is defined as the ratio of the number of papers and the number of citations, which is the same or higher than the number of papers. The h-index should be used for evaluation of persons entering university staff or prestigious societies. The value of h-index 10-12 is for prestigious universities a mark for tenure. A fellow of the American Physical Society needs an h-index of 15-20 and a member of the US National Academy of Science higher than 45.

Checking by experts is one of the new trends for institute evaluation. The experts should take into consideration not only the number of IF, but also other criteria of the scientific work such as patents, education of new scientists, international co-operations and projects, etc. Scientific work and its evaluation are not only impact factor, which is also important, but other indicators as well, e.g., successful education of postgraduate students, preparation of textbooks and monographs, and patents.

This process is more challenging than brief language of numbers, and for sure, more objective.