The Journal Impact Factor still consumes Spanish science. For how much longer?

Authors

  • Emilio Delgado-López-Cózar El profesional de la información
  • Alberto Martí­n-Martí­n

DOI:

https://doi.org/10.3145/thinkepi.2019.e13e09

Keywords:

Journal Impact Factor, Journal Citation Reports, Bibliometric indicators, Citation counts, Scientific journals, Scholarly publishing, Research evaluation, Performance assessment of researchers, Research policy, Assessment policy, Scientific ethics,

Abstract

The goal of this essay is to provide an answer to the question "Why does Spain still use Journal Impact Factors and other citation-based bibliometric indicators to assess the performance of researchers and institutions?". Despite the growing number of new citation data sources and bibliometric indicators, and the widespread criticism against JIF use by various declarations and manifestos, in Spain it is still a necessary condition to publish in journals with an impact factor (from Journal Citation Reports) or similar indicators in order to enter in an academic career and to prosper in it. The JIF has penetrated all research-related organizations (funding and evaluation agencies, universities, research centres, hospitals, and cultural centres). It is being mercilessly applied at all levels, from authors, research groups, and institutions, to early-career grant programmes and research projects of every kind. After showing how this requisite is omnipresent in the text of all calls published by the main funding and evaluation agencies in Spain, we try to explain how it came to this. We go over the origin of the JIF and the intentions of its creator, and we review the criticisms that it has received over time, up to the publication of the San Francisco Declaration and the Leiden Manifesto. We discuss the reasons that explain Spain´s blind insistence on keeping the JIF as the gold standard of research assessment. The essay ends with a discussion on why we think the continued support of this policy is damaging science: the JIF promotes scientific monoculture, Publish or Perish culture, and the propagation of impactitis, an illness that is severely altering the moral behaviour of Spanish researchers.

Downloads

Download data is not yet available.

References

Braun, Tibor; Glí¤nzel, Wolfgang (1995). "On a source of error in computing journal impact factors". Chemical intelligencer, n. 1, 31-32.

Camí­, Jordi (1997). "Impactolatria, diagnóstico y tratamiento". Medicina clí­nica, n. 109, pp. 515-524. http://blogs.ujaen.es/cienciabuja/wp-content/uploads/2016/05/Impactolatria.pdf

Delgado-López-Cózar, Emilio (2010). "Claroscuros de la evaluación cientí­fica en España". Boletin Medes: Medicina en Español, n. 4, pp. 25-29. http://hdl.handle.net/10481/35911

Delgado-López-Cózar, Emilio (2017a). "La edición académica a examen: índices de impacto, rankings y agencias de evaluación". En: VII Jornada Digital: Ecosistema, proyección e impacto del libro académico. Madrid, 1 de junio de 2017. http://hdl.handle.net/10481/4676

Delgado-López-Cózar, Emilio (2017b). "Sobre el uso, abuso, mal uso y efectos de la aplicación de los indicadores bibliométricos en la evaluación de la ciencia". Debate: Avaluació de la cií¨ncia: aplicacions i lí­mits dels indicadors bibliomí¨trics. Acto de clausura del postgrado Comunicació i Avaluació de la Cií¨ncia de la Universidad de Barcelona. Barcelona, 28 de noviembre. https://doi.org/10.13140/RG.2.2.30226.30406

Delgado-López-Cózar, Emilio (2018). De la ruta de oro a la ruta verde de la comunicación cientí­fica: negocio editorial y bibliométrico, publicación libre, acceso abierto, evaluación total e individualizada. http://doi.org/10.13140/RG.2.2.30852.78724

Delgado-López-Cózar, Emilio (2019). "La evaluación de revistas cientí­ficas en España: perversiones bibliométricas". En: 9ª Conferencia internacional sobre revistas de Ciencias Sociales y Humanidades. Logroño, 23 de mayo de 2019. https://doi.org/10.13140/RG.2.2.19643.36644

Delgado-López-Cózar, Emilio; Ruiz-Pérez, Rafael; Jiménez-Contreras, Evaristo (2007). "Impact of the impact factor in Spain". British medical journal, 20 april. https://www.bmj.com/rapid-response/2011/11/01/impact-impact-factor-spain

DORA (2018). Declaración de San Francisco sobre la evaluación de la investigación. Traducción por Beatriz Pardal-Peláez. https://sfdora.org/read/es

EASE (2007). EASE statement on inappropriate use of impact factors. European Association of Science Editors. http://www.ease.org.uk/publications/impact-factor-statement

Garfield, Eugene (1972). "Citation analysis as a tool in journal evaluation". Science, v. 178, n. 4060, pp. 471-479. https://doi.org/10.1126/science.178.4060.471

Garfield, Eugene (1983a). "How to use citation analysis for faculty evaluation and when is it relevant? Part 1". Current contents, n. 44, pp. 5-13. http://www.garfield.library.upenn.edu/essays/v6p354y1983.pdf

Garfield, Eugene (1983b). "How to use citation analysis for faculty evaluation and when is it relevant? Part 2". Current contents, n. 45, pp. 363-372. http://www.garfield.library.upenn.edu/essays/v6p363y1983.pdf

Garfield, Eugene (1996). "Fortnightly review: How can impact factors be improved?". British medical journal, v. 313, n. 7054, pp. 411-413. https://doi.org/10.1136/bmj.313.7054.411

Garfield, Eugene (1999). "Journal impact factor: a brief review". CMAJ, v. 161, n. 8, pp. 979-980. https://www.cmaj.ca/content/161/8/979

Garfield, Eugene (2005). "The agony and the ecstasy. The history and meaning of the Journal Impact Factor". En: International Congress on Peer Review and Biomedical Publication. http://garfield.library.upenn.edu/papers/jifchicago2005.pdf

Glí¤nzel, Wolfgang; Moed, Henk F. (2002). "Journal impact measures in bibliometric research". Scientometrics, v. 53, n. 2, pp. 171-193. https://doi.org/ 10.1023/A:1014848323806

Hicks, Diana; Wouters, Paul; Waltman, Ludo; De-Rijcke, Sarah; Rafols, Ismael (2015). "Bibliometrics: the Leiden Manifesto for research metrics". Nature news, v. 520, n. 7548, pp. 429. https://doi.org/10.1038/520429a

Jiménez-Contreras, Evaristo; De-Moya-Anegón, Félix; Delgado-López-Cózar, Emilio (2003). "The evolution of research activity in Spain: The impact of the National Commission for the Evaluation of Research Activity (CNEAI)". Research policy, v. 32, n. 1, pp. 123-142. https://doi.org/10.1016/S0048-7333(02)00008-2

Jiménez-Contreras, Evaristo; Delgado-López-Cózar, Emilio; Ruiz-Pérez, Rafael; Fernández, Ví­ctor M. (2002). "Impact-factor rewards affect Spanish research". Nature, v. 417, n. 6892, pp. 898. https://doi.org/10.1038/417898b

Monastersky, Richard (2005). "The number that´s devouring science". The chronicle of higher education, v. 52, n. 8.

Orduña-Malea, Enrique; Martí­n-Martí­n, Alberto; Delgado-López-Cózar, Emilio (2017). "Métricas en perfiles académicos: ¿un nuevo juego adictivo para los investigadores?". Revista española de salud pública, n. 90, e20006. https://www.ncbi.nlm.nih.gov/pubmed/27653216

Saha, Somnath; Saint, Sanjay; Christakis, Dimitri A. (2003). "Impact factor: a valid measure of journal quality?". Journal of the Medical Library Association, v. 91, n. 1, pp. 42. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC141186

Seglen, Per O. (1992). "How representative is the journal impact factor?". Research evaluation, v. 2, n. 3, pp. 143-149. https://doi.org/10.1093/rev/2.3.143

Seglen, Per O. (1994). "Causal relationship between article citedness and journal impact". Journal of the American Society for Information Science, v. 45, n. 1. https://doi.org/10.1002/(SICI)1097-4571(199401)45:1%3C1::AID-ASI1%3E3.0.CO;2-Y

Seglen, Per O. (1997). "Why the impact factor of journals should not be used for evaluating research". British medical journal, v. 314, pp. 498-502. https://doi.org/10.1136/bmj.314.7079.497

Vanclay, Jerome K. (2012). "Impact factor: outdated artefact or stepping-stone to journal certification?". Scientometrics, v. 92, n. 2, pp. 211-238. https://doi.org/10.1007/s11192-011-0561-0

Wilsdon, James; Allen, Liz; Belfiore, Eleonora; Campbell, Philip; Curry, Stephen; Hill, Steven; Jones, Ri­chard; Kain, Roger; Kerridge, Simon Richard; Thelwall, Mike; Tinkler, Jane; Viney, Ian; Wouters, Paul (2016). The metric tide: Independent review of the role of metrics in research assessment and management. Sage. https://doi.org/10.13140/RG.2.1.4929.1363

Published

2019-12-29

How to Cite

Delgado-López-Cózar, E., & Martí­n-Martí­n, A. (2019). The Journal Impact Factor still consumes Spanish science. For how much longer?. Anuario ThinkEPI, 13. https://doi.org/10.3145/thinkepi.2019.e13e09

Dimensions

Altmetrics

Issue

Section

E. Comunicación cientí­fica, edición y fuentes de información