Against magical thinking regarding bibliometrics
DOI:
https://doi.org/10.3145/thinkepi.2022.e16a21Keywords:
Research evaluation, Impact Factor, Scientometrics, Responsible use of metricsAbstract
This work discusses the current debate between the use of qualitative approaches versus the use of quantitative indicators in research evaluation. It argues that too much importance is currently given to the methods and criteria employed in evaluation instead of discussing the most essential issue: the goal that evaluation pursues and how different research activities are valued. To finish, some design problems of the Spanish research evaluation system are highlighted because those problems act as a barrier towards a more contextualized and responsible evaluation system.
References
Kozlowski, Diego; Larivií¨re, Vincent; Sugimoto, Cassidy R.; Monroe-White, Thema (2022). "Intersectional inequalities in science". Proceedings of the National Academy of Sciences, v. 119, n. 2. https://doi.org/10.1073/pnas.2113067119
Moed, Henk F. (2017). Applied evaluative informetrics. Cham: Springer. ISBN: 978 3 319 60522 7 https://doi.org/10.1007/978-3-319-60522-7
Ni, Chaoqun; Smith, Elise; Yuan, Haimiao; Larivií¨re, Vincent; Sugimoto, Cassidy R. (2021). "The gendered nature of authorship". Science Advances, v. 7, n. 36, eabe4639. https://doi.org/10.1126/sciadv.abe4639
Robinson-Garcia, Nicolas; Costas, Rodrigo; Nane, Gabriela F.; Van-Leeuwen, Thed N. (2021). "Valuation regimes in academia: Researchers´ attitudes towards their diversity of activities and academic performance". SocArXiv. https://doi.org/10.31235/osf.io/ve7d3
