Evaluation of Publication Indexing Bias in NIRF Research Performance Metrics
Keywords:
publication indexing bias, research assessment, Scopus, Web of Science, Indian higher education, bibliometric indicators, responsible research assessmentAbstract
The National Institutional Ranking Framework (NIRF), established by the Ministry of Education in 2015, has become the dominant instrument for evaluating higher education institutions in India. With research and professional practice carrying 30% weightage in the overall ranking, the framework relies heavily on bibliometric indicators derived exclusively from two commercial databases: Scopus and Web of Science. This paper critically examines the publication indexing bias inherent in NIRF's research performance metrics. Through a comprehensive analysis of database coverage disparities, institutional responses, and systemic consequences, the study demonstrates that the exclusive reliance on Scopus and Web of Science creates a structural bias that systematically disadvantages Indian journals, regionally relevant research, and institutions without resources to publish in internationally indexed outlets. The paper documents how this bias has incentivized questionable publishing practices, including citation manipulation, predatory publishing, and the production of "casual papers" that prioritize quantity over quality. Drawing on the principles of responsible research assessment, the study proposes a reformed framework that incorporates Indian journals, recognizes diverse research outputs, and emphasizes qualitative evaluation alongside quantitative metrics.
References
Mills, D., & Asubiaro, T. (2024). Regional disparities in Web of Science and Scopus journal coverage. Scientometrics. https://doi.org/10.1007/s11192-024-04948-x
National Institutional Ranking Framework. (2024). Methodology for Ranking of Academic Institutions in India (Research Institution). Ministry of Education, Government of India. http://www.nirfindia.org
National Institutional Ranking Framework. (2019). India Rankings 2019 Report. Ministry of Human Resource Development, Government of India. http://www.nirfindia.org
ThePrint. (2024, July 8). NIRF parameters ill-designed & lead to absurd university ratings. Govt must order a review. https://theprint.in
Mudur, G. S. (2025, October 13). Top scientists flag corruption in NIRF rankings, urge overhaul of research metrics. The Telegraph India. https://www.telegraphindia.com
The Hindu. (2025, September 15). Trust, transparency, and teaching: Rethinking India's NIRF rankings. https://www.thehindu.com
DORA. (2025, June 17). Implementing Responsible Research Assessment in India. https://sfdora.org
StudiumTech. (2025, July 21). Why NIRF Only Counts Scopus & Web of Science Publications — And What It Means for You. https://www.studiumtech.in
LSE Impact Blog. (2024, September 9). Citation indexes make research more unequal. https://blogs.lse.ac.uk
The Hindu Business Line. (2023, June 20). Share of highly cited publications from top institutions drop: NIRF 2023. https://www.thehindubusinessline.com
OUCI. (n.d.). Mapping of Dental Journal Publishing in India - A Pilot Study on Epistemological Challenges in Southern Scholarly Publishing. https://ouci.dntb.gov.ua
The Hindu. (2023, June 14). Is the National Institutional Ranking Framework flawed? https://www.thehindu.com
The Hindu. (2025, September 1). NIRF at 10: How self-reporting leads to fudging of ranking data. https://www.thehindu.com
IREG Observatory. (2024). National Institutional Ranking Framework (NIRF). https://ireg-observatory.org
Deccan Herald. (2025, October 14). NIRF risks promoting reputation over merit. https://www.deccanherald.com
Civilsdaily. (2025, September 9). Ranking Pitfalls: India Rankings (2025) based on NIRF. https://www.civilsdaily.com
The Hindu. (2025, September 8). Ranking pitfalls: On the India Rankings 2025. https://www.thehindu.com
Economic Times. (2025, October 3). NIRF to begin negative marking for dishonesty. https://education.economictimes.indiatimes.com
The Hindu. (2025, September 8). NIRF 2025: Retraction penalties barely dent rankings; call for stronger reforms. https://www.thehindu.com
Sansad. (n.d.). National Institutional Ranking Framework (NIRF) methodology. https://sansad.in
Downloads
Published
Issue
Section
License
Copyright (c) 2026 Prof. Dr. S. Balasubramanian (Author)

This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.




