Evaluation of Publication Indexing Bias in NIRF Research Performance Metrics

Authors

  • Prof. Dr. S. Balasubramanian Chief Editor and Managing Director, IAEME Publication Pvt Limited, Chennai, India. Author

Keywords:

publication indexing bias, research assessment, Scopus, Web of Science, Indian higher education, bibliometric indicators, responsible research assessment

Abstract

The National Institutional Ranking Framework (NIRF), established by the Ministry of Education in 2015, has become the dominant instrument for evaluating higher education institutions in India. With research and professional practice carrying 30% weightage in the overall ranking, the framework relies heavily on bibliometric indicators derived exclusively from two commercial databases: Scopus and Web of Science. This paper critically examines the publication indexing bias inherent in NIRF's research performance metrics. Through a comprehensive analysis of database coverage disparities, institutional responses, and systemic consequences, the study demonstrates that the exclusive reliance on Scopus and Web of Science creates a structural bias that systematically disadvantages Indian journals, regionally relevant research, and institutions without resources to publish in internationally indexed outlets. The paper documents how this bias has incentivized questionable publishing practices, including citation manipulation, predatory publishing, and the production of "casual papers" that prioritize quantity over quality. Drawing on the principles of responsible research assessment, the study proposes a reformed framework that incorporates Indian journals, recognizes diverse research outputs, and emphasizes qualitative evaluation alongside quantitative metrics.

References

Mills, D., & Asubiaro, T. (2024). Regional disparities in Web of Science and Scopus journal coverage. Scientometrics. https://doi.org/10.1007/s11192-024-04948-x

National Institutional Ranking Framework. (2024). Methodology for Ranking of Academic Institutions in India (Research Institution). Ministry of Education, Government of India. http://www.nirfindia.org

National Institutional Ranking Framework. (2019). India Rankings 2019 Report. Ministry of Human Resource Development, Government of India. http://www.nirfindia.org

ThePrint. (2024, July 8). NIRF parameters ill-designed & lead to absurd university ratings. Govt must order a review. https://theprint.in

Mudur, G. S. (2025, October 13). Top scientists flag corruption in NIRF rankings, urge overhaul of research metrics. The Telegraph India. https://www.telegraphindia.com

The Hindu. (2025, September 15). Trust, transparency, and teaching: Rethinking India's NIRF rankings. https://www.thehindu.com

DORA. (2025, June 17). Implementing Responsible Research Assessment in India. https://sfdora.org

StudiumTech. (2025, July 21). Why NIRF Only Counts Scopus & Web of Science Publications — And What It Means for You. https://www.studiumtech.in

LSE Impact Blog. (2024, September 9). Citation indexes make research more unequal. https://blogs.lse.ac.uk

The Hindu Business Line. (2023, June 20). Share of highly cited publications from top institutions drop: NIRF 2023. https://www.thehindubusinessline.com

OUCI. (n.d.). Mapping of Dental Journal Publishing in India - A Pilot Study on Epistemological Challenges in Southern Scholarly Publishing. https://ouci.dntb.gov.ua

The Hindu. (2023, June 14). Is the National Institutional Ranking Framework flawed? https://www.thehindu.com

The Hindu. (2025, September 1). NIRF at 10: How self-reporting leads to fudging of ranking data. https://www.thehindu.com

IREG Observatory. (2024). National Institutional Ranking Framework (NIRF). https://ireg-observatory.org

Deccan Herald. (2025, October 14). NIRF risks promoting reputation over merit. https://www.deccanherald.com

Civilsdaily. (2025, September 9). Ranking Pitfalls: India Rankings (2025) based on NIRF. https://www.civilsdaily.com

The Hindu. (2025, September 8). Ranking pitfalls: On the India Rankings 2025. https://www.thehindu.com

Economic Times. (2025, October 3). NIRF to begin negative marking for dishonesty. https://education.economictimes.indiatimes.com

The Hindu. (2025, September 8). NIRF 2025: Retraction penalties barely dent rankings; call for stronger reforms. https://www.thehindu.com

Sansad. (n.d.). National Institutional Ranking Framework (NIRF) methodology. https://sansad.in

Downloads

Published

2026-07-09

How to Cite

Prof. Dr. S. Balasubramanian. (2026). Evaluation of Publication Indexing Bias in NIRF Research Performance Metrics. INTERNATIONAL JOURNAL OF ENGINEERING AND TECHNOLOGY RESEARCH & DEVELOPMENT, 7(1), 13-29. https://ijetrd.com/index.php/ijetrd/article/view/IJETRD_07_01_003