Neurology India
menu-bar5 Open access journal indexed with Index Medicus
  Users online: 3043  
 Home | Login 
About Editorial board Articlesmenu-bullet NSI Publicationsmenu-bullet Search Instructions Online Submission Subscribe Videos Etcetera Contact
  Navigate Here 
 Resource Links
  »  Similar in PUBMED
 »  Search Pubmed for
 »  Search in Google Scholar for
 »Related articles
  »  Article in PDF (519 KB)
  »  Citation Manager
  »  Access Statistics
  »  Reader Comments
  »  Email Alert *
  »  Add to My List *
* Registration required (free)  

  In this Article
 »  Abstract
 » Introduction
 » Methods
 » Results
 » Discussion
 » Acknowledgments
 »  References
 »  Article Tables

 Article Access Statistics
    PDF Downloaded295    
    Comments [Add]    
    Cited by others 1    

Recommend this journal


Table of Contents    
Year : 2015  |  Volume : 63  |  Issue : 3  |  Page : 338-346

Publication performance and research output of Neurology and Neurosurgery training institutes in India: A 5-year analysis

Department of Neurosurgery, Jawaharlal Institute of Postgraduate Medical Education and Research, Puducherry, India

Date of Web Publication5-Jun-2015

Correspondence Address:
Venkatesh S Madhugiri
Department of Neurosurgery, Jawaharlal Institute of Postgraduate Medical Education and Research, Puducherry - 605 006
Login to access the Email id

Source of Support: None, Conflict of Interest: None

DOI: 10.4103/0028-3886.158200

Rights and Permissions

 » Abstract 

Context: Scientific publications are a reflection of the quality of the clinical and academic work being carried out in an institute. Training in the process of research and scientific writing are important components of the residency curriculum.
Aims: The publication performance and research output of institutes training residents in neurology and neurosurgery were evaluated.
Setting and Design: Internet-based study.
Methods: This study was based on the data available on the websites of the Medical Council of India and the National Board of Examinations. The PubMed search interface was used to determine the publication output of institutes over the past 5 years (2010-2014). Google Scholar was used to determine the citation performance of each paper. The publication parameters were normalized to the number of faculty members in each institute as listed on the institutional web page. The normalized publication performance for an institute was computed by comparing the figures for that institute with the national average.
Results: Institutes could be ranked on several criteria. There was a high degree of clustering of output from the top 5% of the institutes. About 13% of the neurology intake and 30.9% of neurosurgery intake over the past 5 years has been into the institutes that have not published a single paper during this period.
Conclusions: This evaluation of the publication performance and research output of neurology and neurosurgery training institutes would serve as a baseline data for future evaluations and comparisons. The absence of any publication and research output from several training institutes is a matter of concern.

Keywords: Citation; clinical neurosciences; India; neurology; neurosurgery; publication performance; rankings; research output; residency programs

How to cite this article:
Madhugiri VS. Publication performance and research output of Neurology and Neurosurgery training institutes in India: A 5-year analysis. Neurol India 2015;63:338-46

How to cite this URL:
Madhugiri VS. Publication performance and research output of Neurology and Neurosurgery training institutes in India: A 5-year analysis. Neurol India [serial online] 2015 [cited 2021 Jun 18];63:338-46. Available from:

 » Introduction Top

The training curricula for neurology and neurosurgery residents have been constantly evolving over the past several decades. [1],[2] Residency training now involves the acquisition of core competence across several domains. These domains include clinical patient care, procedural skills development, theoretical knowledge, communication and teaching skills, teamwork and management skills, exposure to evidence-informed medicine, training in research methodology, and scientific writing. [3] Since the quality of resident training directly affects the quality of clinical care and research, it becomes essential to monitor the skills acquired during the training period. [4],[5],[6] The most important of these domains would obviously be clinical care, procedural skills, and theoretical knowledge of the subject. The success of a training institute in imparting these skills, however, is difficult to evaluate; the required information is often not easily available.

One of these components, however, readily lends itself to quantitative evaluation and comparison. This is the exposure to research methodology and scientific writing, as measured by the publication and research output of a training institute. The number and quality of publications emanating from an institute can be construed to indicate (albeit indirectly) the quality of clinical work and research being undertaken in that institute. Thus, by extension, the degree of exposure of residents to these domains could be gauged. Publications and research output are factors that have consistently been used to rank institutes and training programs. [7],[8] While the volume of clinical exposure in most training programs in India may be adequate, the adequacy of exposure to research and scientific writing is not known. [9],[10] Although presentations at conferences also denote academic activity, the absence of a rigorous peer review and lack of a permanent record for peer usage make this activity inappropriate for evaluation and comparison.

Indian medical colleges have been ranked by the print media as well by academic organizations. [11],[12] However, till date, there has been no evaluation of institutes conducting residency programs in neurology and neurosurgery on the basis of their publication performance and research output. In this study, the research output and publication performance of institutes that train residents in neurology and neurosurgery in India were evaluated.

 » Methods Top

The list of institutes recognized by the Medical Council of India (MCI) to conduct training programs in neurology (DM) and neurosurgery (MCh - 3 and 6 years programs) was obtained from the MCI website ( However, similar information for the diplomate courses (DNB) was not readily available on the website of the National Board of Examinations (NBE, Therefore, the centers conducting DNB courses in neurology and neurosurgery were identified from the lists of seats offered in institutes as published in the admission prospectuses for super-specialty DNB courses for the years 2013-2015. The lists of papers published by departments (neurology/neurosurgery) in the listed institutes were then identified as described subsequently.

Step 1

The website of each institute was accessed to determine the exact listed departmental name - for instance in some institutes, neurology and neurosurgery were combined and listed as "Department of Clinical Neurosciences" or "Department of Neurological sciences."

Step 2

A PubMed search was built using the advanced search function to collate papers published by each institute. For all searches, 2 search fields were employed. In SEARCHSET-1, the first search string was the department/subject (neurology/neurosurgery) and this was searched as an "affiliation." If a different nomenclature (besides neurology/neurosurgery) had been displayed on the website, this was used in addition to neurology/neurosurgery, in a separate search. In SEARCHSET-2, neurology and neurosurgery were searched as Major Medical Subject Heading terms. In both search sets, the 2 nd search string was always the name of the institute; this was also searched as an affiliation. Every effort was made to incorporate as many spelling and abbreviation variations as possible in this search term. For instance, if the word "Shri" appeared in the name of an institute, irrespective of the spelling listed on the website, separate searches were carried out using all possible spelling variations (such as Sri, Shri, Shree, Sree, etc.,). At some instances, as many as 7 separate searches were carried out for a single institute in each search set. For example, publications by the Post Graduate Institute of Medical Education and Research (PGIMER), Dr. Ram Manohar Lohia Hospital were searched for using the entire name and various abbreviations thereof (such as PGIMER Dr. Ram Manohar Lohia hospital, PGIMER Dr RML Hospital, Dr. Ram Manohar Lohia hospital, RML Hospital, R M L Hospital, etc.,). The search limits were set to the past 5 years (2010-2014 inclusive).

Step 3

For the next search, the institutional web site was accessed again to check if the names of the teaching faculty were listed. If faculty names were available, a PubMed search was performed using the name of each faculty member as an author. [13] The list of papers published by the faculty over the past 5 years were collated.

Step 4

Lists of papers obtained by each of the several searches carried out were merged and duplicates eliminated. Separate databases were generated and maintained for each institute using EndNote® (vX7, Thomson Reuters).

Each publication was categorized as a case report, original paper, and review article or as belonging to a miscellaneous category (response to comments, opinion piece, editorial, etc.). Case series describing ≥4 cases were considered to be original articles. No distinction was made between basic laboratory research, clinical investigations or trials, translational research or case series - these were all categorized as original papers.

The following calculations were then made:

  • The number of times each article had been cited in literature was determined by performing a search on Google Scholar (
  • The ratio of the number of publications per year to the faculty strength was calculated for each institute (total publications in 5 years/faculty strength)
  • In order to evaluate the productivity of each institute vis-a-vis the average performance across India, the publications per year statistic for each institute was compared with the national average. Thus, if Pi were to be the average publications per year for a particular institute i and P0 - the national average of Pi , the normalized publication performance (NPP) would be given by following formula that has been described previously- [14]
  • The quality of original work being published from the institutes was assessed as follows - institutes were first divided into quartiles based on the number of original papers published. All original papers published by institutes in the highest quartile were listed, and the citations received by these papers were determined. The institutes were then ranked on the basis of the number of citations received per paper. It was necessary to divide the institutes into quartiles based on the number of original papers published so as to select those institutes that had published a substantial amount of work over the past 5 years rather than an institute that had only published one paper that became highly cited. Thus, the quality as well as the quantity of published original work was assessed
  • The i10 index for each institute was calculated; this denotes the number of published papers (between 2010 and 2014) that have been cited at least 10 times since publication
  • The 10 year h-index was determined for each institute using Harzing's software. [15] The h-index is the number of publications (P) receiving at least P citations each from among papers published in the past 10 years (Np ).

 » Results Top

All results are current as of January 2015. A total of 223 neurology residency spots were available in 2014; these were distributed across 92 institutes. Of these, 173 (77.5%) were DM seats and 32.5% were DNB seats. 239 neurosurgery residency spots were available in 100 institutes as of 2014; 200 of these were MCh seats (83.7%) and the remainder, DNB seats. The distribution of these seats between the government and private sector is displayed in [Table 1].
Table 1: The distribution of clinical neuroscience residency spots between the government and private sectors in India (as of December 2014)

Click here to view

Institutes running neurology residency programs

A total of 1911 papers had been published by neurology teaching institutes in PubMed indexed journals during the 5-year period 2010-2014 (both inclusive). The mean number of publications/institute/year was 4.2 (±10.11); the median was 0.8 papers/institute/year. The average number of papers published by government institutes each year (8.16 ± 14.5) was significantly higher than the number published by private institutes (1.22 ± 1.66) (t = 2.97, P < 0.001). The mean publications/institute/year for DM programs was 5.93 (±11.99) and for DNB neurology programs was 0.69 (±0.81); this difference was significant as well (t = 3.398, P = 0.0012). The mean faculty: annual resident intake ratio for institutes running DM programs was 2.09 (±1.45) and that for institutes running DNB programs was 3.76 (±2.27); this difference was significant on an independent samples t-test (t = −0.371, P = 0.002).

Six of the 39 government institutes (15.38%) and 16 of the 53 private institutions (30.02%) had not published any papers in the past 5 years (z = 1.6, P = 0.05). Assuming that the current intake of residents had remained stable over the past 5 years, 13% of all neurology residents have either graduated from or are currently pursuing residency in institutes that have not published any papers since 2010. The top 5 institutes with the highest overall number of publications (forming 5.5% of the 91 neurology teaching programs) had contributed 55.67% of all neurology papers and 69% of all original articles published over the past 5 years [Table 2]. The teaching institutes were ranked both on the basis of total publications over the past 5 years and the number of original papers published; National Institute of Mental Health and Neuro Sciences (NIMHANS) topped the ranking in both these rank lists [Table 2].
Table 2: Overall publication performance of neurology teaching institutions

Click here to view

The ratio of the number of papers published per year by an institute to the faculty strength of the institute was computed. On this basis, the highest ranked institutes were PGIMER Chandigarh, SGPGI Lucknow, and AIIMS New Delhi. It should, however, be noted that this ratio does not exactly denote the publication/research output of an individual faculty member. This is because a single research project and thus, paper, may have involved more than one faculty member. However, in this analysis, each paper was only counted once. The annual publication output correlated with the number of faculty members for government institutes, but not for private institutions. The institute NPP was calculated by comparing the annual publication performance of each institute with the national average (vide supra). Based on this calculation, NIMHANS received an NPP score of 12.86 - implying that the publication performance of this institute was 1286% better than the national average.

The ranking of neurology training institutes based on the number of citations received by all papers published over the past 5 years is displayed in [Table 3]. Here AIIMS topped the list, followed by NIMHANS and SGPGI, Lucknow. The quality of original work was determined by assessing the cites per original paper for the institutes in the highest publishing quartile. In the 5 years studied, 902 original neurology papers had been published, receiving 6612 citations (median 2.2 cites/paper). On this basis, the top ranked institute was Jawaharlal Nehru Medical College, Belgaum (14.5 cites/paper, 8 papers), followed by NIMS, Hyderabad (64 papers, 14.47 cites/paper) [Table 3]. When ranked by the 5 year i10 index, NIMHANS topped this list, followed by AIIMS and SGPGI. When papers published over the past 10 years were considered and the 10 year h-index was computed, the highest ranked institute was AIIMS (h-index = 58), followed by SGPGI (h-index = 52).
Table 3: Citation performance of the neurology training institutes in India

Click here to view

Institutes running neurosurgery residency programs

The 100 neurosurgery training institutes had published 1639 papers over the past 5 years. The mean number of papers/institute/year was 3.28 ± 8.22; the median was 0.2. The mean publications/institute/year was significantly higher for MCh training institutes (4.16 ± 9.5) than for DNB training centers (1.22 ± 3.05) (t = 2.33, P = 0.021). The government institutes had a higher mean annual publication rate (5.28 ± 0.27) than the private institutions (1.43 ± 3.66) (t = 7.63, P < 0.0001). However, the faculty: resident intake ratio in private institutions (3.55 ± 2.38) was significantly higher than that in government institutes (2.08 ± 1.18) (t = −3.9, P < 0.001). Eighteen of 49 government institutes (36.7%) and 25 out of 52 private institutes (48.07%) had not published any papers in the past 5 years. Thus, approximately 30.9% of residents who have graduated in the past 5 years or are currently pursuing their residency are doing so in institutes that have not published any papers in the past 5 years. This is a much higher proportion than for neurology residency programs (z = 4.6, P < 0.001).

The 5 institutes with the highest number of publications in the past 5 years (forming 5% of 100 institutes) had contributed 53.3% of all papers published in the past 5 years and 70.1% of all original neurosurgical papers published by training institutes. This is an even greater degree of clustering than for neurology training programs [Table 4]. When ranked by the total number of publications over the past 5 years, the top 3 institutes were AIIMS, PGIMER (Chandigarh), and NIMHANS. When ranked by the number of original articles published over the past 5 years, the top 3 institutes were NIMHANS, AIIMS, and PGIMER (Chandigarh).
Table 4: Overall publication performance of neurosurgery teaching institutions

Click here to view

The mean annual number of publications per institute to faculty strength ratio in the neurosurgery group was 0.57 ± 1.12; the median was 0.067. This ratio does not reflect the actual productivity of each individual faculty member but attempts to depict the relationship between the faculty strength and output of an institute. The publications/year for each institute were normalized against the mean of the group as described. This data are presented in [Table 4]. AIIMS received an NPP score of 11.39 (i.e. 1139% more papers published than the average performance for India).

The ranking of neurosurgery training institutes based on the number of citations received by all papers published over the past 5 years is displayed in [Table 5]. NIMHANS, Seth GS Medical College, and AIIMS topped the list. The quality of original work was determined by assessing the cites per paper for the highest publishing quartile. On this basis, the top ranked institute was the Seth GS Medical College (10.11 cites/paper, 36 papers) [Table 5]. The 5 year i10 rank list was topped by NIMHANS (i10 = 22). On the basis of the 10 years h-index, the highest ranked institutes were AIIMS and SGPGI (h-index = 42 for both).
Table 5: Citation performance of the neurosurgery training institutes in India

Click here to view

 » Discussion Top

Publication of a paper is the final stage in the cycle of scientific research. Thus, the number of publications can act as a surrogate marker of the quantity of research being performed in an institute. The quality of research would be denoted by the number of citations that a paper receives. Citations received by a paper are dependent on how useful the paper is to other researchers in the field. [16] Publications and citation metrics have, therefore, routinely been used to evaluate and rank the performance of institutes. [7],[8]

Residency programs are aimed at helping the trainee acquire core competence across several domains. Indubitably, the most important of these would pertain to patient care and management. However, across medical specialties, and especially in the neurosciences, research and publication are imperatives for scientific progress. A recent study found that India ranked 21 st in the neuroscience research output globally. [17] Indian neuroscience papers were also less cited than those from other developing countries. Thus, there is a need to augment the quantity and quality of neuroscience research in India. This is the mandate of academic and teaching institutes. There is, thus, an imperative need to train neuroscience scholars and residents more rigorously in the domains of scientific research and writing.

Exposure to the process of writing and publishing a paper has several benefits for residency trainees. Publication of an original paper by a resident indicates exposure to the entire process of hypothesis formulation, data collection, statistical analysis, and publication. Even the publication of a case report or case series confers significant educational benefits. Publishing a clinical paper involves recognition of the rarity of a finding or the determination of a significant result, thus mandating a sound theoretical knowledge of the subject. Performing a literature search further augments the trainee's knowledge of the subject. The entire process thus creates and fosters the ability to effectively communicate technical data. Studies have shown that residents who have been exposed to scientific research and paper writing during their residency are more likely to opt for careers in academic institutes as well as more likely to do research on their own. [4],[18] This would obviously lead to the evolution of clinician-scientists and have a salutary effect on the development of translational research in India.

It is interesting to note that although the faculty-to-annual resident intake ratio was statistically higher in the DNB programs than in DM Neurology and MCh Neurosurgery programs, the research and publication output were higher in the DM and MCh groups. Moreover, faculty strength correlated with publication output only in government institutes and not in the privately managed institutes. This situation needs to be pondered upon and measures to translate faculty numbers into adequate research and publication output need to be instituted.

Several separate evaluations are possible based on the data generated in this paper. The first is the total number of papers published over the past 5 years. This statistic would give a rough indicator of the quantity of clinical and research work being performed in that institute and by extension, reflect the exposure of residents to these domains. The second evaluation is the number of citations that all papers published from that institute have received over the past 5 years. This figure reflects the visibility and utility of the work done by the center to other institutes. Next, the ratio of papers published to faculty strength would indicate faculty productivity. However, several research projects and papers would have more than one faculty member involved - thus, this ratio merely denotes the relationship between faculty strength and output of an institute. The annual resident intake would obviously influence the publication and research output of an institute. However, the factors that determine resident intake in the government and private sectors vary and may not truly reflect the workload in that department. The faculty strength is more likely to reflect the workload of a department. A comparison of the annual output of each institute with the national average is rendered possible using the NPP [Table 2] and [Table 5]. The quality of original work is reflected by the cites/original paper. Standard metrics such as the 5 years i10 index and 10 years h-index reflect a combination of the quality and quantity of work emanating from an institute. The summary of the institute rankings on these bases is displayed in [Table 6].
Table 6: Integrated rankings of institutes

Click here to view

Of significant concern is the fact that 13% of neurology residents and possibly 30.9% of neurosurgery residents have graduated from or are training in institutes that have published no papers in the past 5 years. The several benefits that accrue from such exposure during the period of residency remain unfulfilled for these residents. [4],[6],[18] Serious thought is required to determine the means to ensure that these residents acquire these skills. Most institutes conduct intra-mural training programs on scientific writing and statistical methods for residents. In order to cater to those residents training in institutes which do not conduct such training sessions, the Neurological Society of India could conduct periodic training programs on research methodology, statistics, critical appraisal of evidence, scientific writing, etc., These could also be held on the sidelines of all national conferences so that residents could attend the conference as well as the workshops. It could be made mandatory by the MCI and NBE for all neurology and neurosurgery residents to have published at least one paper before they are permitted to appear for their summative exam. Publication performance and research output could also be evaluated as mandatory components while granting recognition to institutes to run neurology and neurosurgery training programs. A mandatory long extra-mural posting for residents (lasting possibly 3-4 months) would offer the possibility for residents to work in institutes that have active research programs.

Limitations of the study

The major limitation of this study was that the data regarding the faculty strength was obtained from the websites of the individual institutes. This data were possibly incomplete and thus the publications: faculty ratios presented here are approximations at best. The other limitation was that owing to the rigorous nature of the search strategy, only the 5 years publication output could be analyzed. This analysis was based on the current faculty strength, resident intake, and recognition status. It was assumed that this had remained largely unchanged over the past 5 years. However, it was felt that it would be inappropriate to extrapolate this data to the past 10 years. However, the 5 years i10 index and 10 years h-index were calculated to reflect institutional performance over the past 5 and 10 years. These rank lists differ only slightly from each other; the top 10 institutes are identical [Table 6]. Another problem was the manner in which institutional affiliations were listed by authors in papers. Some institutes were listed in as many as 7 different ways - this would obviously lead to papers being missed when institutional performance metrics are calculated. It would be desirable, therefore, for each institute to impose a uniform style for listing the affiliation in all papers.

 » Acknowledgments Top

I would like to gratefully acknowledge all the logistic support rendered by Dr. Amrutha Bindu Nagella (Assistant Professor of Anesthesiology and Critical Care, Mahatma Gandhi Medical College and Research Institute, Pondicherry) and Mr. V Subeikshanan (4 th Semester MBBS student, JIPMER, Pondicherry).

 » References Top

Nadkarni TD, Goel A, Pandya SK. Neurosurgery in India. J Postgrad Med 2002;48:332-5.  Back to cited text no. 1
[PUBMED]  Medknow Journal  
Nanda A, Sonig A. Neurosurgical training in India. World Neurosurg 2013;79:615-20.  Back to cited text no. 2
Malik MU, Diaz Voss Varela DA, Stewart CM, Laeeq K, Yenokyan G, Francis HW, et al. Barriers to implementing the ACGME outcome project: A systematic review of program director surveys. J Grad Med Educ 2012;4:425-33.  Back to cited text no. 3
Gast KM, Kuzon WM Jr, Adelman EE, Waljee JF. Influence of training institution on academic affiliation and productivity among plastic surgery faculty in the United States. Plast Reconstr Surg 2014;134:570-8.  Back to cited text no. 4
Gautam G. The current three-year postgraduate program in urology is insufficient to train a urologist. Indian J Urol 2008;24:336-8.  Back to cited text no. 5
[PUBMED]  Medknow Journal  
Gupta A, Kumar S, Kumar S, Mishra MC, Kumar S. Surgical residency programme: Training, teaching, and evaluation in general surgery - A peer opinion poll in five medical colleges in northern India. Indian J Surg 2006;68:6.  Back to cited text no. 6
Aquino LL, Wen G, Wu JJ. US dermatology residency program rankings. Cutis 2014;94:189-94.  Back to cited text no. 7
Ponce FA, Lozano AM. Academic impact and rankings of American and Canadian neurosurgical departments as assessed using the h index. J Neurosurg 2010;113:447-57.  Back to cited text no. 8
Nath NC, Bhadra UK. Medical education reform in India - Problems and prospects. J Indian Med Assoc 2011;109:156-7.  Back to cited text no. 9
Man JP, Weinkauf JG, Tsang M, Sin DD. Why do some countries publish more than others? An international comparison of research funding, English proficiency and publication output in highly ranked general medical journals. Eur J Epidemiol 2004;19:811-7.  Back to cited text no. 10
India′s Best Colleges-2014. The Annual Survey from India Today and the Nielson Company; 2014. Available from: and Y=2014. [Last accessed on 2014 Dec 29].  Back to cited text no. 11
Prathap G, Gupta BM. Ranking of Indian medical colleges for their research performance during 1999-2008. Ann Libr Inf Stud 2011;58:8.  Back to cited text no. 12
(US) NLoM. PubMed Health; 2014. Available from: [Last accessed on 2014 Dec 30].  Back to cited text no. 13
Madhugiri VS, Sasidharan GM, Subeikshanan V, Dutt A, Ambekar S, Strom SF. An analysis of the citation climate in neurosurgical literature and description of an interfield citation metric. Neurosurgery 2015;76:505-13.  Back to cited text no. 14
Harzing AW. Publish or Perish; 2007. Available from:  Back to cited text no. 15
Van Noorden R, Maher B, Nuzzo R. The top 100 papers. Nature 2014;514:550-3.  Back to cited text no. 16
Bala A, Gupta BM. Mapping of Indian neuroscience research: A scientometric analysis of research output during 1999-2008. Neurol India 2010;58:35-41.  Back to cited text no. 17
[PUBMED]  Medknow Journal  
Cull WL, Yudkowsky BK, Schonfeld DJ, Berkowitz CD, Pan RJ. Research exposure during pediatric residency: Influence on career expectations. J Pediatr 2003;143:564-9.  Back to cited text no. 18


  [Table 1], [Table 2], [Table 3], [Table 4], [Table 5], [Table 6]

This article has been cited by
1 Quantitative research on traumatic brain injury in India: The travails and the new optimism
VirendraDeo Sinha,Amit Chakrabarty
Neurology India. 2017; 65(2): 261
[Pubmed] | [DOI]


Print this article  Email this article
Online since 20th March '04
Published by Wolters Kluwer - Medknow