Skip to main content
  • Research article
  • Open access
  • Published:

Research productivity across different ophthalmic subspecialties in the United States

Abstract

Background

The purpose of this study was to compare the h-index, and subsequently the research productivity, among different ophthalmic subspecialties in the United States.

Methods

A cohort of over 15,000 academic ophthalmologists residing in the United States (US) was identified out of the physician list of the American Academy of Ophthalmology. Of them, 1000 ophthalmologists with at least one publication were randomly retrieved, 100 in each of the following 10 subspecialties: cataract, cornea/external disease, glaucoma, medical retina, neuro-ophthalmology, pediatric ophthalmology, plastic/reconstructive ophthalmology, refractive surgery, retina/vitreous surgery and uveitis. Data collected included: number of published papers, h-index score, annual increase in h-index and the mean number of authors on each paper.

Results

The mean h-index amongst all subspecialties was 9.87 ± 13.90, and the mean average annual increase in h-index was 0.22 ± 0.21. The mean number of papers published was 37.20 ± 80.08 and the mean number of authors on each paper was 3.39 ± 0.84. Uveitis was the most prolific subspecialty in mean number of papers (74.78 ± 131.37), in mean h-index (16.69 ± 20.00) and in mean annual increase in h-index (0.35 ± 0.28). The least fertile subspecialty with regards to research was cataract with 11.06 ± 27.65 mean number of papers, a mean h-index of 3.89 ± 5.84, and a mean annual increase in h-index of 0.11 ± 0.11.

Conclusions

This study describes the research productivity in each ophthalmic subspecialty in the US, thus providing information on the research performance of each field and on the expected academic accomplishments within it.

Peer Review reports

Background

The h-index was introduced in 2005 by prof. J.E. Hirsch to quantify the importance, significance and broad impact of a scientist’s cumulative research contribution [1]. The h-index reflects the number h of papers a researcher is a co-author on, each of which has been cited at least h times in other papers. Today it is widely accepted as the standard of scientometrics of an individuals’ research impact, and was further tailored to predict young scientists’ potential [2]. Furthermore, the h-index is used as an assessment tool in many universities and academic medical centers by committees for recruitment, promotion, tenure and awarding of grants. Its application in medicine has been recently explored in various specialties [3,4,5,6,7,8,9,10,11,12].

Ophthalmology encompasses a variety of activities which a physician can engage in: clinical medical care, surgical care, teaching and research. Ophthalmology residents interested in an academic career should be given the opportunity to get accurate information about the potential for research advancement and academic promotion of a given subspecialty they consider to fellow in. As there is a proven correlation between h-index, academic rank and grant funding [3, 4, 7, 11, 13,14,15,16,17,18,19], knowledge of the mean h-index in each field in ophthalmology and thus of the possibility of expected academic accomplishments might be factored in their decision-making process.

The purpose of this study was to describe and compare the research productivity (as measured by the proxy h-index) of various ophthalmic subspecialties in the United States (US). We hypothesized that authors from various sub-specialties of ophthalmology have different h-indices. It was also to try and determine the factors possibly associated with the h-index such as authors’ gender, total number of published papers, total number of citations, annual increase in h-index and number of authors on each paper. A last purpose was to determine the annual increase in h-index and the factors related to it.

Methods

Data acquisition

A study cohort of over 15,000 ophthalmologists residing in the US was identified out of the physician list of the American Academy of Ophthalmology. Each ophthalmologist was assigned a subspecialty, as recorded on the American Academy of Ophthalmology website (www.aao.org, accessed: December 4, 2018). Out of this cohort, 100 ophthalmologists were chosen in each one of the following 10 subspecialties: cataract, cornea/external disease, glaucoma, medical retina, neuro-ophthalmology, pediatric ophthalmology, plastic/reconstructive ophthalmology, refractive surgery, retina/vitreous surgery and uveitis. A random drown of ophthalmologists within each subspecialty, using random number allocating, was performed. In order to be chosen for the study, each ophthalmologist had to be one with at least one scientific publication. Ophthalmologists with no publications were excluded. Data collection was stopped once reaching a list of 100 ophthalmologists within each subspecialty. Overall, we retrieved 1000 ophthalmologists for this study.

Data were collected using Harzing, A.W. (2007) Publish or Perish (www.harzing.com, London. United Kingdom) on December 2018, and were incorporated into an Excel spreadsheet (Microsoft, Inc., Seattle, WA). The authors’ gender was obtained through a series of quests utilizing the Google search engine. The authors’ names were combined with their sub specialty, while relying on an official source (Hospital profile, Private website, Advertisement with a photograph, etc.), and their gender was recorded.

Study variables

The primary outcome was to describe the research productivity by using the h-index, across the above-mentioned various ophthalmic subspecialties in the United States. Other variables which were collected included: total number of published papers, total number of citations, annual increase in h-index, number of authors on each paper and the gender of the ophthalmologists who were retrieved.

Statistical analysis

Data were analyzed using the SPSS statistical software version 23.0 (SPSS, Cary, NC, US). Data are expressed as mean ± SD. Statistical differences between groups were tested using a one-way analysis of variance (ANOVA) for normally distributed data and the Kruskal-Wallis test for non-normally distributed data. The Bonferroni correction was applied for multiple comparisons. The Pearson correlation was used to analyze the relationship between h-index and the number of citations, the number of authors per paper and the number of papers. A P-value of less than 0.05 was considered statistically significant.

Results

Figure 1 depicts the frequency of the h-index score in the entire cohort. Figure 2 presents the mean h-index in each subspecialty. The mean h-index among all subspecialties was 9.87 ± 13.90 (Table 1). The mean number of papers published in the entire study group was 37.20 ± 80.08 and the mean number of authors on each paper was 3.39 ± 0.84 (Table 1). Figure 3 shows the mean number of papers an author published in each subspecialty. The mean average annual increase in h-index was 0.22 ± 0.21 (Table 1) and is shown for each subspecialty in Fig. 4.

Fig. 1
figure 1

The h-index score histogram of the entire cohort

Fig. 2
figure 2

The h-index score in each of the 10 ophthalmology subspecialties

Table 1 Research productivity comparison of ophthalmic subspecialties
Fig. 3
figure 3

Number of articles for each of the 10 ophthalmology subspecialties

Fig. 4
figure 4

Average annual increase in the individual h-index score for each of the 10 ophthalmology subspecialties

Uveitis was, the most prolific subspecialty in mean number of papers (74.78 ± 131.37, P < 0.001), in mean h-index (16.69 ± 20.00, P < 0.001) and in mean annual increase in h-index (0.35 ± 0.28, P < 0.001). The least fertile subspecialty with regards to research was cataract with a mean number of papers of 11.06 ± 27.65 and a mean h-index of 3.89 ± 5.84.

The mean number of authors on each paper ranged between 3.08 and 3.62 and was not found to be correlated with the h-index score (r = 0.083, P = 0.008). As expected, a significant high correlation was found between the number of papers published and the h-index score (r = 0.898, P < 0.001, Fig. 5), and between the number of citations and the h-index score (r = 0.893, P < 0.001, Fig. 6).

Fig. 5
figure 5

Correlation between the number of papers and the h-index

Fig. 6
figure 6

Correlation between the number of citations and the h-index

The gender distribution of the ophthalmologists retrieved in each subspecialty is presented in Fig. 7. Figure 8 and Table 2 present a comparison of the mean h-index between genders in each individual ophthalmology subspecialty. In a comparison between genders in the entire cohort the male ophthalmologists exhibited a significantly higher mean h-index than the female ones (10.93 and 7.15, respectively, P < 0.001). There was a trend to higher mean h-index in males than in females in all subspecialties, which reached statistical significance in the fields of cornea/external disease, glaucoma, neuro-ophthalmology and pediatric ophthalmology (Table 2).

Fig. 7
figure 7

Distribution of genders in each of the 10 ophthalmology subspecialties

Fig. 8
figure 8

Comparison of the mean h-index between genders in each of the 10 ophthalmology subspecialties

Table 2 Comparison of the mean h-index between genders in each individual ophthalmology subspecialty

Discussion

The purpose of this study was to compare the h-index (a proxy measurement of research productivity) across various ophthalmology subspecialties in the United States. To the best of our knowledge, no such study has been conducted to date.

In 2005, prof. Jorge Hirsch introduced the h-index as an alternative to other scientific performance indices, such as number of publications, average number of citations and sum of all citations, in order to quantify the importance, significance and broad impact of a scientist’s cumulative research contributions [1]. The h-index reflects the number h of papers a researcher is a co-author on with at least h citations in other articles. It is widely accepted throughout the scientific community because it quantifies both the author’s scientific productivity and the cumulative impact of his work. Furthermore, Poynard et al. demonstrated that a high h-index was associated with true conclusions, methodological quality of trials and positive predictive values [20]. It has even been shown that the h-index, as a measure of scientific interest, appears to be a reflection of the true impact of human diseases in medicine [21]. In addition, not only is the h-index a score reflecting one individual’s lifetime work, but it has been further implemented to identify the research strength of institutions and to measure their academic productivity [22].

However, the h-index has its downsides as it can be inflated with self-citations [23] and may be discriminatory of epistemological beliefs and methodological preferences [24]. It can also act as a stressor and a source for burnout symptoms to young researchers who have yet to build their own, high h-index. In contrast, a high h-index may be reassuring for scientists and may become an important motivational factor for further, high quality research [25].

In this study, we compared the research productivity in 10 subspecialties of ophthalmology: cataract, cornea/external disease, glaucoma, medical retina, neuro-ophthalmology, pediatric ophthalmology, plastic/reconstructive ophthalmology, refractive surgery, retina/vitreous surgery and uveitis. The h-index score as well as the number of published papers were highest in uveitis followed by neuro-ophthalmology and medical retina. We speculate that, since these three fields are not surgical, they may grant more time to immerse in the minutiae of research. Theoretically, since these three fields complement other fields in medicine such as internal medicine and rheumatology with regards to uveitis, internal medicine with regards to medical retina and neurology and neurosurgery with regards to neuro-ophthalmology, they also might open the way to more collaboration with other practitioners, and hence more research opportunities. Against the latter theory is the lack of correlation that we found between mean number of authors and h-index. The mean h-index in uveitis was 16.69 and by comparison, in cataract the mean h-index score was 3.89 which was the lowest of all subspecialties. The other two subspecialties besides cataract with the lowest h-index, average annual increase in h-index and number of papers were pediatric ophthalmology and refractive surgery. Importantly, two of these subspecialties are essentially surgical ones, and possibly the most rewarding financially. Thus we speculate that such a financial incentive might harm academic motivation and performance. Regarding the annual increase in h-index, uveitis still ranked first with a mean increase of 0.35 to the h-index score annually and medical retina ranks second with 0.31.

Nevertheless, in terms of ophthalmology, this superiority in publication indices does not necessarily reflect medical and social impact, but only the scope of academic activity. This can be influenced by other factors, such as spare time for research, economic motives and other academic and medical disciplines. For example, as mentioned above, uveitis, medical retina and neuro-ophthalmology are all related to other medical specialties. Thus, the potential for publication and citation in these fields is beyond the bounds of ophthalmology journals; therefore, expanding academic productivity, but not representing their clinical centrality in ophthalmology.

As expected, a significant correlation was found between the number of papers and the h-index score and between the number of citations and the h-index score.

Another interesting aspect which was looked at was the gender distribution in each subspecialty. In a recent publication [26], we showed that despite an overall increase in the contribution of women to the field of ophthalmology, contributions to articles published in subspecialty ophthalmology journals and the proportion of women listed as last authors on overall articles published in ophthalmology journals are still low. In this study, we also found that that in all subspecialties there was a male predominance. In addition, the mean h-index of the male authors was significantly higher than that of the female ones in the entire cohort (Table 2), as well as in every subspecialty (Table 2, Fig. 8). Nevertheless, the recent increase in the contribution of women to the field of ophthalmology will hopefully begin to show its markings in the near future.

This study has several limitations. First, individuals in each field were chosen randomly, and even though the sample size was quite large, the samples may not be, by chance, representative of the group they were extracted from. Second, the sample included only ophthalmologists that published at least one paper. Including clinicians who have not published any papers would have lowered the study measures regarding cumulative academic contribution (mean number of published papers, mean h-index score and mean annual increase in h-index). However, the decrease in each subspecialty might have been different, and thus, possibly modifying the outcomes.

Notwithstanding its limitations, this study is the first to compare the research productivity among major subspecialties of opthalmology. It may provide young scientist in search of a fertile field of academic ophthalmology an additional tool for evaluation.

Conclusions

In this study, we described the research productivity in different ophthalmic subspecialties in the US, providing, to the best of our knowledge for the first time, valuable information on the research performance of each field and on the expected academic accomplishments within it. As evident by the average h-index score and number of publications, we have found the highest academic productivity to be in uveitis followed by neuro-ophthalmology and medical retina.

Availability of data and materials

The datasets used and/or analysed during the current study are available from the corresponding author on reasonable request.

Abbreviations

US:

United States

References

  1. Hirsch JE. An index to quantify an individual’s scientific research output. Proc Natl Acad Sci U S A. 2005;102(46):16569–72.

    Article  CAS  Google Scholar 

  2. Carbon CC. The Carbon_h-factor: predicting individuals’ research impact at early stages of their career. PLoS One. 2011;6(12):e28770.

    Article  CAS  Google Scholar 

  3. Susarla SM, Lopez J, Swanson EW, Miller D, O'Brien-Coon D, Zins JE, Serletti JM, Yaremchuk MJ, Manson PN, Gordon CR. Are quantitative measures of academic productivity correlated with academic rank in plastic surgery? A national study. Plast Reconstr Surg. 2015;136(3):613–21.

    Article  CAS  Google Scholar 

  4. Benway BM, Kalidas P, Cabello JM, Bhayani SB. Does citation analysis reveal association between h-index and academic rank in urology? Urology. 2009;74(1):30–3.

    Article  Google Scholar 

  5. Lee J, Kraus KL, Couldwell WT. Use of the h index in neurosurgery. Clinical article. J Neurosurg. 2009;111(2):387–92.

    Article  Google Scholar 

  6. Rad AE, Brinjikji W, Cloft HJ, Kallmes DF. The H-index in academic radiology. Acad Radiol. 2010;17(7):817–21.

    Article  Google Scholar 

  7. Svider PF, Choudhry ZA, Choudhry OJ, Baredes S, Liu JK, Eloy JA. The use of the h-index in academic otolaryngology. Laryngoscope. 2013;123(1):103–6.

    Article  Google Scholar 

  8. Bould MD, Boet S, Sharma B, Shin E, Barrowman NJ, Grantcharov T. H-indices in a university department of anaesthesia: an evaluation of their feasibility, reliability, and validity as an assessment of academic performance. Br J Anaesth. 2011;106(3):325–30.

    Article  CAS  Google Scholar 

  9. DeLuca LA Jr, St John A, Stolz U, Matheson L, Simpson A, Denninghoff KR. The distribution of the h-index among academic emergency physicians in the United States. Acad Emerg Med Off J Soc Acad Emerg Med. 2013;20(10):997–1003.

    Article  Google Scholar 

  10. Gast KM, Kuzon WM Jr, Adelman EE, Waljee JF. Influence of training institution on academic affiliation and productivity among plastic surgery faculty in the United States. Plast Reconstr Surg. 2014;134(3):570–8.

    Article  CAS  Google Scholar 

  11. Lopez J, Susarla SM, Swanson EW, Calotta N, Lifchez SD. The association of the H-index and academic rank among full-time academic hand surgeons affiliated with fellowship programs. J Hand Surg. 2015;40(7):1434–41.

    Article  Google Scholar 

  12. Paik AM, Mady LJ, Villanueva NL, Goljo E, Svider PF, Ciminello F, Eloy JA. Research productivity and gender disparities: a look at academic plastic surgery. J Surg Educ. 2014;71(4):593–600.

    Article  Google Scholar 

  13. Khan NR, Thompson CJ, Taylor DR, Venable GT, Wham RM, Michael LM 2nd, Klimo P Jr. An analysis of publication productivity for 1225 academic neurosurgeons and 99 departments in the United States. J Neurosurg. 2014;120(3):746–55.

    Article  Google Scholar 

  14. Babineau M, Fischer C, Volz K, Sanchez LD. Survey of publications and the H-index of academic emergency medicine professors. West J Emerg Med. 2014;15(3):290–2.

    Article  Google Scholar 

  15. Sharma B, Boet S, Grantcharov T, Shin E, Barrowman NJ, Bould MD. The h-index outperforms other bibliometrics in the assessment of research performance in general surgery: a province-wide study. Surgery. 2013;153(4):493–501.

    Article  Google Scholar 

  16. Pagel PS, Hudetz JA. An analysis of scholarly productivity in United States academic anaesthesiologists by citation bibliometrics. Anaesthesia. 2011;66(10):873–8.

    Article  CAS  Google Scholar 

  17. Spearman CM, Quigley MJ, Quigley MR, Wilberger JE. Survey of the h index for all of academic neurosurgery: another power-law phenomenon? J Neurosurg. 2010;113(5):929–33.

    Article  Google Scholar 

  18. Choi M, Holliday EB, Jagsi R, Wilson LD, Fuller CD, Thomas CR Jr. Citation-based estimation of scholarly activity among domestic academic radiation oncologists: five-year update. J Radiat Oncol. 2014;3(1):115–22.

    Article  Google Scholar 

  19. Rezek I, McDonald RJ, Kallmes DF. Is the h-index predictive of greater NIH funding success among academic radiologists? Acad Radiol. 2011;18(11):1337–40.

    Article  Google Scholar 

  20. Poynard T, Thabut D, Munteanu M, Ratziu V, Benhamou Y, Deckmyn O. Hirsch index and truth survival in clinical research. PLoS One. 2010;5(8):e12044.

    Article  Google Scholar 

  21. McIntyre KM, Hawkes I, Waret-Szkuta A, Morand S, Baylis M. The H-index as a quantitative indicator of the relative impact of human diseases. PLoS One. 2011;6(5):e19558.

    Article  CAS  Google Scholar 

  22. Turaga KK, Gamblin TC. Measuring the surgical academic output of an institution: the “institutional” H-index. J Surg Educ. 2012;69(4):499–503.

    Article  Google Scholar 

  23. Bartneck C, Kokkelmans S. Detecting h-index manipulation through self-citation analysis. Scientometrics. 2011;87(1):85–98.

    Article  Google Scholar 

  24. Ouimet M, Bedard PO, Gelineau F. Are the h-index and some of its alternatives discriminatory of epistemological beliefs and methodological preferences of faculty members? The case of social scientists in Quebec. Scientometrics. 2011;88(1):91–106.

    Article  Google Scholar 

  25. Tijdink JK, Vergouwen AC, Smulders YM. Emotional exhaustion and burnout among medical professors; a nationwide survey. BMC Med Educ. 2014;14:183.

    Article  Google Scholar 

  26. Mimouni M, Zayit-Soudry S, Segal O, Barak Y, Nemet AY, Shulman S, Geffen N. Trends in authorship of articles in major ophthalmology journals by gender, 2002-2014. Ophthalmology. 2016;123(8):1824–8.

    Article  Google Scholar 

Download references

Acknowledgements

Not applicable.

Funding

No funding was received.

Author information

Authors and Affiliations

Authors

Contributions

AG participated in the design of the study, collected the data, drafted the manuscript and read and approved the manuscript. IV participated in the design of the study, performed the statistical analysis, made revisions to the manuscript and read and approved the manuscript. OR collected the data, performed the statistical analysis, made revisions to the manuscript and read and approved the manuscript. FBM participated in the design of the study, helped to analyze the results, made revisions to the manuscript and read and approved the manuscript. EL participated in the design of the study, helped to analyze the results, made revisions to the manuscript and read and approved the manuscript. EZB participated in the design of the study, helped to analyze the results, made revisions to the manuscript and read and approved the manuscript. RE collected the data, helped to analyze the results, made revisions to the manuscript and read and approved the manuscript. MM conceived of the study, participated in its design and coordination, helped to draft the manuscript and read and approved the manuscript.

Corresponding author

Correspondence to Assaf Gershoni.

Ethics declarations

Ethics approval and consent to participate

Not applicable.

Consent for publication

Not applicable.

Competing interests

The authors declare that they have no competing interests.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Gershoni, A., Vainer, I., Reitblat, O. et al. Research productivity across different ophthalmic subspecialties in the United States. BMC Health Serv Res 19, 778 (2019). https://doi.org/10.1186/s12913-019-4590-3

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12913-019-4590-3

Keywords