Performance Benchmarks for Scholarly Metrics Associated with Fisheries and Wildlife Faculty.
Research productivity and impact are often considered in professional evaluations of academics, and performance metrics based on publications and citations increasingly are used in such evaluations. To promote evidence-based and informed use of these metrics, we collected publication and citation da...
Saved in:
| Main Authors: | , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Public Library of Science (PLoS)
2016-01-01
|
| Series: | PLoS ONE |
| Online Access: | https://doi.org/10.1371/journal.pone.0155097 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1839614099503185920 |
|---|---|
| author | Robert K Swihart Mekala Sundaram Tomas O Höök J Andrew DeWoody Kenneth F Kellner |
| author_facet | Robert K Swihart Mekala Sundaram Tomas O Höök J Andrew DeWoody Kenneth F Kellner |
| author_sort | Robert K Swihart |
| collection | DOAJ |
| description | Research productivity and impact are often considered in professional evaluations of academics, and performance metrics based on publications and citations increasingly are used in such evaluations. To promote evidence-based and informed use of these metrics, we collected publication and citation data for 437 tenure-track faculty members at 33 research-extensive universities in the United States belonging to the National Association of University Fisheries and Wildlife Programs. For each faculty member, we computed 8 commonly used performance metrics based on numbers of publications and citations, and recorded covariates including academic age (time since Ph.D.), sex, percentage of appointment devoted to research, and the sub-disciplinary research focus. Standardized deviance residuals from regression models were used to compare faculty after accounting for variation in performance due to these covariates. We also aggregated residuals to enable comparison across universities. Finally, we tested for temporal trends in citation practices to assess whether the "law of constant ratios", used to enable comparison of performance metrics between disciplines that differ in citation and publication practices, applied to fisheries and wildlife sub-disciplines when mapped to Web of Science Journal Citation Report categories. Our regression models reduced deviance by ¼ to ½. Standardized residuals for each faculty member, when combined across metrics as a simple average or weighted via factor analysis, produced similar results in terms of performance based on percentile rankings. Significant variation was observed in scholarly performance across universities, after accounting for the influence of covariates. In contrast to findings for other disciplines, normalized citation ratios for fisheries and wildlife sub-disciplines increased across years. Increases were comparable for all sub-disciplines except ecology. We discuss the advantages and limitations of our methods, illustrate their use when applied to new data, and suggest future improvements. Our benchmarking approach may provide a useful tool to augment detailed, qualitative assessment of performance. |
| format | Article |
| id | doaj-art-daf9a8e176a7400ca44b44ec69610c05 |
| institution | Matheson Library |
| issn | 1932-6203 |
| language | English |
| publishDate | 2016-01-01 |
| publisher | Public Library of Science (PLoS) |
| record_format | Article |
| series | PLoS ONE |
| spelling | doaj-art-daf9a8e176a7400ca44b44ec69610c052025-07-26T05:31:08ZengPublic Library of Science (PLoS)PLoS ONE1932-62032016-01-01115e015509710.1371/journal.pone.0155097Performance Benchmarks for Scholarly Metrics Associated with Fisheries and Wildlife Faculty.Robert K SwihartMekala SundaramTomas O HöökJ Andrew DeWoodyKenneth F KellnerResearch productivity and impact are often considered in professional evaluations of academics, and performance metrics based on publications and citations increasingly are used in such evaluations. To promote evidence-based and informed use of these metrics, we collected publication and citation data for 437 tenure-track faculty members at 33 research-extensive universities in the United States belonging to the National Association of University Fisheries and Wildlife Programs. For each faculty member, we computed 8 commonly used performance metrics based on numbers of publications and citations, and recorded covariates including academic age (time since Ph.D.), sex, percentage of appointment devoted to research, and the sub-disciplinary research focus. Standardized deviance residuals from regression models were used to compare faculty after accounting for variation in performance due to these covariates. We also aggregated residuals to enable comparison across universities. Finally, we tested for temporal trends in citation practices to assess whether the "law of constant ratios", used to enable comparison of performance metrics between disciplines that differ in citation and publication practices, applied to fisheries and wildlife sub-disciplines when mapped to Web of Science Journal Citation Report categories. Our regression models reduced deviance by ¼ to ½. Standardized residuals for each faculty member, when combined across metrics as a simple average or weighted via factor analysis, produced similar results in terms of performance based on percentile rankings. Significant variation was observed in scholarly performance across universities, after accounting for the influence of covariates. In contrast to findings for other disciplines, normalized citation ratios for fisheries and wildlife sub-disciplines increased across years. Increases were comparable for all sub-disciplines except ecology. We discuss the advantages and limitations of our methods, illustrate their use when applied to new data, and suggest future improvements. Our benchmarking approach may provide a useful tool to augment detailed, qualitative assessment of performance.https://doi.org/10.1371/journal.pone.0155097 |
| spellingShingle | Robert K Swihart Mekala Sundaram Tomas O Höök J Andrew DeWoody Kenneth F Kellner Performance Benchmarks for Scholarly Metrics Associated with Fisheries and Wildlife Faculty. PLoS ONE |
| title | Performance Benchmarks for Scholarly Metrics Associated with Fisheries and Wildlife Faculty. |
| title_full | Performance Benchmarks for Scholarly Metrics Associated with Fisheries and Wildlife Faculty. |
| title_fullStr | Performance Benchmarks for Scholarly Metrics Associated with Fisheries and Wildlife Faculty. |
| title_full_unstemmed | Performance Benchmarks for Scholarly Metrics Associated with Fisheries and Wildlife Faculty. |
| title_short | Performance Benchmarks for Scholarly Metrics Associated with Fisheries and Wildlife Faculty. |
| title_sort | performance benchmarks for scholarly metrics associated with fisheries and wildlife faculty |
| url | https://doi.org/10.1371/journal.pone.0155097 |
| work_keys_str_mv | AT robertkswihart performancebenchmarksforscholarlymetricsassociatedwithfisheriesandwildlifefaculty AT mekalasundaram performancebenchmarksforscholarlymetricsassociatedwithfisheriesandwildlifefaculty AT tomasohook performancebenchmarksforscholarlymetricsassociatedwithfisheriesandwildlifefaculty AT jandrewdewoody performancebenchmarksforscholarlymetricsassociatedwithfisheriesandwildlifefaculty AT kennethfkellner performancebenchmarksforscholarlymetricsassociatedwithfisheriesandwildlifefaculty |