Research impact "metric tide" and the assessment of quality of research
- Speaker: Professor Boris Mirkin
- DCS Birkbeck London and FCS NRU Higher School of Economics Moscow
- Date: Wednesday, 2 December 2015 from 16:00 to 17:00
- Location: Malet 151
Because of the current globalization processes, both in geography and in occupation, one should recognise that the metric tide in assessment of research impact, by both governments and public at large, is not entirely unreasonable. This talk goes in line with the DORA initiative that there should be products of researcher's work assessed directly rather than citation and other metrics the relevance of which can be debatable at times. We tackle the most difficult issue: assessment of quality of research results. We propose doing that over a well established domain taxonomy so that the quality of a research result is judged by the rank of the taxon that has been created or drastically affected by the result. This line of thinking and an in-house method for aggregating ranking criteria are applied to a sample of scientists in data analysis/machine learning domain.
1. The Metric Tide: Report of the Independent Review of the Role of Metrics in Research Assessment and Management, July 2015, http://www.hefce.ac.uk/pubs/rereports/Year/2015/metrictide/.
2. B. Mirkin, M. Orlov (2014) RESEARCH IMPACT: LEVEL OF RESULTS, CITATION, MERIT. Working Paper WP7/2014/09, http://www.hse.ru/data/2014/12/02/1104478267/WP7_2014_09_F.pdf, NRU HSE, Moscow RF.