|
|
Social impact assessment of science achievements based on international experiences |
FAN Yingjie1,2,3, XU Fang1,3 |
1. School of Public Policy and Management of University of Chinese Academy of Sciences, Beijing 100090, China;
2. Bureau of International Cooperation, National Natural Science Foundation of China, Beijing 100080, China;
3. Institutes of Science and Development, Chinese Academy of Sciences, Beijing 100190, China |
|
|
Abstract: The evaluation of the social impact of science achievements funded by the government can be considered as a breakthrough point in the reform of China's science and technology system. Besides, it is also an inevitable step to carry out the strategy of China's innovation-driven development. The lessons drawn from the evaluation activities in western countries can be a useful guidance. The paper focuses on three typical systems, the UK's Research Excellence Framework (REF) for assessing the excellence of researches in higher education institutions, the Standard Evaluation Protocol (SEP), which is used to assess researches conducted by Dutch universities and NWO and academy institutes, and the USA's STAR METRICS for creating a repository of data and tools, that will be useful to assess the impact of federal R&D investments. This paper analyzes the evaluation unit, the processes, and the objectives of the above three systems, as well as their differences, focusing on the indicators that define the social impact and the methods to realize the evaluation. Based on this analysis, it is concluded that the social impact evaluation should be at the core of the performance evaluation of public scientific research institutions in China. Following the experience of the UK's REF system, the national strategies, the differences between institutions and disciplines, as well as the regional divergence should be taken into account when developing the indicators of social impacts and the corresponding measurements in China. To facilitate the system operation, it is necessary to create a searchable database of scientific researches funded by national agencies.
|
Received: 12 January 2019
|
|
|
|
[1] 徐芳, 刘文斌, 李晓轩. 英国REF科研影响力评价的方法及启示[J]. 科学学与科学技术管理, 2014, 35(7):9-15. Xu Fang, Liu Wenbin, Li Xiaoxuan. The method and enlightenment of REF scientific research impact assessment in UK[J]. Science of Science and Management of S. & T., 2014, 35(7):9-15.
[2] VSNU,KNAW and NWO. Standard evaluation protocol 2015-2021:Protocol for research assessments in the Netherlands[EB/OL]. (2014-03-21)[2019-03-14] https://www.knaw.nl/en/news/publications/standard-evaluation-protocol-2015-2013-2021?set_language=en.
[3] Australian Research Council. Australian research council corporate plan 2015-16 to 2018-19[R]. Canberra:Commonwealth of Australia, 2015.
[4] 汪雪锋, 张硕, 刘玉琴, 等. 中国科技评价研究40年:历史演进及主题演化[J]. 科学学与科学技术管理, 2018, 39(12):67-80. Wang Xuefeng, Zhang Shuo, Liu yuqin, et al. Forty years of research on science and technology evaluation in china:Historical and theme evolution[J]. Science of Science and Management of S.& T., 2018, 39(12):67-80.
[5] 陈兆莹. 关于科技评价和科技评价改革的讨论[J]. 科学通报, 2018, 63(7):611-617. Chen Zhaoying. Reflections on science and technology evaluation in China[J]. Chinese Science Bulletin, 2018, 63(7):611-617.
[6] David C, Ian M C, Molly M J, et al. Making the Grade:Methodologies for assessing and evidencing research impact[EB/OL]. (2013-01-01)[2019-03-15]. https://www.exeter.ac.uk/media/universityofexeter/research/ourresearchexcellence/describeproject/pdfs/2013_06_04_7_Essays_on_Impact_FINAL.pdf.
[7] Stand Up for Research of University and College Union[EB/OL]. (2009-10-16)[2019-03-12]. http://www.ucu.org.uk/events.
[8] Meulen B V D, Daemen F, Drooge L V, et al. Evaluating Research in Context:Pilot Study at Faculty of Architecture TU Delft[EB/OL]. (2010-03-01)[2019-03-15]. https://repository.tudelft.nl/islandora/object/uuid:f0a713f1-1564-4b79-be66-4f5299ebba2c?collection=research.
[9] Van d M B, Rip A. Evaluation of societal quality of public sector research in the Netherlands[J]. Research Evaluation, 2000, 9(1):11-25.
[10] Catriona M, Molly M J, Michael F. et al. Preparing impact submissions for REF 2014:An evaluation[EB/OL]. (2015-03-25)[2019-03-15]. https://www.rand.org/pubs/research_briefs/RB9833.html.
[11] King's College London and Digital Science. The nature, scale and beneficiaries of research impact:An initial analysis of Research Excellence Framework (REF) 2014 impact case studies[J]. Revista Da Sociedade Brasileira De Medicina Tropical2015, 41(1):27-33. |
[1] |
LIU Tonglin, TU Zhenbiao, ZHANG Hu, LÜ Yuanjian. Evaluation method of equipment system contribution based on envelope analysis[J]. Science & Technology Review, 2018, 36(24): 44-47. |
[2] |
LI Xiaohui, HE Defang, PENG Jie. Technology transfer mode in Japanese universities and its enlightenment[J]. Science & Technology Review, 2018, 36(2): 8-12. |
[3] |
LI Xiaohui, HE Defang, PENG Jie. The US policies for promoting technology transfer[J]. Science & Technology Review, 2016, 34(23): 137-142. |
[4] |
. Evaluation of Anti-tactical Ballistic Missile Operation[J]. , 2009, 27(0924): 76-80. |
|
|
|
|