طراحی چارچوب ارزیابی مأموریت‌گرا برای مؤسسه‌های سیاست‌پژوه

نوع مقاله : مقاله پژوهشی

نویسندگان

1 استادیار گروه ارزیابی سیاست‌ها و پایش علم،‌ فناوری و نوآوری، مرکز تحقیقات سیاست علمی کشور، تهران، ایران

2 عضو هیئت علمی / مرکز تحقیقات سیاست علمی کشور

3 کارشناسی ارشد، کارشناس پژوهشی مرکز تحقیقات سیاست علمی کشور، تهران، ایران

چکیده

در دهه‌های اخیر، الزام و ارزش نقش‌آفرینی پژوهشهای کاربردی در هدایت و اثربخشی تصمیمهای سیاستی برای سیاستگذاران مسجّل شده؛ به‌گونه‌ای که به منظور بهره‌گیری از نظرات کارشناسی در تشخیص و انتخاب بهترین گزینه‌های سیاستی، به سمت نهادسازی با مأموریت سیاست‌پژوهی پیش رفتهاند. این پژوهش با هدف ارائه چارچوب ارزیابی عملکرد مناسب برای مؤسسه‌های سیاست­پژوه مبتنی بر رویکرد مأموریت‌گرایی انجام شد. با بهره‌مندی از رویکرد پژوهش ترکیبی و روش سنتز چارچوب، مهم‌ترین ابعاد، شاخص‌ها و سنجه‌های ارزیابی عملکرد این مؤسسه‌ها متناظر با جایگاه کارکردی آن در نظام ملّی نوآوری و مأموریت‌های اصلی شناسایی شده برای این گونه مؤسسات، انتخاب شده‌اند. اعتبارسنجی چارچوب ارزیابی عملکرد به روش استدلال آگاهانه بر اساس نظر خبرگان انجام شده و درجه اهمیت اجزای چارچوب بر اساس آزمون t تک‌نمونهای تعیین شده است. چارچوب ارزیابی عملکرد حاصل از این پژوهش به صورت نمودار راداری مشتمل بر چهار چارک تناسب، کارایی، اثربخشی و سودمندی، 18 بُعد و شاخص‌های زیرمجموعه آن، نمایش داده شده است. همچنین مهم‌ترین نتایج این پژوهش با تمرکز بر وجوه افتراق ارزیابی عملکرد مؤسسه‌های سیاست‌پژوه، نشان‌دهنده محورهایی کلیدی برخاسته از مأموریت‌های اختصاصی این گونه مؤسسه‌هاست. عواملی همچون تنوع تخصصی پژوهشگران سیاست‌پژوهی و فنّی موردنیاز مؤسسه، سیاستمداران متمایز میهمان، مشارکت در گفتمان عمومی حوزه کاری، شبکه‌سازی سیاستی، برنامه‌های یادگیری، دانش‌افزایی از طریق رهبری فکری در فضای سیاستی و حکمرانی خوب، از جمله مهم‌ترین موارد حائز اشاره است.

کلیدواژه‌ها


عنوان مقاله [English]

Designing a Mission-based Evaluation Model for Policy Research Institutes

نویسندگان [English]

  • mahdieh farazkish 1
  • Ghasem Azadi 2
  • sajede abdi 3
1 Assistant professor, Department of Policy Evaluation & STI Monitoring, National Research Institute for Science Policy (NRISP), Tehran, Iran
2 Faculty Member /National Research Institute For Science Policy
3 Research Assistant, National Research Institute for Science Policy (NRISP), Tehran, Iran
چکیده [English]

In recent decades, policymakers have confirmed the necessity and value of the role of applied research in the guidance and effectiveness of policy decisions. This research provides an evaluation framework for policy-research institutes based on the mission-oriented approach. Using the mixed methodology approach and the framework synthesis research method, we have selected the most important dimensions, indices, and measures for evaluating the performance of these institutions corresponding to their functional position in the national innovation system. In addition, we have validated the evaluation framework by expert survey and determined the importance of its components based on the one-sample T-test. The final evaluation framework shows in the form of a radar chart consisting of four quadrants of appropriateness, efficiency, effectiveness, and usefulness, 18 dimensions, and its sub-categories. Also, the most important results of this research, focusing on the different aspects of evaluating the performance of political research institutes and think tanks, indicate key axes derived from the specific missions of such institutes. Factors such as the specialized variety of political and technical researchers required by the institute, distinguished guest politicians, participation in the public discourse of the work field, policy networking, learning programs, knowledge enhancement through intellectual leadership in the political environment, and good governance, are the most important results

کلیدواژه‌ها [English]

  • Evaluation Framework
  • Research Institutes
  • Mission-orientated Approach
  • Policy Research Institutes
]1[ Nasri, SH., Ghazinoori, S. & Radaei, N. (2023). Mission-oriented Typology of Public Research Institutions in the National Innovation System. Journal of Science & Technology Policy, 15(4), 1-12. {In Persian}.
DOI: 10.22034/jstp.2022.13948
]2[ Intarakumnerd P, Goto A. Role of public research institutes in national innovation systems in industrialized countries: The cases of Fraunhofer, NIST, CSIRO, AIST, and ITRI. Research Policy. 2018 Sep 1;47(7):1309–20. DOI: 10.1016/j.respol.2018.04.011
]3[ Sajedinejad A, Hassannayebi E, Ganji A. Performance Evaluation Model for Research Institutes Using an Improved Balanced Scorecard and DEMATEL Technique. Rahyaft. 2020 Jun 21;30(78):19–36. https://doi.org/10.22034/rahyaft.2020.13830
]4[ Taherkhani A. Designing a performance evaluation model using BSC in knowledge-based organizations [Master’s thesis]. Faculty of Management, University of Tehran; 2015.
]5[ Mehregan MR, Zali MR. Designing and explaining the performance evaluation system of industrial research centers. Journal of Managment Knowledge. 17(3):91–107.
]6[ Samadian MS, Chavoshi SK, Mennati H. Identifying and determining the optimal model for evaluating the performance of Naja research centers. Resource Management in the Police. 2017;5(17):56–31.
]7[ Kazemi HK, Bagheri F, Nasri Nasrabadi S. Evaluating the Performance of Research Centers by organizational Excellence Model Approach; Case Study: National Research Institute for Science Policy. Journal of Science and Technology Policy. 2016 Dec 21;9(4):77–93.
]8[ Hajian A, Ahmadvand AM, Movahedi M. Performance evaluation model of non-industrial research organizations. Journals Management System. 5(2):81–105.
]9[ Sheikhan N, Bakhtiarinezhad F. Designing and Implementation of Performance Evaluation Model for Research Centers. Journal of Industry and University. 2019 Oct;20(19):21.
]10[ Montazer GA, Sharanjani M, Moradipoor H, Farzkish M. Sanandaj handbook: evaluation model of the country’s research institutes. Tehran: University Publication Center; 2020.
]11[ Tijssen RJW. Anatomy of use-inspired researchers: From Pasteur’s Quadrant to Pasteur’s Cube model. Research Policy. 2018;47(9):1626–38. DOI: 10.1016/j.respol.2018.05.010
]12[ Stokes DE. Pasteur’s quadrant: Basic science and technological innovation. Brookings Institution Press; 1997.
]13[ Birkland TA. An Introduction to the Policy Process: Theories, Concepts, and Models of Public Policy Makin. 2nd Edition. New York: M. E. Sharpe.; 2005.
]14[ Denham A, Garnett M. “A Hollowed Out Tradition? British Think Tanks in the Twenty First Century”, Diane Stone and Andrew Denham (Eds.), Think Tank Traditions: Policy Research and the Politics of Ideas. Manchester: Manchester University Press; 2004.
]15[ Abelson D. Do Think Tanks Matter? Opportunities, Constraints and Incentives for Think Tanks in Canada and the United States. Global Society. 2000 Apr 1;14:213–36.
]16[ Özgür H, Kulaç O. An Analysis of the Studies on Think Tanks Success and Ranking. European Scientific Journal. 2015;2:73–90. https://doi.org/10.19044/esj.2015.v11n10p%25p
]17[ Abelson DE, Carberry CM. Following suit or falling behind? A comparative analysis of think tanks in Canada and the United States. Canadian Journal of Political Science/Revue canadienne de science politique. 1998;31(3):525–55.
]18[ Karimi T. New models of organizational performance evaluation. Tadbir. 2006;
]19[ Smismans S. Policy Evaluation in the EU: The Challenges of Linking Ex Ante and Ex Post Appraisal. Eur j risk regul. 2015 Mar;6(1):6–26. https://doi.org/10.1017/S1867299X00004244
]20[Ghazinoory, S., Farazkish, M., Montazer, G. A., & Soltani, B. (2017). Designing a national science and technology evaluation system based on a new typology of international practices. Technological Forecasting and Social Change, 122, 119-127. https://doi.org/10.1016/j.techfore.2017.04.012
]21[ Farazkish M, Dastranj N. Selecting and Applying Science, Technology and Innovation Evaluation Indices. Journal of Science and Technology Policy. 2019 Jun 22; 12(2):579–98. dorl.net/dor/20.1001.1.20080840.1398.12.2.38.3
]22[ McGann JG. The competition for dollars, scholars and influence in the public policy research industry. Dissertations available from ProQuest. 1991 Jan 1;1–381.
]23[ McGann JG. Best Practices for Funding and Evaluating Think Tanks and Public Policy Research. Amber, PA: McGann Associates. 2006;
]24[ Struyk RJ. Managing think tanks: practical guidance for maturing organizations. Expanded 2nd ed. Budapest: Local Government and Public Service Initiative, Open Society Institute; 2006. 350 p. (LGI books).
]25[ Bennett S, Corluka A, Doherty J, Tangcharoensathien V. Approaches to developing the capacity of health policy analysis institutes: a comparative case study. Health Research Policy and Systems. 2012 Mar 5;10(1):7. https://doi.org/10.1186/1478-4505-10-7
]26[ Brown, E., Knox, A., Tolmie, C., Gugerty, M. K., Kosack, S., & Fabrizio, A. Linking Think Tank Performance, Decisions, and Context. 2014;
]27[ McGann J. 2020 Global Go To Think Tank Index Report. TTCSP Global Go To Think Tank Index Reports [Internet]. 2021 Jan 28; Available from: https://repository.upenn.edu/think_tanks/18
]28[ McGann JG. Global Go To Think Tank Index & Abridged Report. Philadelphia: University of Pennsylvania. 2013;
]29[ James P, Abelson DE, Lusztig M. Myth of the Sacred: The Charter, the Courts, and the Politics of the Constitution in Canada. McGill-Queen’s Press - MQUP; 2002. 271 p.
]30[ Alcazar L, Balarín M, Weerakoon D, Eboh E. Final Report - Learning to monitor think tanks impact: Three experiences from Africa, Asia and Latin America. 2012 Oct [cited 2022 Dec 14]; Available from: https://idl-bnc-idrc.dspacedirect.org/handle/10625/50591
]31[ Arellano A, Dalaqua RH, Echt L, Guruli I, Reszkető P. Learning Together: Performance Self Assessments for Think Tanks. 2015;
]32[ Gang L, Simin W, Jingya Z, Yi D, Qi W, Tingting G, et al. The 2017 China Think Tank Index Report: Methodology and Think Tank Rankings. 2017;
]33[ Włoch R, Xhindi N. think tanks in Albania: a case of a flawed power-knowledge nexus. The Copernicus Journal of Political Studies. 2020 Dec 14;(2):143–60. http://dx.doi.org/10.12775/CJPS.2020.020
]34[ Braml J. U.S. and German Think Tanks in Comparative Perspective. German policy studies [Internet]. 2006 Sep 22 [cited 2022 Dec 14]; Available from: https://www.semanticscholar.org/paper/U.S.-and-German-Think-Tanks-in-Comparative-Braml/ffffae47b9555cbea782d71e71262731e64300b2
]35[ Christoplos I, Moran G, Bjarnesen J. Review of five South Africa based think tanks supported by Sida: Final report. SIDA Decentralised Evaluation. 2015;31.
]36[ Xu P. Evaluation of and Research on the Effectiveness of Social Think Tanks – A Case of Center for China & Globalization (CCG). Journal of Public Management Research. 2017 Mar 6;3(1):17–28. https://doi.org/10.5296/jpmr.v3i1.10814
]37[ Zhu X. The influence of think tanks in the Chinese policy process: Big Data Report on Chinese Think Tanks. China Think Tank Big Data Evaluation Project School of Public Policy and Management. Tsinghua University. 2016;
]38[ Samandar Ali Eshtehardi Mo, Goodarzi M, Ghorbani MH. Strategies to fulfill the mission of education in the entrepreneurial university: a framework synthesis and focus group study. Rahyaft. 2021;
]39[ Hevner AR, March ST, Park J, Ram S. Design science in information systems research. MIS quarterly. 2004;75–105.
]40[ Chyung SY (Yonnie), Roberts K, Swanson I, Hankinson A. Evidence-Based Survey Design: The Use of a Midpoint on the Likert Scale. Performance Improvement [Internet]. 2017 Nov 1; Available from: https://scholarworks.boisestate.edu/ipt_facpubs/87