{"id":19315,"date":"2015-03-01T16:32:00","date_gmt":"2015-03-01T16:32:00","guid":{"rendered":"https:\/\/technopolis-group.com\/getting-what-you-measure-effects-of-performance-based-research-funding-systems\/"},"modified":"2020-04-08T15:21:11","modified_gmt":"2020-04-08T15:21:11","slug":"getting-what-you-measure-effects-of-performance-based-research-funding-systems","status":"publish","type":"post","link":"https:\/\/technopolis-group.com\/de\/getting-what-you-measure-effects-of-performance-based-research-funding-systems\/","title":{"rendered":"Getting what you measure? Effects of performance-based research funding systems"},"content":{"rendered":"\n<figure class=\"wp-block-pullquote\"><blockquote><p>The \u2018core\u2019 or \u2018institutional\u2019 funding universities receive to do research of their own choosing is being subjected to quality control and competition in a growing number of countries, apparently with significant impact on their behaviour and productivity \u2013 but also with unanticipated negative effects.  <\/p><\/blockquote><\/figure>\n\n\n\n<p class=\"has-text-align-left\">During the post-War period, state universities were generally financed through a single block grant. But over time they have additionally been gaining external income from research councils, other government agencies and industry, so the block grant is a declining proportion of their income. Curiously, despite wide variations in the share of total income provided by the part of the block grant dedicated to research (for example Danish universities received 72% block grant funding in 2009, the UK 48% and Ireland 31% according to Eurostat) there is no clear relationship between the share of institutional funding and research performance.<\/p>\n\n\n\n<p>Since 1986, education ministries have begun to use performance-based research funding systems (PRFS) in awarding institutional funding. In general, they aim to stimulate performance by reallocating resources to the strongest universities and research groups. The UK Research Assessment Exercise (RAE \u2013 recently renamed REF) was the first of these, and like other first-generation PRFS it relies heavily on peer review of submissions from the universities. From roughly 2000, more countries adopted a second generation of PRFS, mostly using bibliometric indicators rather than peer review. By that time the cost and difficulty of doing bibliometric analysis had fallen enough to be affordable \u2013 and, indeed to provide a much cheaper solution than peer review. Up to this point, PRFS focused on scientific quality, typically viewed through the lens of scientific publication. But a third generation of PRFS now aims to incorporate aspects that consider the influence of research on innovation and society more widely. Evidence<br>used ranges from patents through counting innovation March 2015 &#8211; N\u00b0 13 3 outputs like prototypes to text descriptions of research impacts in the REF.<\/p>\n\n\n\n<p> Key design decisions for PRFS include <\/p>\n\n\n\n<ul class=\"wp-block-list\"><li>Whether also to reward external project-based income<br>(many PRFS do), in which case the system will tend to<br>reinforce the themes and types of research that already<br>get external funding<\/li><li>Whether to create a list of \u2018approved\u2019 national language<br>publications of quality, in addition to relying on the<br>international journals indexed in the bibliometric<br>databases<\/li><li>Whether and how to address impact<\/li><li>Whether to extend to PRFS beyond the universities<br>to research institutes (only Norway and the Czech<br>Republic do this)<\/li><li>How much of the institutional funding to make<br>contestable each time the PRFS is run. There is a need<br>to balance stability against change. Many systems<br>seem to effect a lot of change while moving only small<br>amounts of money about \u2013 it looks as if esteem and<br>career prospects matter more to individual researchers<br>than how much money their institution gets<\/li><li>Whether to put different research fields in competition<br>with each other or to make a policy decision about how<br>much funding to give to each field and then arrange for<br>competition within each field<\/li><\/ul>\n\n\n\n<p>Despite their widespread adoption, there is little evidence about whether and how PRFS work. What we know is mostly based on evidence from the UK, Norway and the Czech Republic, which suggests that effects depend both on policy purposes and on the effectiveness of implementation.<\/p>\n\n\n\n<p>Norway introduced a PRFS in 2004 as part of\nthe university \u2018Quality Reform\u2019 and subsequently set up a similar but separate system for the\nuniversity hospitals and research institutes. Both act upon a very small fraction of total\ninstitutional funding. The PRFS\ndistributes money in a linear way and in practice rewarded the newer and weaker\nuniversities for their increasing\nresearch efforts, building national capacity rather than reallocating resources to the\nexisting winners. It drove up the\nnumber of publications but not their average quality. (An early Australian PRFS\ndid the same, a few years\nbefore.) The PRFS for the institutes had similar effects but failed to increase\neither the amount of\ninstitute-university collaboration or international income \u2013 perhaps because\nboth were already high. <\/p>\n\n\n\n<p>In response to dissatisfaction with peer\nreview based approaches,\nthe Czech Republic introduced a metricsbased PRFS in 2008, which ran annually\nand was intended over a short\nperiod to become the only mechanism for allocating institutional research funding. Universities\ndoubled their academic paper production\nin three years and the\nproduction of innovation-related outputs grew even faster. Allocations to\nindividual organisations and fields became very unstable. Gaming was widespread and\ndespite repeated attempts to\nrefine the formulae used, the system was abandoned in 2012 and is currently undergoing\nradical redesign.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>The \u2018core\u2019 or \u2018institutional\u2019 funding universities receive to do research [&hellip;]<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"footnotes":""},"categories":[233,5],"tags":[],"solution":[],"sector":[],"class_list":["post-19315","post","type-post","status-publish","format-standard","hentry","category-technopolitan-de","category-unkategorisiert"],"acf":[],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v27.1.1 - https:\/\/yoast.com\/product\/yoast-seo-wordpress\/ -->\n<title>Getting what you measure? Effects of performance-based research funding systems - Technopolis Group<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/technopolis-group.com\/de\/getting-what-you-measure-effects-of-performance-based-research-funding-systems\/\" \/>\n<meta property=\"og:locale\" content=\"de_DE\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Getting what you measure? Effects of performance-based research funding systems - Technopolis Group\" \/>\n<meta property=\"og:description\" content=\"The \u2018core\u2019 or \u2018institutional\u2019 funding universities receive to do research [&hellip;]\" \/>\n<meta property=\"og:url\" content=\"https:\/\/technopolis-group.com\/de\/getting-what-you-measure-effects-of-performance-based-research-funding-systems\/\" \/>\n<meta property=\"og:site_name\" content=\"Technopolis Group\" \/>\n<meta property=\"article:published_time\" content=\"2015-03-01T16:32:00+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2020-04-08T15:21:11+00:00\" \/>\n<meta name=\"author\" content=\"cedric\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Verfasst von\" \/>\n\t<meta name=\"twitter:data1\" content=\"cedric\" \/>\n\t<meta name=\"twitter:label2\" content=\"Gesch\u00e4tzte Lesezeit\" \/>\n\t<meta name=\"twitter:data2\" content=\"4\u00a0Minuten\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\/\/technopolis-group.com\/de\/getting-what-you-measure-effects-of-performance-based-research-funding-systems\/#article\",\"isPartOf\":{\"@id\":\"https:\/\/technopolis-group.com\/de\/getting-what-you-measure-effects-of-performance-based-research-funding-systems\/\"},\"author\":{\"name\":\"cedric\",\"@id\":\"https:\/\/technopolis-group.com\/nl\/#\/schema\/person\/eeed59af0b9e4a5e3a50d148502a3256\"},\"headline\":\"Getting what you measure? Effects of performance-based research funding systems\",\"datePublished\":\"2015-03-01T16:32:00+00:00\",\"dateModified\":\"2020-04-08T15:21:11+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\/\/technopolis-group.com\/de\/getting-what-you-measure-effects-of-performance-based-research-funding-systems\/\"},\"wordCount\":737,\"commentCount\":0,\"articleSection\":[\"Technopolitan\",\"Unkategorisiert\"],\"inLanguage\":\"de\",\"potentialAction\":[{\"@type\":\"CommentAction\",\"name\":\"Comment\",\"target\":[\"https:\/\/technopolis-group.com\/de\/getting-what-you-measure-effects-of-performance-based-research-funding-systems\/#respond\"]}]},{\"@type\":\"WebPage\",\"@id\":\"https:\/\/technopolis-group.com\/de\/getting-what-you-measure-effects-of-performance-based-research-funding-systems\/\",\"url\":\"https:\/\/technopolis-group.com\/de\/getting-what-you-measure-effects-of-performance-based-research-funding-systems\/\",\"name\":\"Getting what you measure? Effects of performance-based research funding systems - Technopolis Group\",\"isPartOf\":{\"@id\":\"https:\/\/technopolis-group.com\/nl\/#website\"},\"datePublished\":\"2015-03-01T16:32:00+00:00\",\"dateModified\":\"2020-04-08T15:21:11+00:00\",\"author\":{\"@id\":\"https:\/\/technopolis-group.com\/nl\/#\/schema\/person\/eeed59af0b9e4a5e3a50d148502a3256\"},\"breadcrumb\":{\"@id\":\"https:\/\/technopolis-group.com\/de\/getting-what-you-measure-effects-of-performance-based-research-funding-systems\/#breadcrumb\"},\"inLanguage\":\"de\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/technopolis-group.com\/de\/getting-what-you-measure-effects-of-performance-based-research-funding-systems\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/technopolis-group.com\/de\/getting-what-you-measure-effects-of-performance-based-research-funding-systems\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/technopolis-group.com\/de\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Getting what you measure? Effects of performance-based research funding systems\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/technopolis-group.com\/nl\/#website\",\"url\":\"https:\/\/technopolis-group.com\/nl\/\",\"name\":\"Technopolis Group\",\"description\":\"Technopolis-group\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/technopolis-group.com\/nl\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"de\"},{\"@type\":\"Person\",\"@id\":\"https:\/\/technopolis-group.com\/nl\/#\/schema\/person\/eeed59af0b9e4a5e3a50d148502a3256\",\"name\":\"cedric\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"de\",\"@id\":\"https:\/\/technopolis-group.com\/nl\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/497d412f48cec5d772f00904ec9eeece7ccdc8c4c13e9c38824de5ce441fab90?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/497d412f48cec5d772f00904ec9eeece7ccdc8c4c13e9c38824de5ce441fab90?s=96&d=mm&r=g\",\"caption\":\"cedric\"},\"url\":\"https:\/\/technopolis-group.com\/de\/author\/cedric\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Getting what you measure? Effects of performance-based research funding systems - Technopolis Group","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/technopolis-group.com\/de\/getting-what-you-measure-effects-of-performance-based-research-funding-systems\/","og_locale":"de_DE","og_type":"article","og_title":"Getting what you measure? Effects of performance-based research funding systems - Technopolis Group","og_description":"The \u2018core\u2019 or \u2018institutional\u2019 funding universities receive to do research [&hellip;]","og_url":"https:\/\/technopolis-group.com\/de\/getting-what-you-measure-effects-of-performance-based-research-funding-systems\/","og_site_name":"Technopolis Group","article_published_time":"2015-03-01T16:32:00+00:00","article_modified_time":"2020-04-08T15:21:11+00:00","author":"cedric","twitter_card":"summary_large_image","twitter_misc":{"Verfasst von":"cedric","Gesch\u00e4tzte Lesezeit":"4\u00a0Minuten"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/technopolis-group.com\/de\/getting-what-you-measure-effects-of-performance-based-research-funding-systems\/#article","isPartOf":{"@id":"https:\/\/technopolis-group.com\/de\/getting-what-you-measure-effects-of-performance-based-research-funding-systems\/"},"author":{"name":"cedric","@id":"https:\/\/technopolis-group.com\/nl\/#\/schema\/person\/eeed59af0b9e4a5e3a50d148502a3256"},"headline":"Getting what you measure? Effects of performance-based research funding systems","datePublished":"2015-03-01T16:32:00+00:00","dateModified":"2020-04-08T15:21:11+00:00","mainEntityOfPage":{"@id":"https:\/\/technopolis-group.com\/de\/getting-what-you-measure-effects-of-performance-based-research-funding-systems\/"},"wordCount":737,"commentCount":0,"articleSection":["Technopolitan","Unkategorisiert"],"inLanguage":"de","potentialAction":[{"@type":"CommentAction","name":"Comment","target":["https:\/\/technopolis-group.com\/de\/getting-what-you-measure-effects-of-performance-based-research-funding-systems\/#respond"]}]},{"@type":"WebPage","@id":"https:\/\/technopolis-group.com\/de\/getting-what-you-measure-effects-of-performance-based-research-funding-systems\/","url":"https:\/\/technopolis-group.com\/de\/getting-what-you-measure-effects-of-performance-based-research-funding-systems\/","name":"Getting what you measure? Effects of performance-based research funding systems - Technopolis Group","isPartOf":{"@id":"https:\/\/technopolis-group.com\/nl\/#website"},"datePublished":"2015-03-01T16:32:00+00:00","dateModified":"2020-04-08T15:21:11+00:00","author":{"@id":"https:\/\/technopolis-group.com\/nl\/#\/schema\/person\/eeed59af0b9e4a5e3a50d148502a3256"},"breadcrumb":{"@id":"https:\/\/technopolis-group.com\/de\/getting-what-you-measure-effects-of-performance-based-research-funding-systems\/#breadcrumb"},"inLanguage":"de","potentialAction":[{"@type":"ReadAction","target":["https:\/\/technopolis-group.com\/de\/getting-what-you-measure-effects-of-performance-based-research-funding-systems\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/technopolis-group.com\/de\/getting-what-you-measure-effects-of-performance-based-research-funding-systems\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/technopolis-group.com\/de\/"},{"@type":"ListItem","position":2,"name":"Getting what you measure? Effects of performance-based research funding systems"}]},{"@type":"WebSite","@id":"https:\/\/technopolis-group.com\/nl\/#website","url":"https:\/\/technopolis-group.com\/nl\/","name":"Technopolis Group","description":"Technopolis-group","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/technopolis-group.com\/nl\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"de"},{"@type":"Person","@id":"https:\/\/technopolis-group.com\/nl\/#\/schema\/person\/eeed59af0b9e4a5e3a50d148502a3256","name":"cedric","image":{"@type":"ImageObject","inLanguage":"de","@id":"https:\/\/technopolis-group.com\/nl\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/497d412f48cec5d772f00904ec9eeece7ccdc8c4c13e9c38824de5ce441fab90?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/497d412f48cec5d772f00904ec9eeece7ccdc8c4c13e9c38824de5ce441fab90?s=96&d=mm&r=g","caption":"cedric"},"url":"https:\/\/technopolis-group.com\/de\/author\/cedric\/"}]}},"publishpress_future_action":{"enabled":false,"date":"2026-04-15 06:26:17","action":"change-status","newStatus":"draft","terms":[],"taxonomy":"category","extraData":[]},"publishpress_future_workflow_manual_trigger":{"enabledWorkflows":[]},"_links":{"self":[{"href":"https:\/\/technopolis-group.com\/de\/wp-json\/wp\/v2\/posts\/19315","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/technopolis-group.com\/de\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/technopolis-group.com\/de\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/technopolis-group.com\/de\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/technopolis-group.com\/de\/wp-json\/wp\/v2\/comments?post=19315"}],"version-history":[{"count":0,"href":"https:\/\/technopolis-group.com\/de\/wp-json\/wp\/v2\/posts\/19315\/revisions"}],"wp:attachment":[{"href":"https:\/\/technopolis-group.com\/de\/wp-json\/wp\/v2\/media?parent=19315"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/technopolis-group.com\/de\/wp-json\/wp\/v2\/categories?post=19315"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/technopolis-group.com\/de\/wp-json\/wp\/v2\/tags?post=19315"},{"taxonomy":"solution","embeddable":true,"href":"https:\/\/technopolis-group.com\/de\/wp-json\/wp\/v2\/solution?post=19315"},{"taxonomy":"sector","embeddable":true,"href":"https:\/\/technopolis-group.com\/de\/wp-json\/wp\/v2\/sector?post=19315"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}