{"id":48424,"date":"2023-07-19T09:27:49","date_gmt":"2023-07-19T09:27:49","guid":{"rendered":"https:\/\/technopolis-group.com\/new\/technopolis-completes-two-studies-on-the-uks-research-excellence-framework-ref-2021-which-will-inform-the-countrys-next-national-research-assessment-exercise-in-2028\/"},"modified":"2023-07-20T11:54:28","modified_gmt":"2023-07-20T11:54:28","slug":"technopolis-completes-two-studies-on-the-uks-research-excellence-framework-ref-2021-which-will-inform-the-countrys-next-national-research-assessment-exercise-in-2028","status":"publish","type":"new","link":"https:\/\/technopolis-group.com\/nl\/new\/technopolis-completes-two-studies-on-the-uks-research-excellence-framework-ref-2021-which-will-inform-the-countrys-next-national-research-assessment-exercise-in-2028\/","title":{"rendered":"Technopolis completes two studies on the UK\u2019s Research Excellence Framework (REF) 2021, which will inform the country\u2019s next national research assessment exercise in 2028"},"content":{"rendered":"\n<p>Technopolis completed two studies on the UK\u2019s Research Excellence Framework 2021 (REF 2021). REF 2021 was the UK\u2019s largest national research assessment exercise to date and encompassed submissions from 157 higher education institutions (HEIs) and more than 76,000 researchers. It will determine the selective distribution of a substantial volume of institutional research funding, which could amount to more than \u00a315bn between 2022\/23 and 2029\/30.<\/p>\n\n\n\n<p><strong>Technopolis analysis of REF 2021 outputs<\/strong> explored ways in which the micro data generated by the latest cycle might yield insights into the health of disciplines or research areas. The study included four areas of experimental analyses of REF 2021 data:<\/p>\n\n\n\n<ul class=\"wp-block-list\"><li><strong>Analysis of medical sub-disciplines <\/strong><strong>t<\/strong><strong>o pilot an approach to categorise outputs submitted to the REF<\/strong> in a way that is meaningful, but distinct from the Units of Assessment the outputs are submitted to, and provide subsequent analysis. We found that this approach successfully provides a more granular view into the REF submissions to health related units of assessment (UoAs 1\u20134), with \u2018Neurology and Neurosurgery\u2019, \u2018General and Internal Medicine\u2019, \u2018Oncology and Carcinogenesis\u2019, \u2018Cellular and Developmental Biology\u2019, and \u2018Experimental Psychology\u2019 appearing amongst the top 20 medical subfields (the latter representing 76% of all UoAs 1\u20134 outputs)<\/li><li><strong>Analysis of ageing and gerontology research<\/strong> to test a methodology to identify outputs relating to ageing and gerontology research across all panels and UoAs, and provide subsequent analysis. We found that publications in this area are&nbsp;more interdisciplinary than the global average&nbsp;based on&nbsp;two interdisciplinary indicators (which capture disciplinary diversity of authors and&nbsp;disciplinary diversity of references).\u200b There is also high knowledge uptake beyond academic research&nbsp;&#8211; higher citations in patents,&nbsp;policy-related documents, practice guidelines and news items above&nbsp;the world average, and above the scores for the UK&nbsp;and UKRI-funded publications in the field<\/li><li><strong>Exploring research excellence within the arts and humanities<\/strong>, and the effectiveness of the REF system at dealing with a diversity of types of research outputs. We found there are&nbsp;no (statistically) significant differences in scores between traditional and non-traditional outputs, once we control by type of institution and HEIs\u2019&nbsp;characteristics (via econometric analysis). Overall&nbsp;non-traditional outputs are being submitted to REF less than would&nbsp;be expected.&nbsp;The submission of non-traditional outputs to REF2021&nbsp;has decreased in absolute&nbsp;terms&nbsp;(from 5,509 to 4,436 outputs submitted) and in relative terms from 2.9% to 2.4% of&nbsp;outputs submitted<\/li><li><strong>Understanding the extent to which REF encourages or discourages interdisciplinary research (IDR)<\/strong>, including its ability to assess this work fairly and robustly. Our results suggest that HEIs did not submit fewer IDR outputs&nbsp;than would be&nbsp;expected. REF outputs have similar degree of IDR in comparison with UK and UKRI publications&nbsp;measured in terms of knowledge integration. Research integrating a diverse knowledge base (measured as disciplinary diversity&nbsp;of references) was, to some degree, negatively correlated with the&nbsp;quality profile of REF outputs. The negative correlation between the disciplinary diversity of authors and the quality profile was less pronounced and less&nbsp;consistent when looking at each panel and units of assessment&nbsp;individually.\u200b The results above could be explained by IDR outputs being truly (albeit slightly) lower&nbsp;in quality, in comparison with average, or by a slight negative bias against IDR in the&nbsp;REF&nbsp;process<\/li><\/ul>\n\n\n\n<p>In bringing together the four analyses, we found that on-going developments in data science allow implementing automated processes (many of which rely on machine learning) to analyse certain concepts, at scale. However, the implementation of the different projects also showcases that (i) the successful implementation of data science methods requires not only the use of specialised skills but also a great of prior work in terms of structuring and curating the data information in a way that is meaningful to the analysis; (ii) these methods do not replace the need for thematic expertise and peer-reviewed assessment.<\/p>\n\n\n\n<p>Through this project, the funding bodies gained insights into the feasibility of carrying out a more granular analysis of research assessment data, or analysis of cross-cutting themes in future exercises.<\/p>\n\n\n\n<p><strong>Technopolis also delivered a study to <\/strong><strong>estimate REF 2021 costs and analyse the balance of costs against benefits played out in REF 2021<\/strong>. We estimate the total cost to the UK of running REF 2021 was around \u00a3471M, which amounts to around \u00a33m per HEI on average for the 7-year cycle and around \u00a36k for each researcher submitted. This figure constitutes a substantial increase in the costs borne by the higher education (+50%) community when compared with the costs of submitting to the preceding national assessment exercise, REF 2014. The overall cost amounts to around 3-4% of the funding expected to be distributed, which is more economical than the costs of the peer-review procedures (c. 12% of funds distributed) used by the grant-awarding research councils.<\/p>\n\n\n\n<p>The higher cost of REF 2021 was driven in large part by an expansion in the scope of the exercise and in particular by the inclusion of a substantially larger cohort of researchers (+50%). From this perspective, the increased costs are in part mirrored by increased benefits in the shape of a more inclusive process that has provided greater equity to individual researchers. UK HEIs value many of the cultural shifts resulting from these changes, such as greater ability to deal with researchers\u2019 individual circumstances or more open research practices. Indeed, the great majority of HEIs surveyed by Technopolis believe REF 2021 represented moderate or high value for money.<\/p>\n\n\n\n<p>Both Technopolis studies are available <a href=\"https:\/\/beta.jisc.ac.uk\/future-research-assessment-programme\/evaluation-activities\">here<\/a>.<\/p>\n\n\n\n<p>These two Technopolis studies are already making a difference, and have informed some of the key decisions on the high-level design of the next research assessment exercise (REF2028), the outline design for which published in July 2023 by JISC on behalf of the four UK higher education funding bodies <a href=\"https:\/\/beta.jisc.ac.uk\/future-research-assessment-programme\/initial-decisions\">here<\/a>.<\/p>\n\n\n\n<p>The team: <a href=\"https:\/\/technopolis-group.com\/nl\/expert\/anete-vingre\/\" data-type=\"URL\" data-id=\"https:\/\/technopolis-group.com\/expert\/anete-vingre\/\" target=\"_blank\" rel=\"noreferrer noopener\">Anete Vingre<\/a>, <a href=\"https:\/\/technopolis-group.com\/nl\/expert\/cristina-rosemberg-montes\/\" data-type=\"URL\" data-id=\"https:\/\/technopolis-group.com\/expert\/cristina-rosemberg-montes\/\" target=\"_blank\" rel=\"noreferrer noopener\">Cristina Rosemberg Montes<\/a>, <a href=\"https:\/\/technopolis-group.com\/nl\/expert\/paul-simmonds\/\" data-type=\"URL\" data-id=\"https:\/\/technopolis-group.com\/expert\/paul-simmonds\/\" target=\"_blank\" rel=\"noreferrer noopener\">Paul Simmonds<\/a>.<\/p>\n","protected":false},"template":"","solution":[149,133],"sector":[118],"class_list":["post-48424","new","type-new","status-publish","hentry","solution-data-analytics-nl","solution-evaluation-nl","sector-research-innovation-nl"],"acf":[],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v27.1.1 - https:\/\/yoast.com\/product\/yoast-seo-wordpress\/ -->\n<title>Technopolis completes two studies on the UK\u2019s Research Excellence Framework (REF) 2021, which will inform the country\u2019s next national research assessment exercise in 2028 - Technopolis Group<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/technopolis-group.com\/nl\/new\/technopolis-completes-two-studies-on-the-uks-research-excellence-framework-ref-2021-which-will-inform-the-countrys-next-national-research-assessment-exercise-in-2028\/\" \/>\n<meta property=\"og:locale\" content=\"nl_NL\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Technopolis completes two studies on the UK\u2019s Research Excellence Framework (REF) 2021, which will inform the country\u2019s next national research assessment exercise in 2028 - Technopolis Group\" \/>\n<meta property=\"og:description\" content=\"Technopolis completed two studies on the UK\u2019s Research Excellence Framework [&hellip;]\" \/>\n<meta property=\"og:url\" content=\"https:\/\/technopolis-group.com\/nl\/new\/technopolis-completes-two-studies-on-the-uks-research-excellence-framework-ref-2021-which-will-inform-the-countrys-next-national-research-assessment-exercise-in-2028\/\" \/>\n<meta property=\"og:site_name\" content=\"Technopolis Group\" \/>\n<meta property=\"article:modified_time\" content=\"2023-07-20T11:54:28+00:00\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Geschatte leestijd\" \/>\n\t<meta name=\"twitter:data1\" content=\"5 minuten\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\/\/technopolis-group.com\/nl\/new\/technopolis-completes-two-studies-on-the-uks-research-excellence-framework-ref-2021-which-will-inform-the-countrys-next-national-research-assessment-exercise-in-2028\/\",\"url\":\"https:\/\/technopolis-group.com\/nl\/new\/technopolis-completes-two-studies-on-the-uks-research-excellence-framework-ref-2021-which-will-inform-the-countrys-next-national-research-assessment-exercise-in-2028\/\",\"name\":\"Technopolis completes two studies on the UK\u2019s Research Excellence Framework (REF) 2021, which will inform the country\u2019s next national research assessment exercise in 2028 - Technopolis Group\",\"isPartOf\":{\"@id\":\"https:\/\/technopolis-group.com\/nl\/#website\"},\"datePublished\":\"2023-07-19T09:27:49+00:00\",\"dateModified\":\"2023-07-20T11:54:28+00:00\",\"breadcrumb\":{\"@id\":\"https:\/\/technopolis-group.com\/nl\/new\/technopolis-completes-two-studies-on-the-uks-research-excellence-framework-ref-2021-which-will-inform-the-countrys-next-national-research-assessment-exercise-in-2028\/#breadcrumb\"},\"inLanguage\":\"nl-NL\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/technopolis-group.com\/nl\/new\/technopolis-completes-two-studies-on-the-uks-research-excellence-framework-ref-2021-which-will-inform-the-countrys-next-national-research-assessment-exercise-in-2028\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/technopolis-group.com\/nl\/new\/technopolis-completes-two-studies-on-the-uks-research-excellence-framework-ref-2021-which-will-inform-the-countrys-next-national-research-assessment-exercise-in-2028\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/technopolis-group.com\/nl\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"News\",\"item\":\"https:\/\/technopolis-group.com\/pt-pt\/new\/\"},{\"@type\":\"ListItem\",\"position\":3,\"name\":\"Technopolis completes two studies on the UK\u2019s Research Excellence Framework (REF) 2021, which will inform the country\u2019s next national research assessment exercise in 2028\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/technopolis-group.com\/nl\/#website\",\"url\":\"https:\/\/technopolis-group.com\/nl\/\",\"name\":\"Technopolis Group\",\"description\":\"Technopolis-group\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/technopolis-group.com\/nl\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"nl-NL\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Technopolis completes two studies on the UK\u2019s Research Excellence Framework (REF) 2021, which will inform the country\u2019s next national research assessment exercise in 2028 - Technopolis Group","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/technopolis-group.com\/nl\/new\/technopolis-completes-two-studies-on-the-uks-research-excellence-framework-ref-2021-which-will-inform-the-countrys-next-national-research-assessment-exercise-in-2028\/","og_locale":"nl_NL","og_type":"article","og_title":"Technopolis completes two studies on the UK\u2019s Research Excellence Framework (REF) 2021, which will inform the country\u2019s next national research assessment exercise in 2028 - Technopolis Group","og_description":"Technopolis completed two studies on the UK\u2019s Research Excellence Framework [&hellip;]","og_url":"https:\/\/technopolis-group.com\/nl\/new\/technopolis-completes-two-studies-on-the-uks-research-excellence-framework-ref-2021-which-will-inform-the-countrys-next-national-research-assessment-exercise-in-2028\/","og_site_name":"Technopolis Group","article_modified_time":"2023-07-20T11:54:28+00:00","twitter_card":"summary_large_image","twitter_misc":{"Geschatte leestijd":"5 minuten"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/technopolis-group.com\/nl\/new\/technopolis-completes-two-studies-on-the-uks-research-excellence-framework-ref-2021-which-will-inform-the-countrys-next-national-research-assessment-exercise-in-2028\/","url":"https:\/\/technopolis-group.com\/nl\/new\/technopolis-completes-two-studies-on-the-uks-research-excellence-framework-ref-2021-which-will-inform-the-countrys-next-national-research-assessment-exercise-in-2028\/","name":"Technopolis completes two studies on the UK\u2019s Research Excellence Framework (REF) 2021, which will inform the country\u2019s next national research assessment exercise in 2028 - Technopolis Group","isPartOf":{"@id":"https:\/\/technopolis-group.com\/nl\/#website"},"datePublished":"2023-07-19T09:27:49+00:00","dateModified":"2023-07-20T11:54:28+00:00","breadcrumb":{"@id":"https:\/\/technopolis-group.com\/nl\/new\/technopolis-completes-two-studies-on-the-uks-research-excellence-framework-ref-2021-which-will-inform-the-countrys-next-national-research-assessment-exercise-in-2028\/#breadcrumb"},"inLanguage":"nl-NL","potentialAction":[{"@type":"ReadAction","target":["https:\/\/technopolis-group.com\/nl\/new\/technopolis-completes-two-studies-on-the-uks-research-excellence-framework-ref-2021-which-will-inform-the-countrys-next-national-research-assessment-exercise-in-2028\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/technopolis-group.com\/nl\/new\/technopolis-completes-two-studies-on-the-uks-research-excellence-framework-ref-2021-which-will-inform-the-countrys-next-national-research-assessment-exercise-in-2028\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/technopolis-group.com\/nl\/"},{"@type":"ListItem","position":2,"name":"News","item":"https:\/\/technopolis-group.com\/pt-pt\/new\/"},{"@type":"ListItem","position":3,"name":"Technopolis completes two studies on the UK\u2019s Research Excellence Framework (REF) 2021, which will inform the country\u2019s next national research assessment exercise in 2028"}]},{"@type":"WebSite","@id":"https:\/\/technopolis-group.com\/nl\/#website","url":"https:\/\/technopolis-group.com\/nl\/","name":"Technopolis Group","description":"Technopolis-group","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/technopolis-group.com\/nl\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"nl-NL"}]}},"publishpress_future_workflow_manual_trigger":{"enabledWorkflows":[]},"_links":{"self":[{"href":"https:\/\/technopolis-group.com\/nl\/wp-json\/wp\/v2\/new\/48424","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/technopolis-group.com\/nl\/wp-json\/wp\/v2\/new"}],"about":[{"href":"https:\/\/technopolis-group.com\/nl\/wp-json\/wp\/v2\/types\/new"}],"wp:attachment":[{"href":"https:\/\/technopolis-group.com\/nl\/wp-json\/wp\/v2\/media?parent=48424"}],"wp:term":[{"taxonomy":"solution","embeddable":true,"href":"https:\/\/technopolis-group.com\/nl\/wp-json\/wp\/v2\/solution?post=48424"},{"taxonomy":"sector","embeddable":true,"href":"https:\/\/technopolis-group.com\/nl\/wp-json\/wp\/v2\/sector?post=48424"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}