{"id":9799,"date":"2025-10-29T10:33:20","date_gmt":"2025-10-29T10:33:20","guid":{"rendered":"https:\/\/wissenschaftliche-integritaet.de\/kommentare\/forschungsbewertung-reformieren\/"},"modified":"2025-10-29T10:40:12","modified_gmt":"2025-10-29T10:40:12","slug":"reforming-research-assessment","status":"publish","type":"kommentare","link":"https:\/\/wissenschaftliche-integritaet.de\/en\/comments\/reforming-research-assessment\/","title":{"rendered":"Reforming research assessment"},"content":{"rendered":"\n<p>Guideline 5 emphasises that research achievements must be evaluated based on transparent and verifiable assessment criteria. These criteria should reflect the various dimensions of a researcher&#8217;s outputs, with a particular focus on originality, quality and relevance. The San Francisco Declaration on Research Assessment (DORA) provides a normative and practically applicable reference framework for this purpose.<\/p>\n\n\n\n<h6 class=\"wp-block-heading\"><strong>San Francisco Declaration on Research Assessment (DORA)<\/strong><\/h6>\n\n\n\n<p><a href=\"https:\/\/sfdora.org\/\">DORA<\/a> was adopted in 2013 with the aim of counteracting assessment practices based on the widespread but methodologically questionable use of publication-based metrics, in particular the Journal Impact Factor (JIF). The JIF is an indicator of the frequency with which articles in a given journal are cited. It is calculated by relating the number of citations in a given year to the number of publications in the two preceding years (Lewandowski 2006). According to DORA, the JIF is not suitable for assessing the quality of individual research outputs or academic careers, nor was it ever intended for that purpose. Its use is said to entail structural distortions, discipline-specific inequalities and incentives for strategic manipulation. For this reason, DORA calls on research institutions and funding organisations to avoid using journal-based metrics, such as the Journal Impact Factor (JIF), as a measure of the quality of individual research articles, and instead to focus their assessment on the quality of the research content itself, while acknowledging the diversity of research outputs.<\/p>\n\n\n\n<h6 class=\"wp-block-heading\"><strong><strong>The Practical Guide<\/strong><\/strong><\/h6>\n\n\n\n<p>Published in 2025, the <a href=\"https:\/\/sfdora.org\/resource\/practical-guide\/\">Practical Guide to Implementing Responsible Research Assessment at Research Performing Organizations<\/a> translates the DORA principles into practical steps research institutions can implement, offering hands-on guidance, resources and illustrative examples for the ongoing development of responsible assessment practices. In alignment with Guideline 5, it differentiates between multiple dimensions of research assessment. The assessment criteria set out therein are expanded to include contributions to the promotion of research integrity, for example.<\/p>\n\n\n\n<p>The Practical Guide also consolidates existing resources and tools. For instance, the referenced <a href=\"https:\/\/doi.org\/10.25546\/98474\">Researcher Impact Framework<\/a> distinguishes between knowledge generation, career and collaboration development, support for the research community and societal impact, while the <a href=\"https:\/\/doi.org\/10.5281\/zenodo.4927605\">SPACE rubric<\/a> offers structure and support for self-assessment and the further development of institutional assessment practices, for example.<\/p>\n\n\n\n<div style=\"height:20px\" aria-hidden=\"true\" class=\"wp-block-spacer\"><\/div>\n\n\n<div id=\"links-block_78d34754732a60e9aca4fe6fd3c8bc7b\" class=\"kodex__comments-full--used-links links\"><h3 class=\"mb05em\">Further links<\/h3><div class=\"dfg_links_link_title\"> <\/div><a class=\"kodex__comments-full--used-links  outside-link\" href=\"https:\/\/sfdora.org\/\"  target=\"_blank\">San Francisco Declaration on Research Assessment<span><\/span><\/a><div class=\"dfg_links_link_title\"> <\/div><a class=\"kodex__comments-full--used-links  outside-link\" href=\"https:\/\/sfdora.org\/resource-library\/?_resource_type=tools&#038;_dora_produced=1\"  target=\"_blank\">DORA toolkit<span><\/span><\/a><div class=\"dfg_links_link_title\"> <\/div><div class=\"mb05em\">Allen, L., Barbour, V., Cobey, K., Faulkes, Z., Hazlett, H., Lawrence, R., Lima, G., Massah, F., &#038; Schmidt, R. (2025). A Practical Guide to Implementing Responsible Research Assessment at Research Performing Organizations. Declaration on Research Assessment (DORA): <\/div><a class=\"kodex__comments-full--used-links  outside-link\" href=\"https:\/\/sfdora.org\/resource\/practical-guide\/\"  target=\"_blank\">https:\/\/sfdora.org\/resource\/practical-guide\/<span><\/span><\/a><div class=\"dfg_links_link_title\"> <\/div><div class=\"mb05em\">Lima, G. and Bowman, S. (2022). Researcher Impact Framework: Building Audience-Focused Evidence-Based Impact Narratives. Trinity College Dublin. [pdf] Dublin. <\/div><a class=\"kodex__comments-full--used-links  outside-link\" href=\"https:\/\/doi.org\/10.25546\/98474\"  target=\"_blank\">https:\/\/doi.org\/10.25546\/98474<span><\/span><\/a><div class=\"dfg_links_link_title\"> <\/div><div class=\"mb05em\">Anna Hatch, &#038; Ruth Schmidt. (2021). SPACE to evolve academic assessment: A rubric for analyzing institutional conditions and progress indicators. Zenodo. <\/div><a class=\"kodex__comments-full--used-links  outside-link\" href=\"https:\/\/doi.org\/10.5281\/zenodo.4927605\"  target=\"_blank\">https:\/\/doi.org\/10.5281\/zenodo.4927605<span><\/span><\/a><div class=\"dfg_links_link_title\"> <\/div><div class=\"mb05em\">Lewandowski, D. (2006). Schlagw\u00f6rter des Wissenschaftssystems: Journal Impact Factor. (IFQ)  <\/div><a class=\"kodex__comments-full--used-links  outside-link\" href=\"http:\/\/www.research-information.de\/iq\/iq_inhalt.php?agora\/Journal_Impact_Factor\/journal_impact_factor_inc.htmlXXXJournal%20Impact%20Factor\"  target=\"_blank\">accessed on 25 July 2025<span><\/span><\/a><\/div>","protected":false},"excerpt":{"rendered":"<p>Guideline 5 emphasises that research achievements must be evaluated based on transparent and verifiable assessment criteria. These criteria should reflect the various dimensions of a researcher&#8217;s outputs, with a particular focus on originality, quality and relevance. The San Francisco Declaration on Research Assessment (DORA) provides a normative and practically applicable reference framework for this purpose. [&hellip;]<\/p>\n","protected":false},"featured_media":0,"menu_order":0,"template":"","kommentar_cats":[257],"kommentar_tags":[214],"class_list":["post-9799","kommentare","type-kommentare","status-publish","hentry","kommentar_cats-general","kommentar_tags-performance-assessment"],"acf":[],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v27.4 - https:\/\/yoast.com\/product\/yoast-seo-wordpress\/ -->\n<title>Reforming research assessment - Wissenschaftliche Integrit\u00e4t<\/title>\n<meta name=\"description\" content=\"DORA provides a normative and practically applicable reference framework for assessment criteria that take various dimensions of a researcher&#039;s outputs into account.\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/wissenschaftliche-integritaet.de\/en\/comments\/reforming-research-assessment\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Reforming research assessment - Wissenschaftliche Integrit\u00e4t\" \/>\n<meta property=\"og:description\" content=\"DORA provides a normative and practically applicable reference framework for assessment criteria that take various dimensions of a researcher&#039;s outputs into account.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/wissenschaftliche-integritaet.de\/en\/comments\/reforming-research-assessment\/\" \/>\n<meta property=\"og:site_name\" content=\"Wissenschaftliche Integrit\u00e4t\" \/>\n<meta property=\"article:modified_time\" content=\"2025-10-29T10:40:12+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/wissenschaftliche-integritaet.de\/wp-content\/uploads\/2020\/02\/dfg-wissenschaftliche-integritaet-defaultimage.png\" \/>\n\t<meta property=\"og:image:width\" content=\"2324\" \/>\n\t<meta property=\"og:image:height\" content=\"1474\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/png\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data1\" content=\"3 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/wissenschaftliche-integritaet.de\\\/en\\\/comments\\\/reforming-research-assessment\\\/\",\"url\":\"https:\\\/\\\/wissenschaftliche-integritaet.de\\\/en\\\/comments\\\/reforming-research-assessment\\\/\",\"name\":\"Reforming research assessment - Wissenschaftliche Integrit\u00e4t\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/wissenschaftliche-integritaet.de\\\/en\\\/#website\"},\"datePublished\":\"2025-10-29T10:33:20+00:00\",\"dateModified\":\"2025-10-29T10:40:12+00:00\",\"description\":\"DORA provides a normative and practically applicable reference framework for assessment criteria that take various dimensions of a researcher's outputs into account.\",\"breadcrumb\":{\"@id\":\"https:\\\/\\\/wissenschaftliche-integritaet.de\\\/en\\\/comments\\\/reforming-research-assessment\\\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/wissenschaftliche-integritaet.de\\\/en\\\/comments\\\/reforming-research-assessment\\\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/wissenschaftliche-integritaet.de\\\/en\\\/comments\\\/reforming-research-assessment\\\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\\\/\\\/wissenschaftliche-integritaet.de\\\/en\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Reforming research assessment\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/wissenschaftliche-integritaet.de\\\/en\\\/#website\",\"url\":\"https:\\\/\\\/wissenschaftliche-integritaet.de\\\/en\\\/\",\"name\":\"Wissenschaftliche Integrit\u00e4t\",\"description\":\"Sicherung guter wissenschaftlicher Praxis\",\"publisher\":{\"@id\":\"https:\\\/\\\/wissenschaftliche-integritaet.de\\\/en\\\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/wissenschaftliche-integritaet.de\\\/en\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\\\/\\\/wissenschaftliche-integritaet.de\\\/en\\\/#organization\",\"name\":\"Deutsche Forschungsgemeinschaft e.V.\",\"url\":\"https:\\\/\\\/wissenschaftliche-integritaet.de\\\/en\\\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/wissenschaftliche-integritaet.de\\\/en\\\/#\\\/schema\\\/logo\\\/image\\\/\",\"url\":\"https:\\\/\\\/wissenschaftliche-integritaet.de\\\/wp-content\\\/uploads\\\/2020\\\/02\\\/GWP-Logo-v20200213@2x.png\",\"contentUrl\":\"https:\\\/\\\/wissenschaftliche-integritaet.de\\\/wp-content\\\/uploads\\\/2020\\\/02\\\/GWP-Logo-v20200213@2x.png\",\"width\":252,\"height\":70,\"caption\":\"Deutsche Forschungsgemeinschaft e.V.\"},\"image\":{\"@id\":\"https:\\\/\\\/wissenschaftliche-integritaet.de\\\/en\\\/#\\\/schema\\\/logo\\\/image\\\/\"}}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Reforming research assessment - Wissenschaftliche Integrit\u00e4t","description":"DORA provides a normative and practically applicable reference framework for assessment criteria that take various dimensions of a researcher's outputs into account.","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/wissenschaftliche-integritaet.de\/en\/comments\/reforming-research-assessment\/","og_locale":"en_US","og_type":"article","og_title":"Reforming research assessment - Wissenschaftliche Integrit\u00e4t","og_description":"DORA provides a normative and practically applicable reference framework for assessment criteria that take various dimensions of a researcher's outputs into account.","og_url":"https:\/\/wissenschaftliche-integritaet.de\/en\/comments\/reforming-research-assessment\/","og_site_name":"Wissenschaftliche Integrit\u00e4t","article_modified_time":"2025-10-29T10:40:12+00:00","og_image":[{"width":2324,"height":1474,"url":"https:\/\/wissenschaftliche-integritaet.de\/wp-content\/uploads\/2020\/02\/dfg-wissenschaftliche-integritaet-defaultimage.png","type":"image\/png"}],"twitter_card":"summary_large_image","twitter_misc":{"Est. reading time":"3 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/wissenschaftliche-integritaet.de\/en\/comments\/reforming-research-assessment\/","url":"https:\/\/wissenschaftliche-integritaet.de\/en\/comments\/reforming-research-assessment\/","name":"Reforming research assessment - Wissenschaftliche Integrit\u00e4t","isPartOf":{"@id":"https:\/\/wissenschaftliche-integritaet.de\/en\/#website"},"datePublished":"2025-10-29T10:33:20+00:00","dateModified":"2025-10-29T10:40:12+00:00","description":"DORA provides a normative and practically applicable reference framework for assessment criteria that take various dimensions of a researcher's outputs into account.","breadcrumb":{"@id":"https:\/\/wissenschaftliche-integritaet.de\/en\/comments\/reforming-research-assessment\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/wissenschaftliche-integritaet.de\/en\/comments\/reforming-research-assessment\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/wissenschaftliche-integritaet.de\/en\/comments\/reforming-research-assessment\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/wissenschaftliche-integritaet.de\/en\/"},{"@type":"ListItem","position":2,"name":"Reforming research assessment"}]},{"@type":"WebSite","@id":"https:\/\/wissenschaftliche-integritaet.de\/en\/#website","url":"https:\/\/wissenschaftliche-integritaet.de\/en\/","name":"Wissenschaftliche Integrit\u00e4t","description":"Sicherung guter wissenschaftlicher Praxis","publisher":{"@id":"https:\/\/wissenschaftliche-integritaet.de\/en\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/wissenschaftliche-integritaet.de\/en\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/wissenschaftliche-integritaet.de\/en\/#organization","name":"Deutsche Forschungsgemeinschaft e.V.","url":"https:\/\/wissenschaftliche-integritaet.de\/en\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/wissenschaftliche-integritaet.de\/en\/#\/schema\/logo\/image\/","url":"https:\/\/wissenschaftliche-integritaet.de\/wp-content\/uploads\/2020\/02\/GWP-Logo-v20200213@2x.png","contentUrl":"https:\/\/wissenschaftliche-integritaet.de\/wp-content\/uploads\/2020\/02\/GWP-Logo-v20200213@2x.png","width":252,"height":70,"caption":"Deutsche Forschungsgemeinschaft e.V."},"image":{"@id":"https:\/\/wissenschaftliche-integritaet.de\/en\/#\/schema\/logo\/image\/"}}]}},"_links":{"self":[{"href":"https:\/\/wissenschaftliche-integritaet.de\/en\/wp-json\/wp\/v2\/kommentare\/9799","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/wissenschaftliche-integritaet.de\/en\/wp-json\/wp\/v2\/kommentare"}],"about":[{"href":"https:\/\/wissenschaftliche-integritaet.de\/en\/wp-json\/wp\/v2\/types\/kommentare"}],"version-history":[{"count":1,"href":"https:\/\/wissenschaftliche-integritaet.de\/en\/wp-json\/wp\/v2\/kommentare\/9799\/revisions"}],"predecessor-version":[{"id":9801,"href":"https:\/\/wissenschaftliche-integritaet.de\/en\/wp-json\/wp\/v2\/kommentare\/9799\/revisions\/9801"}],"wp:attachment":[{"href":"https:\/\/wissenschaftliche-integritaet.de\/en\/wp-json\/wp\/v2\/media?parent=9799"}],"wp:term":[{"taxonomy":"kommentar_cats","embeddable":true,"href":"https:\/\/wissenschaftliche-integritaet.de\/en\/wp-json\/wp\/v2\/kommentar_cats?post=9799"},{"taxonomy":"kommentar_tags","embeddable":true,"href":"https:\/\/wissenschaftliche-integritaet.de\/en\/wp-json\/wp\/v2\/kommentar_tags?post=9799"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}