{"id":1159,"date":"2026-09-22T14:16:44","date_gmt":"2026-09-22T13:16:44","guid":{"rendered":"https:\/\/blog.fairsharing.org\/?p=1159"},"modified":"2026-09-22T16:44:52","modified_gmt":"2026-09-22T15:44:52","slug":"fairassist","status":"publish","type":"post","link":"https:\/\/blog.fairsharing.org\/?p=1159","title":{"rendered":"FAIRassist: registry of FAIR benchmarks and metrics"},"content":{"rendered":"\n<p>Although more than 30 FAIR assessment and assistance tools have emerged in recent years (<a href=\"https:\/\/fairassist.org\/tools\">https:\/\/fairassist.org\/tools<\/a>), they often exhibit widely different results due to the <a href=\"https:\/\/doi.org\/10.5281\/zenodo.7463421\">lack of transparency<\/a> about what is actually being checked and how it is measured. FAIR is intentionally expressed as a set of high-level principles rather than a technical standard, allowing different research communities to implement FAIR according to their own practices. However, the credibility of the results produced by existing tools and the transparency of the methods used, are major recognised challenges. They are being tackled in a highly collaborative manner by two specific FAIR-focused European task forces (<a href=\"https:\/\/eosc.eu\/eosc-association\/eosc-task-forces\">https:\/\/eosc.eu\/eosc-association\/eosc-task-forces<\/a>) and implemented by the OSTrails project (<a href=\"https:\/\/ostrails.eu\">https:\/\/ostrails.eu<\/a>). OSTrails has delivered a <a href=\"https:\/\/docs.ostrails.eu\/en\/latest\/architecture\/fair-if.html\">common framework<\/a> (the Assess-IF) to achieve harmonisation in the behaviour of FAIR assessment tools by providing components that enable the definition of what FAIR means in a given context, how it should be measured, and how results should be weighted, interpreted, and potentially improved. <\/p>\n\n\n\n<p>FAIRsharing supports this framework via our <a href=\"https:\/\/fairassist.org\/\">FAIRassist<\/a> component, where all community-defined conceptual components are registered, along with the standards, databases, and policies needed to interpret them. This allows FAIR assistance and assessment tools to utilise transparent, community-vetted definitions of FAIR, while also providing context-specific guidance before, during, and after assessment. FAIRassist acts as a centralized commons to discover and track resources for FAIR measurement and guidance.<\/p>\n\n\n\n<p>FAIRassist.org is composed of two parts: a list of FAIR evaluation<strong> <\/strong>tools and a registry. The <a href=\"https:\/\/fairassist.org\/tools?utm_source=gemini\" target=\"_blank\" rel=\"noreferrer noopener\">Tools section of FAIRassist<\/a> is a tabular list of automated evaluation engines as well as manual questionnaires and checklists. It provides an overview of the current ecosystem of FAIR evaluation tools to help RDM professionals understand how FAIRness is measured and practically improved. Tool developers can complete a simple form to register new evaluation tools or update existing entries as software evolves.<\/p>\n\n\n\n<p>The <a href=\"https:\/\/fairassist.org\/registry?utm_source=gemini\" target=\"_blank\" rel=\"noreferrer noopener\">registry<\/a> component serves as a trusted commons for Assess-IF conceptual components. Powered by FAIRsharing, it provides curated, machine-actionable records assigned with persistent identifiers (DOIs). The registry catalogs all three conceptual components of the Assess-IF:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li><strong>Dimensions:<\/strong> High-level frameworks defining the scope of evaluation (e.g., FAIR, FAIR4RS).<\/li>\n\n\n\n<li><strong>Metrics:<\/strong> Narrative descriptions of community-defined requirements for individual FAIR principles.<\/li>\n\n\n\n<li><strong>Benchmarks:<\/strong> Structured collections of metrics tailored to specific digital object types, disciplines, or institutional contexts.<\/li>\n<\/ul>\n\n\n\n<figure class=\"wp-block-image size-large\"><img loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"801\" src=\"https:\/\/blog.fairsharing.org\/wp-content\/uploads\/2026\/09\/image-1024x801.png\" alt=\"\" class=\"wp-image-1163\" srcset=\"https:\/\/blog.fairsharing.org\/wp-content\/uploads\/2026\/09\/image-1024x801.png 1024w, https:\/\/blog.fairsharing.org\/wp-content\/uploads\/2026\/09\/image-300x235.png 300w, https:\/\/blog.fairsharing.org\/wp-content\/uploads\/2026\/09\/image-768x600.png 768w, https:\/\/blog.fairsharing.org\/wp-content\/uploads\/2026\/09\/image-1200x938.png 1200w, https:\/\/blog.fairsharing.org\/wp-content\/uploads\/2026\/09\/image.png 1471w\" sizes=\"auto, (max-width: 1024px) 100vw, 1024px\" \/><figcaption class=\"wp-element-caption\">Partial view of FAIRassist when exploring the content of the <a href=\"https:\/\/fairassist.org\/registry?search=(principle=The+FAIR+Principles%26organisations=bodleian_library,_university_of_oxford,_oxford,_uk%26recordType=benchmark_ids)\">Institutional Repository Datasets benchmark<\/a>.<\/figcaption><\/figure>\n\n\n\n<p>The flexibility of the OSTrails Assess-IF enables communities to define FAIR in ways that are appropriate for their needs. Real-world examples of Assess-IF benchmarks registered in FAIRassist include:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>Evaluation of <a href=\"https:\/\/doi.org\/10.5281\/zenodo.21769644\">FAIR-enabling databases<\/a>. FAIRsharing has leveraged activities of infrastructures and communities such as the Research Data Alliance (RDA) to develop a definition of FAIR-enabling databases, which checks the FAIR-enabling capabilities of databases themselves, rather than the FAIRness of the datasets they contain. Checks include whether a FAIRsharing database record <a href=\"https:\/\/doi.org\/10.25504\/FAIRsharing.f94dc0\">references a data preservation policy<\/a> and whether it <a href=\"https:\/\/doi.org\/10.25504\/FAIRsharing.55789c\">supports versioned content<\/a>. <\/li>\n\n\n\n<li>Institutional repository datasets. Another example comes from the <a href=\"https:\/\/www.ukrn.org\/2026\/03\/13\/defining-fair-for-uk-institutional-repositories-a-community-collaboration-between-fairsharing-and-ukrn\/\">Oxford-led collaboration with UKRN<\/a> of UK institutional repositories that has focused on defining dataset FAIRness for these generalist repositories, irrespective of discipline. The Oxford Research Archive (ORA) is currently using the FAIR Champion tool to implement these definitions, aiming to maximise the FAIRness of the repository and repository content, as well as providing assistance to Oxford researchers during the dataset deposition process. These community FAIR definitions assess a wide variety of dataset characteristics, many of which use FAIRsharing records to perform their checks.<\/li>\n<\/ul>\n\n\n\n<p><em>To discover assessment tools or explore community benchmarks, visit <a href=\"https:\/\/fairassist.org?utm_source=gemini\" target=\"_blank\" rel=\"noreferrer noopener\">FAIRassist.org<\/a>.<\/em> <em>You may also be interested in our recent presentations to <a href=\"https:\/\/doi.org\/10.5281\/zenodo.22233162\">RSECon26<\/a> and as part of the <a href=\"https:\/\/doi.org\/10.5281\/zenodo.22794103\">DRI\/DCC webinar series<\/a>.<\/em><\/p>\n","protected":false},"excerpt":{"rendered":"<p>Although more than 30 FAIR assessment and assistance tools have emerged in recent years (https:\/\/fairassist.org\/tools), they often exhibit widely different results due to the lack of transparency about what is actually being checked and how it is measured. FAIR is intentionally expressed as a set of high-level principles rather than a technical standard, allowing different [&hellip;]<\/p>\n","protected":false},"author":6,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"templates\/template-full-width.php","format":"standard","meta":{"footnotes":""},"categories":[4],"tags":[31,59],"class_list":["post-1159","post","type-post","status-publish","format-standard","hentry","category-news","tag-fair","tag-ostrails"],"_links":{"self":[{"href":"https:\/\/blog.fairsharing.org\/index.php?rest_route=\/wp\/v2\/posts\/1159","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/blog.fairsharing.org\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/blog.fairsharing.org\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/blog.fairsharing.org\/index.php?rest_route=\/wp\/v2\/users\/6"}],"replies":[{"embeddable":true,"href":"https:\/\/blog.fairsharing.org\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=1159"}],"version-history":[{"count":5,"href":"https:\/\/blog.fairsharing.org\/index.php?rest_route=\/wp\/v2\/posts\/1159\/revisions"}],"predecessor-version":[{"id":1165,"href":"https:\/\/blog.fairsharing.org\/index.php?rest_route=\/wp\/v2\/posts\/1159\/revisions\/1165"}],"wp:attachment":[{"href":"https:\/\/blog.fairsharing.org\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=1159"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/blog.fairsharing.org\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=1159"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/blog.fairsharing.org\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=1159"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}