NHGRI FAIR Assessment 2024 Rubric

View Associations

Rubric Assessments (1)


Assessment Metrics Date
Target Project   Does your resource create and host data or knowledge assets that can be accessed by researchers? Does your resource create and host software assets that can be downloaded or installed and then used by researchers? Does your resource maintain a Web site that can be accessed by researchers? Does your resource perform expert manual or automated data or knowledge curation? Does your resource accept data submissions from researchers? Does your software read and write data using widely used community standards or formats? What sorts of documentation do you provide for your software? Where does your resource host your software for development? Check all the boxes that apply Are your repositories public or private? Where does your resource host your software for download? Check all the boxes that apply. What main languages are used in the software you offer to the public? Check all the boxes that apply. Do you foresee a need to migrate some or all of your code to other software languages in the foreseeable future? What other software language(s) would you migrate some or all of your code to? Check all the boxes that apply. Is your software available as a downloadable container? Does your resource release versioned software packages? Do you provide documentation describing each software release? Do you provide standard metadata describing each software release? What general approaches does your resource take for curation? Check all the boxes that apply. Do your curation methods introduce standard terms from public ontologies or vocabularies into the curated content? Do your curation methods add citations of relevant publications into the curated content? Do you support community curation, or curation by experts outside of your resource? Do you display detailed provenance that indicates that the curation was made by the community or external experts? Do you require specific file formats for submission to your resource? What specific file formats are required for submission to your resource? Check all the boxes that apply. Are terms from specific vocabularies or ontologies required in submissions to your resource? What specific vocabularies or ontologies are used or required in submissions to your resource? Check all boxes that apply. Are specific database identifiers required in submissions to your resource? Does your resource have mechanisms to record the origin and chain of custody of the submissions? Does your resource ascertain if submitters have obtained all necessary ethical and legal approvals for data sharing and publication? How frequently are submissions released to the public? Do you have embargo or Hold Until Publication policies for submissions? What processes are used to validate submissions? Check all the boxes that apply. Do you plan to start accepting data submissions from researchers as part of the new NIH Data Management and Sharing (DMS) policy? Have you ever performed a FAIR assessment of your assets using some tool or rubric? For example, FAIRshake, FAIR-Checker, or GO FAIR. Do you assign unique, persistent identifiers to some or all of your assets? What kind of unique identifiers do you assign? Check all the boxes that apply. What kinds of assets receive these unique, persistent identifiers in your resource? Does your resource describe its assets using any public metadata standards? For example, DataCite, OpenAIRE, Dublin Core. Does your resource annotate its assets with its own custom metadata vocabulary? What are the public metadata standards that you apply? Check all the boxes that apply. Does your resource annotate its assets with its own custom metadata vocabulary? Please describe your custom metadata vocabulary. Are you using a third-party Web site to improve the findability of your data or knowledge? For example, FAIRSharing, DataMed, WikiData. What third-party Web site are you using to improve the findability of your data or knowledge? Are all of your resource's assets discoverable by Web searches? What kinds of assets hosted by your resource cannot be found by conventional Web searches? Are your assets mirrored or copied to other locations, in addition to being available through your resource? Please describe the different resources that can be used to access your assets. Does your resource require some form of account and authentication to access any of your assets? What access requires some form of account and authentication? Check all the boxes that apply What access requires some form of account and authentication? What is the authentication system? Check all the boxes that apply. What is the authentication system? Check all the boxes that apply. Does your resource require some form of one-time registration to access any of your assets? What access requires some form of one-time registration? Do you offer assets that are accessible using some software download protocol? Is the software protocol enabling these downloads free and easily implemented? Does this software protocol allow for authentication if necessary? Do you measure the number of asset downloads? Are you able to track asset downloads by country or location? Does your resource host sensitive or proprietary data or knowledge of any kind? Please describe this sensitive or proprietary data or knowledge. Is your resource FISMA or FedRAMP-certified? What level is your certification? What documented capabilities does your resource meet for data security? Does your resource use any tools to measure the use of your Web site? For example, Google Analytics, Cloud object monitoring, custom software. What tools does your resource use to measure Web site use? Please indicate the key metrics you collect using these tools. Are you able to track Web site use by country or location? Does your resource offer custom computing or analytics services to researchers? Please describe these custom computing or analytics services. Do you measure use of these computing or analytics services in any way? Please describe how your resource measures the use of your computing or analytics services. Does your resource structure its data or knowledge assets using some public data model or Common Data Model? For example, FHIR, OMOP. What public data model or Common Data Model is used by your resource? What public data model or Common Data Model is used by your resource? What kinds of assets from other resources are your assets frequently integrated with? What databases provide identifiers that your resources uses or links to that allow your resource's assets to be integrated with these assets from other resources? What ontologies or vocabularies does your resource use or link to that allow your resource’s assets to be integrated with these other assets? Does your resource internally integrate different types of its own data or knowledge? For example, a resource may integrate its own genomics and gene expression data. Please briefly describe how your resource integrates its own data. Are there any "missing" ontologies or vocabularies that would enable more annotation or integration of your data or knowledge assets? Please describe the ontology or vocabulary that would allow more annotation or integration of your data or knowledge assets. Does your resource provide documentation that tells researchers how to cite your resource using key publication(s) when they use your assets in their published work? What kind of documentation does your resource provide on the sources or provenance of your data or knowledge assets? Is access to all of your resource's assets completely free of charge Are the conditions for pricing clearly described on your Web site? s any open-source license applied to some or all of your data or knowledge assets? What open-source license does your resource apply to these assets? Is any open-source license applied to some or all your software assets? What open-source license is applied to these software assets? Is the use of any of your data or knowledge assets governed by human subject consent text? Is any commercial or non-open-source license applied to some or all of your data or knowledge assets? Please describe this commercial or non-open-source license. Are Data Access Requests required to use any of your resource's data or knowledge assets? Are Data Use Agreements required to use any of your resource's data or knowledge assets? Please describe any technologies or approaches you have employed that have increased the FAIRness of your assets that other NHGRI resources might benefit from. Please describe any technologies or approaches that you think would increase the FAIRness of your assets. Have you encountered any technical barriers to increasing the FAIRness of your assets? Please describe the technical barriers that you have encountered. Have you encountered any policy barriers to increasing the FAIRness of your assets? Please describe the policy barriers that you have encountered. Have you encountered any financial barriers to increasing the FAIRness of your assets? Have you encountered any institutional barriers to increasing the FAIRness of your assets? Have you encountered any institutional barriers to increasing the FAIRness of your assets? Please describe the institutional barriers that you have encountered. Have you encountered any social barriers to increasing the FAIRness of your assets? Have you encountered any social barriers to increasing the FAIRness of your assets? Please describe the social barriers that you have encountered. What does user feedback tell you about the Findability of your assets and your resource? For example, are there features or changes to your resource being requested by users that would increase the Findability of your assets? What does user feedback tell you about the Accessibility of your assets and your resource? For example, are there features or changes to your resource being requested by users that would increase the Accessibility of your assets? What does user feedback tell you about the Interoperability of your assets and your resource? For example, are there features or changes to your resource being requested by users that would increase the Interoperability of your assets? What does user feedback tell you about the Reusability of your assets and your resource? For example, are there features or changes to your resource being requested by users that would increase the Reusability of your assets? What technologies are used for the storage of your assets? Please describe the location of your central computing and storage resources. What Cloud platform(s) are being used by your resource? Check all the boxes that apply. Why did you choose this Cloud platform(s)? How is your resource using the Cloud? Please estimate the proportion of your assets that are Cloud-hosted. Does your resource intend to increase Cloud use in the future? In what way will you increase your use of the Cloud? Please estimate the volume of the assets you host. Consider only the assets that you are solely responsible for, if you are part of larger collaborations or consortia. Does your resource store any of its assets as files? Does your resource store any of its assets in databases? Please estimate the proportion of your assets stored as files and as database records. Does your resource have public API(s) that your users can access? Please describe the purpose of the public API or APIs. Do you provide public documentation for your API or APIs? Is your public API or APIs built according to some API standard? For example, GA4GH, OpenAPI, FHIR. What API standard does your public API or APIs use? What API standard does your public API or APIs use? Which GA4GH APIs are used by your resource? Would you like to enhance or expand your public API in any way? In what way would you like to enhance or expand your public API? Would you like to create a public API for your resource? What would the purpose of this public API be? Please estimate the number of FTEs working on data curation, including development of curation tools. Please estimate the number of FTEs working on software tools, excluding Web site development. Please estimate the number of FTEs working on software tools, excluding Web site development. Please estimate the number of FTEs working on ontology development, either creating and maintaining ontologies or contributing to ontologies. Please estimate the number of FTEs working on ontology development, either creating and maintaining ontologies or contributing to ontologies. Please estimate the number of FTEs providing user support and/or user training. What emerging capabilities will be the most promising for advancing the FAIRness of your assets or your impact in the future? How will these new capabilities advance your impact and the FAIRness of your assets? Which state(s) best describe your resource? Check all the boxes that apply. Is there a State 3 repository or long-term archive available to you that could maintain your assets if you are not able to maintain your resource? Is there a State 3 repository or long-term archive available to you that could maintain your assets if you are not able to maintain your resource? How can NHGRI further support your resource's efforts to make its assets more Findable, Accessible, Interoperable, and Reusable and thereby increase the use and impact of its assets? Check all the boxes that apply. Please add any additional comments that are relevant to this FARE Tool or to FAIR that should be brought to NHGRI's attention.
ClinGen Allele Registry NHGRI FAIR Assessment for BRL ClinGen Tools
                                                                                                                                                                                                                                                                                                          Jan 26, 2024