Assessing Risks and Impacts of AI
A compelling set of scenarios will aim to explore risks and related impacts across three levels of testing: model testing, red-teaming, and field testing.
ARIA Resources
NIST documents, software, and reports related to the ARIA 0.1 evaluation will be posted in the table below.
-
ARIA Evaluation Design Document
An overview of the ARIA program, including motivating factors for the program's development.
-
ARIA 0.1 Evaluation Plan
The guiding document that defines the implementation of the ARIA 0.1 pilot evaluation.
-
ARIA Data Transfer Agreement
The agreement between NIST and evaluation participants for handling the transfer of software, access credentials, and AI-generated data.
-
ARIA UI Git Repository
This repository is how participants will submit applications for testing. See Appendix A in the evaluation plan for details.
-
ARIA Quick Start Information
This collection of presentation slide decks covers the various stages of the ARIA evaluation process for different participant groups.
-
ARIA FAQ
Frequently Asked Questions about NIST’s ARIA Program.
-
Learn more about ARIA, AI Evaluations: Assessing Risks and Impacts of AI
An overview of the ARIA program, its evaluations and its goals.
ARIA November 2024 Workshop Materials
-
Recording of the ARIA Workshop