AI Technology Evaluation (AITE)
A NIST evaluation program providing researchers with a sequestered testbed environment for the evaluation of AI model performance in a variety of meaningful tasks across diverse datasets, modalities, and domains.
The latest in a portfolio of evaluations managed by the NIST Information Technology Laboratory – AITE provides volunteer testing of AI models on blind data and its sequestered environment mitigates the risk of train/test data contamination to ensure rigorous, objective assessment..
AITE
AITE is designed to promote research in AI across an expanding set of tasks. The three initial tasks focus on image analysis using large vision language models (VLMs) in the context of (1) quantum science, (2) genomics, (3) public safety. Additional tasks will be added over time.
Schedule
- July 2026 AITE Kickoff
- July 2026 Evaluation Plan Release
- August 2026 Evaluation Period Begins