We summarize a subset of the literature regarding the challenges to and recommendations for the test, evaluation, verification, and validation (TEV&V) of autonomous military systems. This literature review is meant for informational purposes only and does not make any recommendations of its own. A synthesis of the literature identified the following categories of TEV&V challenges
-
Problems arising from the complexity of autonomous systems,
-
Challenges imposed by the structure of the current acquisition system,
-
Lack of methods, tools, and infrastructure for testing,
-
Novel safety and security issues,
-
A lack of consensus on policy, standards, and metrics,
-
Issues around how to integrate humans into the operation and testing of these systems.
Recommendations for how to test autonomous military systems can be sorted into five broad groups
-
Use certain processes for writing requirements, or for designing and developing systems,
-
Make targeted investments to develop methods or tools, improve our test infrastructure, or enhance our workforce’s AI skillsets,
-
Use specific proposed test frameworks,
-
Employ novel methods for system safety or cybersecurity, and
-
Adopt specific proposed policies, standards, or metrics.
Suggested Citation
Wojton, Heather M, Daniel J Porter, and John W Dennis. Test & Evaluation of AI-Enabled and Autonomous Systems: A Literature Review. IDA Document NS-D-14331. Alexandria, VA: Institute for Defense Analyses, 2020.