WeaknessASC-2026-0049Other weakness
Overreliance on AI output
LowMitigated
People accept AI answers, summaries and code without checking, so errors and manipulated output pass straight into decisions and production.
How to detect it
- AI output used in decisions without review
- Generated code merged without tests
How to resolve it
- Require review and tests for AI-generated code and content
- Show sources and uncertainty with answers
How to investigate
- Trace the decision or change back to the AI output
- Correct and add a review step