Which concept describes the tendency to trust automated systems blindly?

Get ready for the GARP Risk and AI Exam with flashcards and multiple choice questions. Each question comes with hints and explanations. Prepare for success!

Multiple Choice

Which concept describes the tendency to trust automated systems blindly?

Explanation:
Automation bias is the tendency to trust automated systems blindly, accepting their outputs with little critical scrutiny. In risk analytics and AI practice, this means you might take a model’s assessment at face value without checking inputs, assumptions, or potential errors—especially when the automation feels authoritative or complex. This bias can lead to missing red flags or misinterpreting signals, because human judgment is subdued in favor of what the automated system presents. The other terms come from different domains and don’t describe this specific tendency. Retrieval Augmented Generation is a technique for combining retrieved information with a generative model to produce outputs, not a tendency to trust automation. Consequentialism and Deontology are ethical frameworks about how to judge actions and duties, not about how people interact with automated systems. To counter automation bias, keep a human-in-the-loop, require independent checks, test models across varied scenarios, examine model confidence and explanations, and ensure data quality and transparency in the decision process.

Automation bias is the tendency to trust automated systems blindly, accepting their outputs with little critical scrutiny. In risk analytics and AI practice, this means you might take a model’s assessment at face value without checking inputs, assumptions, or potential errors—especially when the automation feels authoritative or complex. This bias can lead to missing red flags or misinterpreting signals, because human judgment is subdued in favor of what the automated system presents.

The other terms come from different domains and don’t describe this specific tendency. Retrieval Augmented Generation is a technique for combining retrieved information with a generative model to produce outputs, not a tendency to trust automation. Consequentialism and Deontology are ethical frameworks about how to judge actions and duties, not about how people interact with automated systems. To counter automation bias, keep a human-in-the-loop, require independent checks, test models across varied scenarios, examine model confidence and explanations, and ensure data quality and transparency in the decision process.

Subscribe

Get the latest from Examzify

You can unsubscribe at any time. Read our privacy policy