AI Article Synopsis

  • This study examines how people's judgments of an AI system's reliability change over time and aims to compare different predictive models (quantum vs. Markov) for understanding these changes.
  • The researchers found that the quantum model outperformed the Markov model in predicting how people adjusted their reliability ratings, possibly due to the quantum model's ability to capture individual variability better.
  • Additionally, they identified a neural response in EEG data that indicates shifts in expectations about the AI's reliability, suggesting potential for real-time adjustments to the model based on these findings.

Article Abstract

This exploratory study investigates a human agent's evolving judgements of reliability when interacting with an AI system. Two aims drove this investigation: (1) compare the predictive performance of quantum vs. Markov random walk models regarding human reliability judgements of an AI system and (2) identify a neural correlate of the perturbation of a human agent's judgement of the AI's reliability. As AI becomes more prevalent, it is important to understand how humans trust these technologies and how trust evolves when interacting with them. A mixed-methods experiment was developed for exploring reliability calibration in human-AI interactions. The behavioural data collected were used as a baseline to assess the predictive performance of the quantum and Markov models. We found the quantum model to better predict the evolving reliability ratings than the Markov model. This may be due to the quantum model being more amenable to represent the sometimes pronounced within-subject variability of reliability ratings. Additionally, a clear event-related potential response was found in the electroencephalographic (EEG) data, which is attributed to the expectations of reliability being perturbed. The identification of a trust-related EEG-based measure opens the door to explore how it could be used to adapt the parameters of the quantum model in real time.

Download full-text PDF

Source
http://www.ncbi.nlm.nih.gov/pmc/articles/PMC10528121PMC
http://dx.doi.org/10.3390/e25091362DOI Listing

Publication Analysis

Top Keywords

quantum model
16
calibration human-ai
8
human-ai interactions
8
human agent's
8
predictive performance
8
performance quantum
8
quantum markov
8
reliability ratings
8
reliability
7
quantum
6

Similar Publications

Want AI Summaries of new PubMed Abstracts delivered to your In-box?

Enter search terms and have AI summaries delivered each week - change queries or unsubscribe any time!