Cookies on this website

We use cookies to ensure that we give you the best experience on our website. If you click 'Accept all cookies' we'll assume that you are happy to receive all cookies and you won't see this message again. If you click 'Reject all non-essential cookies' only necessary cookies providing core functionality such as security, network management, and accessibility will be enabled. Click 'Find out more' for information on how to change your cookie settings.

This paper draws on three case studies to examine some of the challenges and tensions involved in the use of Autonomous Decision-Making Systems (ADMS). In particular, the paper highlights: i) challenges around the shifting ‘locale’ of the decision, and the associated consequences for stakeholders; ii) potential implications for stakeholders from regulation such as the General Data Protection Regulation (GDPR); iii) the different values that stakeholder groups bring to the ‘decision’ question; iv) how complex pre-existing webs of stakeholders and decision-making authorities may be disrupted or disempowered by the use of an automated system and the lack of evaluation of possible consequences; v) how ADMS for non-technical users can lead to circumvention of the boundaries of intended system use. We illustrate these challenges through case studies in three domains: adult social care, aviation, and vehicle driver monitoring systems. The paper closes with recommendations for both practice and policy in the deployment of ADMS.

Type

Journal article

Journal

Frontiers in Political Science

Publisher

Frontiers Media

Publication Date

14/11/2023

Volume

5

Keywords

aviation, Boeing 737, human factors, MAX MCAS, transparency and explain, adult social care