Social Pressure: The AI Version
New studies from Tel Aviv University and the University of Western Ontario reveal a phenomenon of algorithmic conformity: a tendency for humans to adopt incorrect recommendations from artificial intelligence systems, even when they contradict simple independent judgment. In an experiment where 1,445 participants tagged images, 19%–27% adopted incorrect algorithm recommendations. Another study showed that even when rejecting the system's advice, confidence in the independent decision decreases. The researchers warn that the common solution of keeping 'the human in the loop' is insufficient, as human judgment is already influenced by exposure to the recommendation.
The author, CEO of Humane AI and an expert in human-AI interaction, describes a personal experience where a smart ring complimented her on a good night's sleep despite her waking up tired. She wonders why she doubted her own feeling against the system's data. The article presents two key studies: the first, by Yotam Liel and Prof. Lior Zalmanson from Tel Aviv University, where 1,445 participants performed simple image tagging tasks. Alongside the images, a deliberately incorrect algorithm recommendation was displayed, and 19%–27% of responses matched the incorrect recommendation, compared to less than 1% errors in the control group. The researchers call this 'algorithmic conformity' and compare it to Solomon Asch's classic conformity experiment from the 1950s. The second study, by Lili Suleimanov and Prof. Derrick Neufeld from the University of Western Ontario, tested 440 participants and found that even when rejecting the system's advice, confidence in the original decision decreases. The article warns that the common solution of keeping 'the human in the loop' is insufficient, as human judgment is already influenced by exposure to the recommendation. However, in an experiment where participants thought their decisions had real consequences for the safety of autonomous vehicles, the rate of accepting incorrect recommendations dropped by about half.