AI, Misinformation and Mental Health

Misinformation in the era of AI: Implications for mental health and wellbeing

Introduction

The rapid development of artificial intelligence (AI) has ushered in a new era of information dissemination with both promising and concerning implications1,2. AI is defined as technology that enables machines to mimic human intelligence3. This technology is characterised by enhanced data processing, specialized pattern recognition and routine cognitive automation which have paved the way for innovations in various businesses such as healthcare, manufacturing, fashion, education and social media4. AI- powered tools have the potential to streamline knowledge sharing, enhancing education experiences, and personalizing user support5,6. However, they also present serious challenges such as the emergence of misinformation, particularly on social media platforms and concerns regarding user privacy6-8. The development of generative AI models has further complicated this situation, as these models can create content that closely resembles human generated content. This capability raises alarms about the potential for spreading misleading, inaccurate, or falsified information leading to adverse mental health outcomes 9,10.

This article seeks to explore the critical question: how AI-generated disinformation might affect mental health, including anxiety, depression, fear, and eating disorders? This enquiry is significant as it addresses the potential psychological implications of AI in an era where misinformation is rampant, especially on social media platforms.

Impact of misinformation on mental health

Research indicates that the dissemination of misinformation, especially during crises like the COVID-19 pandemic has significantly contributed to increased anxiety, panic levels among the population, and mistrust in government policies11. An example is the antivaccination campaigns that were released on social media platforms12.

Political misinformation can have significant implications for mental health, especially when amplified through AI technologies13.  For instance, during the 2020 US presidential campaigns there was evidence of misleading information circulated on social media platforms, particularly Twitter, influencing public opinion and potentially contributing to events like the Capitol invasion on Jan 6th, 2021. This incident resulted in injures, several deaths and a widespread sense of fear and insecurity among individuals14.

In Lithuania, a similar pattern emerged when the country received numerous fake reports of bomb threats written in the Russian language. Officials suspect that this was a deliberate strategy by Russia to spread fear and unrest in nations that oppose the war in Ukraine14.

Several studies reveal that continuous exposure to negative or deceptive news online may contribute to various mental health issues including depression, mood swings, paranoia and isolation15,16.

Additionally, in South Sudan, the dissemination of falsified news on social media by anonymous sources have increased violence rates against minority groups in that region17, with likely knock-on effects for those affected, including PTSD (post-traumatic stress disorder)18.

Altered images

In the fashion, beauty and other consumer industries widespread digital retouching of advertising imagery sometimes promotes unrealistic beauty standards. This can have harmful effects on mental health. In particular, exposure to misleading beauty imagery is linked with greater body dissatisfaction, worse mood, poorer self-esteem, and increased risk for disordered eating behaviours18.

Social media platforms such as Instagram and TikTok offer features that allow users to alter photos, leading to exposure to ideal images of others. This exposure can lead to depression and low self-esteem, especially among young adults19,20.

Similarly, a study of Dutch and Japanese teenagers found that whereas both creating and seeing authentic content can be associated with increased mental health and body satisfaction, conversely both creating and seeing edited content can coincide with reduced levels of mental health and body satisfaction21.

Conclusion

Overall, the proliferation of AI-generated disinformation poses a significant threat to mental health. By spreading misleading or falsified information, AI can contribute to increased levels of anxiety, depression and fear among vulnerable users. The ability of AI to create highly realistic content further complicates the issue, making it increasingly difficult to distinguish fact from fiction.

As AI technology continues to advance, it is crucial to develop strategies to mitigate the negative impacts of AI-generated misinformation on mental health. This includes promoting media literacy, fostering critical thinking skills, and establishing fact checking systems. Moreover, collaboration between policy makers and technology companies is essential to create ethical guidelines and regulations governing AI's development and application.

Farida Ali  2025

 

References

1            Thakkar, A., Gupta, A. & De Sousa, A. Artificial intelligence in positive mental health: a narrative review. Front Digit Health 6, 1280235, doi:10.3389/fdgth.2024.1280235 (2024).

2            Alowais, S. A. et al. Revolutionizing healthcare: the role of artificial intelligence in clinical practice. BMC Medical Education 23, 689, doi:10.1186/s12909-023-04698-z (2023).

3            Sharma, S. Benefits or concerns of AI: A multistakeholder responsibility. Futures 157, 103328, doi:https://doi.org/10.1016/j.futures.2024.103328 (2024).

4            Dwivedi, Y. K. et al. Evolution of artificial intelligence research in Technological Forecasting and Social Change: Research topics, trends, and future directions. Technological Forecasting and Social Change 192, 122579, doi:https://doi.org/10.1016/j.techfore.2023.122579 (2023).

5            Jarrahi, M. H., Askay, D., Eshraghi, A. & Smith, P. Artificial intelligence and knowledge management: A partnership between human and AI. Business Horizons 66, 87-99, doi:https://doi.org/10.1016/j.bushor.2022.03.002 (2023).

6            Shah, B. & S. M. B, N. in 2022 5th International Conference on Advances in Science and Technology (ICAST).  431-434.

7            Saheb, T., Sidaoui, M. & Schmarzo, B. Convergence of artificial intelligence with social media: A bibliometric & qualitative analysis. Telematics and Informatics Reports 14, 100146, doi:https://doi.org/10.1016/j.teler.2024.100146 (2024).

8            Shahzad, M. F., Xu, S., Lim, W. M., Yang, X. & Khan, Q. R. Artificial intelligence and social media on academic performance and mental well-being: Student perceptions of positive impact in the age of smart learning. Heliyon 10, e29523, doi:https://doi.org/10.1016/j.heliyon.2024.e29523 (2024).

9            Dwivedi, Y. K. et al. Opinion Paper: “So what if ChatGPT wrote it?” Multidisciplinary perspectives on opportunities, challenges and implications of generative conversational AI for research, practice and policy. International Journal of Information Management 71, 102642, doi:https://doi.org/10.1016/j.ijinfomgt.2023.102642 (2023).

10          Romero Moreno, F. Generative AI and deepfakes: a human rights approach to tackling harmful content. International Review of Law, Computers & Technology, 1-30, doi:10.1080/13600869.2024.2324540.

11          Dobson-Lohman, E. & Potcovaru, A.-M. Fake News Content Shaping the COVID-19 Pandemic Fear: Virus Anxiety, Emotional Contagion, and Responsible Media Reporting. Analysis and Metaphysics 19, 94+ (2020).

12          Monteith, S. et al. Artificial intelligence and increasing misinformation. Br J Psychiatry 224, 33-35, doi:10.1192/bjp.2023.136 (2024).

13          Larson, H. J. & Lin, L. Generative artificial intelligence can have a role in combating vaccine hesitancy. Bmj 384, q69, doi:10.1136/bmj.q69 (2024).

14          Turčinavičiūtė, A. REACTIONS TO MANIPULATIONS IN THE U.S. ELECTIONS: DEEPFAKE WAR BETWEEN RON DESANTIS AND DONALD TRUMP (2024).

15          Buoncompagni, G. Epidemiology of News: Doom Scrolling, Information Overload, and Other “Media Pathologies” in Our Infected Society. Journal of Sociological Research 14, 17, doi:10.5296/jsr.v14i1.20808 (2023).

16          Nela, A. & Parruca, E. Impact of Social Media Disinformation and of Fake News Overexposure on the Actual Capacities and the Psychological Wellbeing During the Covid-19 Pandemic: a Systemic Literature Review. The Global Psychotherapist 3, 126-132, doi:10.52982/lkj191 (2023).

17          Flores-Vivar, J. Artificial intelligence and journalism: diluting the impact of disinformation and fake news through bots. Doxa Comunicación. Revista interdisciplinar de estudios de comunicación y ciencias sociales, 197-212, doi:10.31921/doxacom.n29a10 (2019).

18          Ng, L. C., López, B., Pritchard, M. & Deng, D. Posttraumatic stress disorder, trauma, and reconciliation in South Sudan. Soc Psychiatry Psychiatr Epidemiol 52, 705-714, doi:10.1007/s00127-017-1376-y (2017).

19          Górska, D. et al. Influence of social media on developing body image dissatisfaction and eating disorders. Journal of Education, Health and Sport 22, 56-62, doi:10.12775/JEHS.2023.22.01.005 (2023).

20          Jiotsa, B., Naccache, B., Duval, M., Rocher, B. & Grall-Bronnec, M. Social Media Use and Body Image Disorders: Association between Frequency of Comparing One's Own Physical Appearance to That of People Being Followed on Social Media and Body Dissatisfaction and Drive for Thinness. Int J Environ Res Public Health 18, doi:10.3390/ijerph18062880 (2021).

21          Bij de Vaate, N. A. J. D., Veldhuis, J. & Konijn, E. A. The impact of seeing and posting photos on mental health and body satisfaction: A panel study among Dutch and Japanese adolescents. Computers in Human Behavior 148, 107906, doi:https://doi.org/10.1016/j.chb.2023.107906 (2023).