An Ethical Analysis of the Emotional Relationship between Humans and Artificial Intelligence

Document Type : Policy Note

Authors

1 Postdoctoral Researcher, International Center for Ethics in Sciences and Humanities, University of Tuebingen, Tuebingen, Germany.

2 M.A. student, Faculty of Psychology and Educational Sciences, Allameh Tabatabaei University, Tehran

3 M.A. of Philosophy of Science and Technology, Amirkabir University of Technology, Tehran, Iran

10.22034/jstp.2025.11773.1816

Abstract

‏ 
The interactions between humans and AI-based interactive technologies, particularly social bots, exhibit unique characteristics that distinguish them from human-to-human interactions as well as those with other types of technologies. As users in the world, and consequently in Iran increasingly engage with social bots, there is potential for the development of emotional bonds between users and these intelligent systems. Given their unique nature and the expectations shaped by corporate marketing and advertising, social bots can generate perceptions of agency and emotions, which in turn may foster one-sided emotional attachments from users. These attachments raise a range of significant ethical, social, and psychological concerns that can affect both individuals and larger communities. The present paper seeks to investigate the ethical challenges that arise from human-bot relationships, particularly in terms of the attribution of agency and the development of emotional dependency. In addition, it examines potential policies and solutions that have been proposed to mitigate these issues, focusing on strategies that can address concerns about the impact of these technologies. By critically analyzing these challenges, the study aims to propose policy recommendations that are specifically tailored to the implications of social bots use in the societal context. Ultimately, the findings highlight the need for a balanced approach that takes into account both the potential benefits and risks of such technologies, ensuring that their integration into daily life aligns with ethical standards and societal values.

Keywords

Main Subjects

References

[1] Scheutz, M. (2012). The Inherent Dangers of Unidirectional Emotional Bonds Between Humans and Social Robots. In Robot Ethics: The Ethical and Social Implications of Robotics (p. 205-221). MIT Press.
[2] Cominelli, L., Mazzei, D., & De Rossi, E. (2018). SEAI: Social Emotional Artificial Intelligence Based On Damasio’s Theory Of Mind.  Frontiers in Robotics and AI. https://doi.org/10.3389/frobt.2018.00006
[3] Wu, J. (2024). Social And Ethical Impact of Emotional AI Advancement: The Rise of Pseudo-Intimacy Relationships and Challenges in Human Interactions. Frontiers in Psychology, 15, Article 1410462. https://doi.org/10.3389/fpsyg.2024.1410462
[4] Shouse, E. (2005). Feeling, Emotion, Affect.  M/C Journal, 8 (6). https://doi.org/10.5204/mcj.2443
[5] Bechara, A., Damasio, H., & Damasio, A. R. (2000). Emotion, Decision Making, And the Orbitofrontal Cortex.  Cerebral Cortex,  10 (3), 295–307. https://doi.org/10.1093/cercor/10.3.295
[6] Matsumoto, D., & Hwang, H. (2019). Functions of Emotions. In J. Cummings & L. Sanders (Eds.), Introduction to psychology (University of Saskatchewan).
[7] Sung, J. Y., Guo, L., Grinter, R. E., & Christensen, H. I. (2007). "My Roomba Is Rambo": Intimate Home Appliances.  UbiComp 2007: Ubiquitous Computing. Berlin: Springer, 145-162. https://doi.org/10.1007/978-3-540-74853-3_9
[8] Kahn, P. H., Friedman, J., & Hagman, J. (2002). I Care About Him as A Pal: Conceptions of Robotic Pets in Online Aibo Discussion Forums. In CHI EA '02: CHI '02 Extended Abstracts on Human Factors in Computing Systems (pp. 632–633). https://doi.org/10.1145/506443.506519
[9] Prescott, T. J., & Robillard, J. M. (2021). Are Friends Electric? The Benefits and Risks Of Human-Robot Relationships.  iScience, 24 (1). https://doi.org/10.1016/j.isci.2020.101993
[10]​​ Bao, A., Zeng, Y., & Lu, E. (2023). Mitigating Emotional Risks in Human-Social Robot Interactions Through Virtual Interactive Environment Indication.  Humanities and Social Sciences Communications,10, Article 638. https://doi.org/10.1057/s41599-023-01752-7
 [11] Boine, C. (2023). Emotional Attachment To AI Companions And European Law.  MIT Case Studies in Social and Ethical Responsibilities of Computing, Winter 2023 (February). https://doi.org/10.21428/2c646de5.db67ec7f
[12]​​ Weber-Guskar, E. (2021). How Do Feel About Emotionalized Artificial Intelligence? When Robot Pets, Holograms, And Chatbots Become Affective Partners.  Ethics and Information Technology, 23 , 601–610. https://doi.org/10.1007/s10676-021-09598-8
[13] Castellano, G., Leite, I., Paiva, A., & McOwan, P. W. (2012). Affective Teaching: Learning More Effectively From Empathic Robots.  Awareness Magazine: Self-Awareness in Autonomic Systems. https://doi.org/10.2417/3201112.003948
[14] Friedenberg, J., & Silverman, G. (2005).  Cognitive Science: An Introduction to The Study of Mind. SAGE Publications. https://doi.org/10.4135/9781071802769
[15] Kahn, P. H. (1999).  The Human Relationship With Nature: Development And Culture. MIT Press. https://doi.org/10.7551/mitpress/3602.001.0001
[16]​​ LaGrandeur, K. (2015). Emotion, Artificial Intelligence, And Ethics. In J. Romportl, P. Ircing, E. Zackova, M. Polak, & R. Schuster (Eds.), Beyond artificial intelligence: The disappearing human–machine divide (pp. 97–109). Springer. https://doi.org/10.1007/978-3-319-14408-6_10
[17] Arkin, R. (2007).  Governing Lethal Behavior: Embedding Ethics in A Hybrid Deliberative/Reactive Robot Architecture. Technical Report, Georgia Institute of Technology.
[18] Payandeh, R. and Kanani, H. (2024). Ethical Analysis of Terms and Conditions for the Use of AI-Based Products and Services in Iran. Journal of Science and Technology Policy, 17(3), 27-39. {In Persian{. doi: 10.22034/jstp.2025.11769.1813
[19] Shahbazinia, M. and Zolghadr, M. J. (2024). Recognizing Artificial Intelligence (AI) As A Legal Person: Providing A Policy Proposal to The Iranian Legislator. Journal of Science and Technology Policy, 17(3), 41-52. {In Persian {.doi: 10.22034/jstp.2025.11778.1819
 
 
 
 
 
 

Files

Share

How to cite

Statistics