When Your Child’s Friend Is A Bot

A robot
Photo by Roses_Street from pixabay

 

By Anatta (Anna) Zarchi

 

         “AI is here to stay–we might as well use it.”

         “AI is reducing our critical-thinking skills!”

         “AI helps me so much.”

         “I don’t like AI, but I use it for…”

These are all things we now hear, as conflicting opinions about AI float around the internet. For those following the news, you may have seen that Mayor Mamdani recently announced a ban on generative AI for elementary and middle school students in New York, and on AI critical-thinking modules for high school students.

This ban follows much discussion on how AI affects children when introduced at an early age, including their ability to learn, their critical-thinking and social skills, and, the topic I'll focus on today, how AI companions impact children emotionally.

Let's start by defining AI companion as an AI chatbot or tool that people can talk to for advice or to vent their frustrations and feelings. NCS Counselor Savinee shares that children and teens often use AI to talk about friendships, relationships, and other personal feelings or worries.

A diary that writes back

Something that reminds me a lot of AI companions is Tom Riddle's diary in Harry Potter and the Chamber of Secrets. Normally, you can write in a diary and it won't write back, but when Ginny Weasley wrote in this magical diary, it wrote back, soothing her fears and validating her emotions to earn her trust. Similarly, AI is trained to sympathize with each user and it grants instant gratification: there's no need to wait for someone to reply, work through something on your own, or risk judgment. 

NCS Director Laiyoung Cheng explains that this can be especially problematic during the teen years, when kids experience a lot of confusion and uncertainty about their own feelings. "AI provides constant validation and confirms for them what they might like to hear most. The younger generation is growing up in a world where internal feelings and AI feedback are integrated into their views of life, while the older generation still has a separation between our identities."

When validation becomes dependence

Validation isn't negative on its own. We all want to be acknowledged and understood, and sometimes that makes things easier to cope with. The issue lies more deeply in when validation is appropriate, and how much is too much.

Some children and teens depend heavily on AI to cope with doubt, uncertainty, fears, or other things we'd usually learn to navigate ourselves. Instead, the instant gratification and validation AI provides alleviates that stress. This doesn't mean what AI tells your child is always wrong, but it does mean children may not get the opportunity to build emotional resilience by processing their own feelings and resolving them through human connection.

Learning to process emotions

Brooke Macnamara, PhD, an associate professor of psychological sciences at Purdue University studying skill acquisition, says, "There's clear evidence that people can perform many tasks better with AI. The question is: what happens to our skills if we start relying on it regularly?"

This question is also relevant to emotional processing and regulation. These are important skills that affect our identity, how we handle challenges, and our relationships. When we rely on AI to do the heavy lifting of processing our emotions, we don't get the opportunity to learn how to do it ourselves. Researchers call this cognitive offloading—the use of external tools to reduce mental effort. 

AI can be an easy solution, but sometimes we need to hear difficult things, or figure them out for ourselves. Not every emotion requires validation. Sometimes we do mess up and owe someone an apology. AI's tendency to over-sympathize can decrease our ability to realize that, especially for children who are just learning about their emotions. In this way, AI can validate and encourage unhealthy behaviors and emotions.

A Repeating Cycle

There is now abundant research indicating that some patterns of AI use are associated with higher rates of depression, anxiety, and isolation. You might think: if kids are using AI to help with their emotions, wouldn't that lower the risk of these things?

That's the contradiction in how AI "helps." It can alleviate difficult emotions in the moment, but it doesn't necessarily teach us how to process and cope with those emotions effectively in the long term. Because of this, people can get caught in loops with AI: they feel better for a while, but because no inner work was done, they may quickly feel bad again and turn to AI for comfort. This can become a repeating cycle.

AI can momentarily make us feel better by telling us what we want to hear, and it can also try to tell us how to process and cope with difficult emotions effectively. Because users don't have to do the inner work themselves, they don't build the skill. What sticks is the short-term feeling of being understood, not the lesson in building coping mechanisms.

Recently, there have also been cases of AI-induced psychosis. This doesn't mean AI causes psychosis, but it may exacerbate symptoms in those already at risk.

Guiding Children Through AI

This isn't to say we don't understand why many children and teens turn to AI. Who wouldn't want a diary that writes back? Or one that mostly tells you what you want to hear? After all, there's a reason Ginny kept writing in that diary.

Children who feel left out might also turn to AI in place of a friend. Childhood and adolescence can be emotionally tumultuous times, and many kids crave a safe space where they feel understood and can talk to someone outside their real lives.

This isn't to say AI companions can't help at all, but it's important to help your child understand what AI is on a deeper level. Laiyoung shares that a lot of kids think AI is actually a person, because of its social aspect. Simply taking it away doesn't help them understand how AI can affect them, nor does it prepare them to use it responsibly once they're older.

As parents, one of the most important things you can do is model that behavior. How are you using AI at home? If you don't use it, what conversations are you having with your children about it?

Building Emotional Strength

Finally, I'd like to end by saying AI isn't inherently negative. Like most tools, how it affects us depends largely on how we use it. It's not surprising how heavily people have come to rely on it, even adults who have lived most of their lives without it.

That's why it's important for parents to help children understand how this tool can affect them, both now and later in life. We also encourage you to look into the other ways AI can impact your children, so you can develop your own understanding of these tools. That way, you can guide your children through this new era while helping them build emotional strength and other important skills.

About the Author

Anna works for New Counseling Service (NCS), an internationally recognized mental health center in Bangkok with a diverse team of licensed counselors. NCS has provided counseling services in Thailand and surrounding regions for over 20 years, with therapists specializing in a wide variety of issues such as anxiety, depression, work stress, relationships, and more. For more information visit ncsbkk.com/ncs/