HOME People & Events

Teen’s tragic death sparks urgent debate on TikTok’s harmful AI algorithms

2024.06.16 07:08:07 Brian Lee
668

[TikTok. Photo Credits to Pixabay]

The recent suicide of Chase Nasca, a 16-year-old high school student, has ignited a crucial conversation about the dangers of TikTok’s AI algorithm and its influence on the mental well-being of teenagers.

 

An examination of Nasca’s TikTok activity revealed the platform’s algorithm can promote content, such as cyberbullying and harmful challenges, detrimental to mental health.

 

Chase’s parents discovered more than 1,000 unsolicited videos that promoted suicide and self-harm.

 

In a digital world where social media is integral to teenagers’ lives, platforms such as TikTok use sophisticated AI algorithms designed to maximize user engagement.

 

By analyzing vast amounts of data, including user interactions, preferences, and viewing habits, these algorithms create content feeds that are impossible to resist.

 

The effectiveness of these algorithms lies in their ability to exploit the brain’s reward system.

 

Each time users see a video they like, their brain releases dopamine, creating a cycle of craving, fulfillment, and ultimately, addiction.

 

Unfortunately, the impact of these algorithms extends beyond addiction, leading to more severe consequences.

 

Principal investigator Dr. Kaitlyn Regehr of UCL Information Studies has voiced concerns about the impact of these algorithms on teenagers.

 

She stated, “Algorithmic processes on TikTok and other social media sites target people’s vulnerabilities - such as loneliness or feelings of loss of control - and gamify harmful content. As young people microdose on topics like self-harm, or extremism, to them, it feels like entertainment.”

 

Dr. Regehr’s statement highlights the threat posed by social media algorithms.

 

They not only foster addiction but also expose and normalize harmful content.

 

Algorithmic suggestions tempt users to stay on the platform for extended periods, and research indicates that more time spent online is linked to heightened exposure to content unsuitable for one’s age, unattainable beauty standards, violence, or even instances of cyberbullying.

 

The normalization of harmful content through these algorithms could contribute to desensitization to issues such as violence, extremism, and mental health challenges.

 

Chase’s death is a poignant example of how exposure to such content can have devastating consequences.

 

Blaine Luetkemeyer, a current US representative of Missouri’s 3rd District, also openly criticized TikTok and its AI algorithm.

 

He explained, “Chase was flooded with videos promoting suicide for hours every day. Needless to say, his family is devastated and will live the rest of their lives with the inconsolable pain of losing the one thing in the world a parent cannot live without.”

 

Chase’s feed was flooded with an endless stream of clips about hopelessness, depression, and pain.

 

This continuous exposure not only overwhelmed him with distress but also exacerbated his struggles with mental health.

 

Two weeks after his death, Chase’s mother started searching his social media accounts, only to find what the algorithm had brought him: videos about suicide and death.

 

The pervasive influence of AI algorithms on social media platforms is not only fueling addiction among teenagers but also significantly impacting mental health.

 

The heartbreaking loss of Chase Nasca displays the devastating impact that unchecked social media algorithms can have on teenagers.


Brian Lee / Grade 10 Session 6
The Episcopal Academy