Snapchat’s AI chatbot raises privacy concerns for kids

LONDON: Snapchat is under scrutiny for a “worrying failure” in assessing potential privacy risks associated with its AI chatbot, especially concerning children, according to the UK’s Information Commissioner’s Office (ICO).

The ICO issued a warning, stating that it could potentially shut down the My AI feature in the UK after a preliminary investigation. Snapchat’s parent company, Snap, acknowledged the seriousness of the matter, noting that it is “closely reviewing” the ICO’s provisional findings.

My AI is a tool allowing users to engage in conversations with a computer that mimics human interaction. Snapchat labels it as an “evolving feature” powered by ChatGPT, an AI tool that convincingly imitates realistic responses using new technology.

Earlier this year, Snap became the first social media platform to adopt an AI-powered chat function. With 21 million users in the UK, including a significant number of children, the ICO expressed particular concern about privacy risks for users aged 13 to 17.

Read More: Samsung unveils One UI 6 loaded with exciting new features

Snap responded by stating its commitment to “work constructively” with the ICO and emphasised that it conducted a “robust legal and privacy review” before making the feature public.

Meanwhile, the ICO clarified that its findings are provisional and no conclusion has been reached regarding the violation of data protection laws. The notice serves as a signal for Snap to ensure My AI complies with data protection rules, including the Children’s Design Code.

The Children’s Design Code, consisting of 15 standards, mandates online services to comply with data protection laws for safeguarding children’s data online.

The ICO highlighted that if a final enforcement notice is issued, Snap might be prevented from offering the My AI function to UK users until the company conducts “an adequate risk assessment.”

Understanding ‘My AI’

Described by the company as an “experimental and friendly” chatbot designed to be a personal sidekick, My AI aims to assist Snapchat users with tasks like planning day trips or creating menus. According to , Snap’s CEO Evan Spiegel the feature registers over two million chats per day on the app.

Launched in February for a fee and made available to all Snapchat users in April, the social media platform acknowledged that “a lot of progress” had been made in My AI’s capabilities.

However, Snap also admitted that the chatbot may occasionally provide incorrect or biased answers and may express uncertainty, cautioning users not to solely rely on its advice.