Over a month has passed since Snapchat introduced ChatGPT features into their ‘My AI’ tool, answering user questions with AI-generated responses. The company has acknowledged concerns about the chatbot’s potential for abuse and has announced changes designed to make it safer.
In order to assess the severity of potentially harmful content and temporarily revoke Snapchatters’ access to My AI if they abuse the service, Snapchat has added Open AI’s moderation technology to their existing toolkit.
Furthermore, the company has implemented a new age signal for My AI that uses a Snapchatter’s birthdate, so that even if a Snapchatter never tells My AI their age in a conversation, the chatbot will consistently take their age into account when engaging in conversation.
In the upcoming weeks, Snapchat will give parents more information about how their kids are interacting with My AI. This means that parents can check in with Family Center to see if and how often their teens are interacting with My AI.
Regarding the concerns over My AI bot, Snapchat says,
We continue to encourage Snapchatters to use our in-app reporting tools if they receive any concerning responses from My AI and to submit feedback to us about their overall experiences with the product.
We are constantly working to improve My AI, and we will continually evaluate additional measures to help keep our community safe. We appreciate all of the early feedback on My AI, and we are committed to providing a fun and safe experience for our community.