AI’s Hit Song for the Ages! Katchafire is Reinvented in Auckland: A Song for a Broken Tongan Heart by Her Solomons Beau!
June 27, 2024
Are You Ready for AI That Knows How You Feel? Why You Should Be Concerned!
June 28, 2024TikTok placed zero content restrictions on the app. Any words we put in created a video with a peppy “Stock AI” Avatar reciting them. That included:
-The 14 words
-An excerpt from Mein Kampf
-Osama Bin Laden’s Letter to America
-A video telling people to drink bleach from “a… pic.twitter.com/I2QbqbDFnw— Jon Sarlin (@jonsarlin) June 21, 2024
@jonsarlin shows how TikTok can get away with the craziest shiznit imaginable (via X/Twitter)
TikTok’s AI Tool Mishap Exposes Major Flaws
TikTok mistakenly released an internal version of its new AI digital avatar tool, Symphony Digital Avatars, without the necessary content restrictions (The Verge). This error allowed users to create videos using paid actors’ likenesses that recited any script, including harmful and offensive content. Discovered by CNN, the tool generated videos quoting Hitler, Osama Bin Laden, and other inappropriate messages. TikTok quickly removed the internal version while retaining the intended version accessible to TikTok Ads Manager account holders.
Unrestricted Content Raises Serious Concerns
The internal version of Symphony Digital Avatars had zero content restrictions, enabling the creation of videos with highly inappropriate and dangerous messages. CNN’s investigation highlighted the tool’s potential misuse by generating videos without watermarks indicating they were AI-generated. This raises significant concerns about the potential for misuse and the platform’s ability to control such content.
TikTok’s Response and Future Implications
TikTok acknowledged the error and stated it affected a minimal number of users for a few days. They assured that any violating content would have been rejected if posted on the platform. Despite resolving the issue, this incident underscores the need for robust safeguards in AI tools to prevent misuse. It also questions whether TikTok is adequately prepared to manage the potential abuse of its digital avatar creator in the future.
(Visit The Verge for the full story)
*An AI tool was used to add an extra layer to the editing process for this story.
