HomeSocial Media MarketingTikTok Continues to Experiment with Generative AI Tools, Including New Voice Replication...

TikTok Continues to Experiment with Generative AI Tools, Including New Voice Replication Process

Whereas the main U.S. tech gamers proceed to experiment with new makes use of for generative AI, China’s Bytedance can be making vital advances, which might find yourself giving TikTok and edge in AI utilization, and driving new behaviors because of AI instruments.

The problem, as most social apps have discovered, is there isn’t actually a invaluable, rapid use case for generative AI in social apps.

Certain, you’ll be able to add in a chatbot, however individuals principally need to join with different individuals (therefore the “social” moniker), whereas picture technology instruments have seemingly restricted novelty worth, and generative AI publish instruments can even detract from human engagement.

Which is the place I really feel like TikTok is taking a extra logical and invaluable method, by implementing options that may really drive engagement.

Although its newest experiment is a bit more questionable on this entrance.

As Enterprise Insider stories, ByteDance has developed a brand new AI mannequin that may replicate any particular person’s voice, with plausible sufficient accuracy, primarily based on minimal enter.

ByteDance’s “StreamVoice” system can use just some utterances to copy an individual’s voice in actual time, enabling you to copy just about any particular person’s speech (you’ll be able to hear examples of StreamVoice outputs right here).

Analysts have highlighted the potential for misuse, with fraud and different misleading conduct set to be facilitated by scammers by way of such methods. Although it additionally price noting that Meta can be growing the identical, with its “AudioBox” software program now additionally out there for dwell testing on the net.

So why create instruments that may replicate individuals’s voice?

In Meta’s AudioBox paper, it says that the device will “decrease the barrier of accessibility for audio creation”, offering extra alternative for extra individuals to create audio content material.

“Creators might use fashions like Audiobox to generate soundscapes for movies or podcasts, customized sound results for video games, or any of a lot of different use circumstances.”

Unsure that’s considerably totally different to recording the audio direct, however conceptually, it might allow extra variations of spoken textual content in your initiatives, which can allow broader inventive expression.

ByteDance is clearly eyeing the identical, and given the recognition of TikTok’s robotic voice components already, it might allow extra methods to boost the audio of your clips.

It’s one other step in TikTok’s evolving AI toolset, which additionally consists of generative AI profile photographs, improved contextual search, and AI music technology in-stream, whereas it’s additionally testing text-to-video creation instruments and AI chatbots of various capability.

And that’s not all. In accordance with a brand new report from Bloomberg, TikTok’s additionally now increasing its take a look at of an automatic characteristic which might make all posts within the app shoppable, by figuring out objects in each video, then prompting viewers to “discover related gadgets on TikTok Store”.

TikTok shopping recommendations

That’s been in testing for a while, with Insider posting the above picture as a part of its story on the undertaking final November, whereas it’s additionally been in testing on Douyin, the Chinese language model of the app, since 2019. So ByteDance has had a very long time to revise and enhance this component forward of a broader TikTok launch.

The incorporation of smarter AI will assist to make this a extra invaluable purchasing device, by showcasing extra merchandise to extra customers, and matching the outcomes primarily based on preferences.

And provided that TikTok is already a key discovery device for a lot of younger customers, it is sensible for the app to construct on this component, and encourage new utilization behaviors, aligned with its broader purchasing push.

Basically, TikTok is making the neatest strikes in the direction of incorporating AI in a complementary means, which is able to improve its core use case, versus being tacked on, as a way to latch onto the newest tech pattern.

That, as famous, is one thing that different platforms are nonetheless battling, and it’ll be fascinating to see how TikTok appears to combine extra AI capabilities over time, and whether or not they do certainly information new utilization behaviors within the app. 


Most Popular